SpidersRUs Toolkits

SpidersRUs Digital Library Toolkit

• An integrated tool for building digital libraries and search engines
• Easy-to-use graphic user interface
• Modular components such as spiders, indexers, and searchers

[click here for free download]

Competitive Intelligence (CI) Spider

• Delivers meaningful Web intelligence to busy business executives
• Summarizes Web page content dynamically
• Easy-to-use graphical user interfaces

[click here for free download]

Meta Spider

• Queries multiple search engines simultaneously
• Extracts key phrases from retrieved Web pages
• Dyanimcally categories pages into different topics

[download not available]

Cancer Spider

• Connects with multiple cancer literature and evidence-based databases
• Document analysis customized for the medical domain
• Dynamically categorizes retrieved Web pages

[download not available]

GA Optimizer I and II

The itsy bitsy spider crawled the Web in search of pages which might interest you. You told the spider what type of homepages you are interested in by giving it URLs (http addresses) to start from and it will surf the Net for you by following links, looking at those pages, and reporting back on homepages of interest to you. The real-time dynamic search took several minutes to complete.

The itsy bitsy spider began with the URLs provides, along with some randomly selected homepages. Then, it followed the links on those pages deeper and deeper into the Web. At each page the spider paused and compared it with the original pages. Those pages which are most similar to the original pages provided to the spider received a higher ranking. The ranking was used to compute the probability for retention from one iteration to the next. For every iteration the spider consulted a database of URLs and selectively added new ones to look at, in hopes that some new and pertinent links will be found. The number of random URLs added to the search was determined by the mutation rate. The spider kept a list of the best pages found since the start of the search and those are displayed after each iteration. The itsy bitsy spider performed a global search of the Web as opposed to the BFS spider which only searches the local space.

Instructons: Type the starting URL(s) in the space provided. Enter one or more keywords. Category selection is optional. The time out and number of URLs to be returned can be adjusted. Press submit. The crossover and mutation rates can be adjusted before the search is started or while it is in progress.

[download not available]