Using ColdFusion to glue together Verity 97 and a popular offline browser
results in a powerful but low-cost and easy-to-create searchable Web spider.
Past issues of CFDJ have laid down a great foundation for creating and
optimizing Verity collections.
This article expands on CFDJ's Verity-related articles by demonstrating how
to create an Internet Web spider not unlike Yahoo. Since Verity and the
offline browser utility do most of the work, simple ColdFusion code is used
to create the searchable Web spider.
Background
According to whatis.com, a spider is "a program that visits Web sites and
reads their pages and other information in order to create entries for a
search engine index." A spider is only one piece of a Web search engine. We
also need a tool to create a Web site search index (or collection) and a tool
to search against the index with the user's search c... (more)