• View
• Edit
• History
• Print

SchemeSpider

Chris DiMaio December 11, 2008

Overview

Scheme Spider is a Web Crawler written solely in Scheme. It connects to the internet and collects information matching the user's specified search criteria and returns those results to the user as a web page.

Screenshot

Concepts Demonstrated

• Data abstraction is used to provide easy access to and manipulation of data within each web page.
• List Processing is heavily used to sort, search, and strip bits of information.
• Map and Filter are used to eliminate unwanted information in long lists of data.
• Recursion is used through out the program where ever an iterative process is needed. This includes tail recursion.
• Functional Programming is used in a small, but important portion of Scheme Spider.

External Technology

Scheme Spider uses the net/sendurl, net/url, html, xml Scheme libraries to communicate with the internet and make sense of information.

Innovation

I feel that Scheme Spider is innovative because it uses a little known technology to make a common application.

Technology Used Block Diagram

Additional Remarks

Use at on risk!