Take the 2-minute tour ×

Is there a good library/package to do web scraping using Scheme (preferably Racket)?

e.g. a Scheme equivalent of mechanize?

share|improve this question
Valid HTML (read XML) can be easily parsed into S-expressions. –  leppie Apr 5 '13 at 16:21
Right, but what about submitting html forms, navigating links, etc.? –  abeln Apr 5 '13 at 16:23
I am sure Racket has some http-client / web-client libraries. –  leppie Apr 5 '13 at 16:24
I haven't yet found a good mechanize-style library for Racket. –  dyoo Apr 5 '13 at 17:19
What about a "not-so-good" one? ;) –  abeln Apr 5 '13 at 17:22
add comment

1 Answer

up vote 3 down vote accepted

I've used a combination of the Racket net/url library, the html-parsing package, and SXML (especially sxpath, for XPath queries). Actually, I wrote some wrappers around net/url that make it slightly easier to use, IMO.

When I've needed to handle cookies, I've called out to the curl command instead of using net/url.

share|improve this answer
add comment

Your Answer


