Free Data/HTML Scraper?

Javert

Tank
Joined
Aug 29, 2003
Messages
3,384
Reaction score
3
Ok, I can see that I'm getting some blank stares.

Basically a scraper is something that reads off the html or a website and stores that information somewhere else. Things that you can scrape include news headlines, price info, etc.

I'm wondering if anyone knows of a low-cost (i.e. free) data scraper, or if it's difficult to code one yourself using HTML. Thanks ahead for the help, and apologies for making the forum a little too surreal today.
 
I installed an add-on for firefox called clipmarks where you can clip sections of text, images, or video, then post it somewhere else on the internet. don't know if that would be helpful for you but ...
 
1. Learn a programming language that allows you to make HTTP connections (any .NET language, C++, I'm guessing python, etc) and supports regex (regular expressions)
2. Learn regex
3. Craft a regex to cherry pick the data you need from wherever you need
4. ???
5. Profit!

Also, what you're looking for is called a "Screen Scraper". I don't know of any specifically, but google around a bit and I'm sure you'll find something.
 
Thanks, I'll take a look.

By the way, I'm not doing this for profit, it actually involves Half-Life 2 (go figure ^^) but I think it'd be pretty cool.
 
Back
Top