
Webbots, spiders, and screen scrapers
Michael Schrenk · 2006
Machine learning, statistics and probability › Applied machine learning and computer vision
#13,395 most recommended
Hacker News
2
mentions by 2 people · top 79% of 15,732 books
Open Library
—
No ratings yet
Wikipedia
—
No article yet
About the book
A practical guide to writing programs that act as automated clients of the World Wide Web: bots, spiders, and screen scrapers that request pages, submit forms, handle cookies and sessions, and extract information from HTML. It is aimed at programmers who want to collect or monitor web data without a human at the browser, and it covers the web-programming techniques that work requires. The core position is that web pages are a usable programmatic data source, so software can retrieve and interpret them as reliably as it reads a file or database. The book presents the mechanics of doing this well, including parsing content that was designed for human readers. It also holds that such automation has to be built with care for the sites it visits, weighing legal and ethical limits such as site terms and robots exclusion conventions.
Written by Claude from what it knows of this book.
What Hacker News says 50% recommend · 0% critical
In the commenters’ own words
This looks like something I might want to check out. I've been writing modest little web bots/crawlers in shell script for quite a few years now. I think it…
In the book "Webbots, Spiders and Screen Scrapers" by Michael Schrenk, there's a topic that deals with automatic procurement and 'sniping' for those who are…
What Open Library readers say
No Open Library reader has rated it yet.
- 0 want to read
- 0 reading
- 1 have read
What critics say, via Wikipedia
No Wikipedia article about this book yet, so no critics to quote.
Reddit communities — coming later
Details
- First published
- 2006
- ISBN
- 9781593271206
- Editions known
- 2 at Open Library
- Open Library
- OL8989112W
Intelligent agents (Computer software)Intelligent agents (computer software)Internet programmingInternet searchingWeb search engines
Read next: its neighbours on the mosaic
Quantitative tradingErnest P. Chan · 2009 · recommended by 12 people · loosely similar by subject
The tangled WebMichal Zalewski · 2011 · recommended by 32 people · similar by subject and what people say about it
Automate thisChristopher Steiner · 2012 · recommended by 4 people · similar by subject and what people say about it
SQL for Web NerdsPhilip Greenspun · 2000 · recommended by 7 people · similar by subject and what people say about it
The intelligent webGautam Shroff · 2013 · recommended by 3 people · similar by subject and what people say about it
Programming Collective IntelligenceToby Segaran · 2007 · recommended by 86 people · similar by subject and what people say about it
Introduction to information retrievalChristopher D. Manning · 2008 · recommended by 41 people · similar by subject and what people say about it
Software engineering for Internet applicationsEve Astrid Andersson · 2006 · recommended by 10 people · similar by subject and what people say about it
The web application hacker's handbookDafydd Stuttard · 2007 · recommended by 31 people · similar by subject and what people say about it
Algorithms of the intelligent webHaralambos Marmanis · 2009 · recommended by 5 people · similar by subject and what people say about it
Javascript Web ApplicationsAlex MacCaw · 2011 · recommended by 8 people · similar by subject and what people say about it
Watch What I DoAllen Cypher · 1993 · recommended by 3 people · similar by subject and what people say about it
One Up On Wall StreetPeter Lynch · 1989 · recommended by 20 people · loosely similar by subject
Google HacksTara Calishain · 2002 · recommended by 1 person · similar by subject and what people say about it
Scalable Internet architecturesTheo Schlossnagle · 2006 · recommended by 9 people · similar by subject and what people say about it
Philip and Alex's Guide to Web PublishingPhilip Greenspun · 1999 · recommended by 15 people · similar by subject and what people say about it
Lucene in actionMichael McCandless · 2010 · recommended by 5 people · similar by subject and what people say about it
Social EngineeringChristopher Hadnagy · 2011 · recommended by 6 people · similar by subject and what people say about it
Web Copy That SellsMaria Veloso · 2004 · recommended by 3 people · similar by subject and what people say about it
Search user interfacesMarti Hearst · 2009 · recommended by 3 people · similar by subject and what people say about it
Data Science at the Command LineJeroen Janssens · 2014 · recommended by 8 people · similar by subject and what people say about it
Semantic web for the working ontologistDean Allemang · 2008 · recommended by 4 people · similar by subject and what people say about it
Automate the Boring Stuff with PythonAl Sweigart · 2015 · recommended by 75 people · similar by subject and what people say about it
The art of software security assessmentMark Dowd · 2006 · recommended by 21 people · similar by subject and what people say about it