Scraping With Scrapy : Part 2

In this post I’ll be writing more about the files created when you create a new Scrapy Project, about how to write a simple spider and a crawl spider.

Simple spider (or Base Spider) will simply scrap the data, you need, from a single webpage whereas Crawl Spider recursively crawls through all the webpages.

Continue reading

#crawler, #parser, #scrapper, #scrapy, #web-crawler