This is one of my works with scrapy module of python. This bot crawls over the flipkart site and stores the details of the laptops which have offer.
- Install scrapy --
pip install scrapy
- Clone the repo
cd flipkart-bot/flipkart
scrapy crawl flipkart -o laptops.json
Thats it, you can now see the laptops details in laptops.json