Price Tracking Amazon | Tutorial | Python Code

How to web scrape Amazon and visualize the collected data for price tracking and trend monitoring.

This is a completed project based on web scraping the Amazon books category for: 'Web Scraping' books using Scrapy in Python. If you want to start collecting data now, so you can check if 'Black Friday' deals are really reduced then now is the time to start checking prices.

All of the files are available on GitHub. If you follow this you will learn how to web scrape Amazon to analyse entire categories of products and present the output in a human friendly plot (graph).

Warning : This is neither particularly 'quick' or 'easy' - there are plenty of tutorials that will use Selenium or BeautifulSoup to scrape a few products if that is what you need.

This project uses: Python ✔️ Scrapy ✔️ MySQL ✔️ Pandas ✔️ Matplotlib ✔️ Raspberry Pi ✔️ ssh ✔️ CRON ✔️

~ CHAPTER TIMES ~ 0:00 Intro 0:10 Network topology 0:18 Crontab CRON config 1:00 Run the spider manually 2:00 Viewing the output 4:38 The SQL query 6:18 The query result 10:50 Fixing remote access to MySQL database 12:12 bind-address = 0.0.0.0 14:17 Visualize the extracted data 19:18 Successful output 21:21 Adjusting the graph

Code : https://github.com/RGGH/Scrapy10/tree/DB-MySQL

This can be adapted and modified for price tracking and monitoring of any products on Amazon.

The entire Amazon Web Scraping playlist is here: https://www.youtube.com/playlist?list=PLKMY3XNPiQ7t8-1BT3XeM55nDLxtc0yoU

Disclaimer : This is for educational purposes only, if you run this code then you are responsible for it's use.

See you around yeah? Dr. P

#python #amazon #blackfriday2020 ... https://www.youtube.com/watch?v=grkwcZmfeLA