Data scraped with Scrapy is stored in SQL (Postgresql) and flask is used to display it.
This video shows : design, set up, test, fix, and a review of key features.

(This is all part of the build up to a bigger project : Scrapy-SQL-Pandas-NLP-Flask all linked together).

0:00 Intro 4:43 Code on GitHub 6:24 how to get all listings from SQL and return with Python 10:09 flask app.py 16:54 checking the SQL table on the Raspberry Pi 18:07 viewing Crontab 23:30 No module named 'Flask' 28:15 app.run(host='0.0.0.0', threaded=True, debug=True) 30:50 view the scraped data in your own web page 32:37 Jinja syntax 33:40 Zebra striping using css

Visit redandgreen blog for more Tutorials

🌏 http://redandgreen.co.uk/about/blog/

Subscribe to the YouTube Channel

🌏 https://www.youtube.com/c/DrPiCode

Follow on Twitter - to get notified of new videos

🌏 https://twitter.com/RngWeb

👍 Become a patron 👍 🌏 https://www.patreon.com/drpi

Buy Dr Pi a coffee (or Tea) ☕ https://www.buymeacoffee.com/DrPi

Proxies

If you need a good, easy to use proxy, I was recommended this one, and having used ScraperAPI for a while I can vouch for them. If you were going to sign up anyway, then maybe you would be kind enough to use the link and the coupon code below?

You can also do a full working trial first as well, (unlike some other companies). The trial doesn't ask for any payment details either so all good! 👍

🌏 10% off ScraperAPI : https://www.scraperapi.com?fpr=ken49 ◼️ Coupon Code: DRPI10 (You can also get started with 1000 free API calls. No credit card required.)

Thumbs up yeah? (cos Algos..)

#webscraping #tutorials #python ... https://www.youtube.com/watch?v=MGngI9FCCYU