Web Scraping Tutorial | How to use Scrapy callback functions : cb_kwargs and meta | code comparison

Callbacks can sound difficult if you've come from using BeautifulSoup or are new to using Scrapy for web scraping, so rather than study the Scrapy documentation you may find this useful as it's a real world example of using meta and cb_kwargs to pass variable between functions.

I hope this tutorial is helpful, please comment, like, subscribe if it is!

Code is all available at : https://github.com/RGGH/Scrapy5

• I also show how you can store very long html class names as variables in a separate module and just reference the variable name in your spider.

See you around yeah? Dr Pi.

(Thanks to Maksim aka Code Monkey King for mentioning cb_kwargs to me the other day, big up CMK). Check out his channel : https://youtu.be/boW-V0CmOzg ... https://www.youtube.com/watch?v=QFSHxLfpVGc