Scrapy Exercise project is to help Scrapy beginner quickly learn web scraping skills by solving problems from the real world.

In this tutorial, I talked about the detail of Wagtail StreamField feature, it is a brand new and powerful solution in CMS world. Its content block model make it super easy to be extended to fit your demand.

What I want to tell you is that your tech blog is a goldmine, try to learn writing, try to improve it, you will find out that it is worthwhile if you do it the right way.

In this Scrapy tutorial, I will show you how to extract data from native javascript statement using Regex and Json. But you can also use the method when developing web scraper using other frameworks such as BeautifulSoup.

This Scrapy Tutorial Series would teach you to build web scraper using Scrapy in Python.