Python : Web Scraping 101

Tutorial

Contents
(0:00:00) Part 1 – Scrapy & Course Introduction
(0:08:22) Part 2 – Setup Virtual Env & Scrapy
(0:16:28) Part 3 – Creating a Scrapy Project
(0:28:17) Part 4 – Build your First Scrapy Spider
(0:55:09) Part 5 – Build Discovery & Extraction Spider
(1:20:11) Part 6 – Cleaning Data with Item Pipelines
(1:44:19) Part 7 – Saving Data to Files & Databases
(2:04:33) Part 8 – Fake User-Agents & Browser Headers
(2:40:12) Part 9 – Rotating Proxies & Proxy APIs
(3:18:12) Part 10 – Run Spiders in Cloud with Scrapyd
(4:03:46) Part 11 – Run Spiders in Cloud with ScrapeOps
(4:20:04) Part 12 – Run Spiders in Cloud with Scrapy Cloud
(4:30:36) Part 13 – Conclusion & Next Steps