Web Scraping in Python Selenium, Scrapy + ChatGPT Prize 2024
$0.99
Have you ever thought about how important is data in our everyday life?
It doesn’t matter if you’re a data scientist, data analyst, or programmer, getting access to the data you need is important! This is why some of the top Fortune 500 companies such as Walmart, Target, and CNN use web scraping to stay ahead with data. We can say this is one of their best secret weapons.
What you’ll learn
- Learn to scrape website from scratch with Beautiful Soup
- Learn the essential stuff you need before learning web scraping (Python, HTML, XPath)
- How to use ChatGPT for web scraping
- 4 web scraping projects (from beginner to advanced projects)
- Handle pagination with any scraping tool
- Learn to scrape JavaScript website with Selenium and Scrapy-Splash
- Store the extracted Data in MongoDb & SQLite3
- Scrape infinite scroll websites
- Login to websites using Selenium & Scrapy
Course content
1717 sections • 95 lectures • Total duration 10 h 47 min
Introduction
Introduction to Beautiful Soup
Project #1: Scraping Multiple Pages with Beautiful Soup
XPath
Introduction to Selenium
Project #1: Dealing with Multiple Pages using Selenium (Amazon Audible Bot)
Introduction to Scrapy
Dealing with Multiple Pages using Scrapy
Project #3: Building Crawlers with Scrapy
Exporting Data to a Database: MongoDB and SQLite
Scraping APIs & Login to website with Scrapy
Splash Basics
Project #4: Scraping JavaScript websites using Scrapy/Splash
How to Make Money Using Web Scraping
Prize: ChatGPT for Web Scraping
Appendix: Infinite Scrolling & Login (Twitter Bot)
Bonus: Python for Data Science Bootcamp 2022: From Zero to Hero