Skip to content

Scrapes TechCrunch article information using Requests, Selenium and parses with Beautiful Soup

Notifications You must be signed in to change notification settings

cassac/techcrunch-scrapper

Repository files navigation

techcrunch-scrapper

Scrapes TechCrunch article information and writes into SQLite database.

Uses BeautifulSoup, Requests and Selenium

  1. Set dates to scrape for articles at bottom of scrape.py
  2. In terminal run python scrape.py

About

Scrapes TechCrunch article information using Requests, Selenium and parses with Beautiful Soup

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages