Skip to content

Latest commit

 

History

History
74 lines (48 loc) · 1.53 KB

README.md

File metadata and controls

74 lines (48 loc) · 1.53 KB

Filmweb Scraper 🤖

📌 Simple scraper used to scrape data from Filmweb service related to best rated movies from most popular polish VOD platforms (Netflix, Disney+, HBO Max, Canal+).

GitHub top language GitHub repo size

Features

  • Getting lists of titles and ratings of at most top 10 movies from top 4 VOD platforms
  • Deduplicating titles if they are available on more than one platform
  • Sorting titles by rating
  • Saving list of titles, ratings and platforms to .csv file

Run scraper in development mode

  • Clone repository
  git clone https://github.com/jakubcieslik99/filmweb-scraper.git

ℹ️ Instructions for running scraper locally:

  • Navigate to the scraper directory and install dependencies
  cd filmweb-scraper
  pnpm install
  • Run scraper in development mode
  pnpm run dev
  • Scrape data and save to .csv file in development mode
  pnpm run start
  • Run unit tests
  pnpm run test

Run scraper in transpiled mode

ℹ️ Instructions for building and running scraper in transpiled mode

  • Transpile
  pnpm run build
  • Scrape data and save to .csv file in transpiled mode
  pnpm install --prod
  pnpm run prod

Feedback

If you have any feedback, please reach out to me at ✉️ [email protected]

Authors