Skip to content

A Twitter scraper with Node.js and Puppeteer to automatically sign-in and download user media (images and videos).

License

Notifications You must be signed in to change notification settings

ArturMiguel/twitter-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Twitter Scraper

A Twitter scraper with Node.js and Puppeteer to automatically sign-in and download user media.

image

Features

  • Automated sign-in.
  • Automated search for user media and download them. Supports image/videos, albums and Twitter pagination.

How to install and run:

  • You need to have Node.js >= v16 and TypeScript installed.
  • Clone the repository: git clone https://github.com/ArturMiguel/twitter-scraper
  • Install the dependencies: npm ci
  • Rename .env.template to .env and put your credentials.
  • Start the application: npm run start

Disclaimer

This is a test repository for personal use, all content collected from Twitter is public and accessed by any user, i just automated this process.

If you want to use Twitter services commercially or professionally, i recommend the official Twitter API https://developer.twitter.com/en/docs/twitter-api.

License

MIT

About

A Twitter scraper with Node.js and Puppeteer to automatically sign-in and download user media (images and videos).

Topics

Resources

License

Stars

Watchers

Forks