Skip to content

Python class to perform ETL. Import JSON from URL and export to S3

Notifications You must be signed in to change notification settings

dakindre/Python-ETL-S3

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Python ETL into AWS S3 (JSON)

Source

  1. Uses sample dataset provided by github of user statistics
  2. You can change it to any source you'd like but just editing the URL

Modifications

  1. Uses anaconda distribution with AWS CLI installed and aws configure set with Access Key and Secret Key
    • To reproduce the script just be sure to have your own Keys saved or embed them in the script (not advised)
    • Point the destination to a bucket in your account

About

Python class to perform ETL. Import JSON from URL and export to S3

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published