UKYDataScienceComp2023

Data Preprocessing

Data Exploration and Cleaning in General
Save a cleaned dataset without texts from url
- At the end, it will create "text_summary_stats.csv" file
Create 'online_news_popularity_data/online_news_popularity_data.csv'
- This script will scrap title and content of news ariticles from the urls
- The csv file will be used for the huggingface dataset object

Name		Name	Last commit message	Last commit date
Latest commit History 15 Commits
online_news_popularity_data		online_news_popularity_data
.gitignore		.gitignore
Data Preprocessing for NN.ipynb		Data Preprocessing for NN.ipynb
Data Preprocessing.ipynb		Data Preprocessing.ipynb
Finetuning MashableBertForClassification.ipynb		Finetuning MashableBertForClassification.ipynb
Pretraining BERT with custom positional embedding.ipynb		Pretraining BERT with custom positional embedding.ipynb
README.md		README.md
Transformer_Models.py		Transformer_Models.py
data_prep.py		data_prep.py