Skip to content

The purpose of this project is to help shopping easier and better by analyzing the sentiments of users' opinions

License

Notifications You must be signed in to change notification settings

SaoshyantOfficial/Digikala-Review-Crawler

Repository files navigation

Digikala_Sentiment_Analysis

This is an open source tool for data collection

The goal of this project is to create a tool for easier data collection.
The data collected with this tool includes user opinions about products.
This tool is very useful for data scientists.
Instructions for using this tool are explained below in gettinh started section.


Getting Started

Clone the repository

open your terminal and clone the repository
Inline code clone code
clone with HTTPS

git clone https://github.com/SaoshyantOfficial/Digikala-Data-Collector.git

clone with SSH

git clone [email protected]:SaoshyantOfficial/Digikala-Data-Collector.git

Install prerequisites if you dont have them

prerequisites

  • selenium
  • flask
  • bs4 Inline code install prerequisites

selenium

pip install selenium

flask

pip install flask

BeautifulSoup

pip install bs4

run the code in yor terminal or in your text editor

Inline code run the code in terminal

python user_interface.py

run the interface

open your browser and type this address

 http://127.0.0.1:5000/

code_running

add urls

go to your considered product page in digikala.com website and copy main url
Once you have added all the desired urls, click on the scrap button

add_urls

Web scraping

Web scraper starts to extract all reviews about your considered product

download opinions file

Then all reviews about your choosen product are extracted and you can download them in a ad .csv file from result page download_gif


Goals

It is an open source tool and is available for all interested people so they can do their own research or projects with the help of this tool faster and easier.
The use of this tool is free and open, and also developers can upgrade this tool.
Hoping to influence the progress of the data scientist community.
Enjoy using this tool

Saoshyant Team

The first release in Spring 2023

About

The purpose of this project is to help shopping easier and better by analyzing the sentiments of users' opinions

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published