App info extractor is a utility to extract and analyze customer reviews and critical metrics of apps from multiple sources like google play store, Apple play store, and any other sources.This utility is highly configurable to extract and give relevant information about any app in a meaningful way.
This utility takes config.yaml as input. Configuration for each app is self-contained in configs. Once a configuration is specified in config.yaml, the utility will iteratively go through each app, crawl the relevant information, and store the data locally as a CSV file.
- Check out the package
- Have python 3.8 on your system . Use pyenv to manage multiple version of python in your machine
- Open terminal and type
cd app_info_extracter
- Setup python virtual enviorment having this will prevent you from messing up with the system-wide python installation
- Now type in terminal
cd src/crawler/
- Add the required configuration in config.yaml using your favorite editor
- in terminal type
python main.py config.yaml
- Results of the crawling will be stored in separate directories for each app in current directory
- In case of failure, just re-run
python main.py config.yaml
script will start from where its left off.
1.Use vim or InteliJUltimate or pycharm or visualstudio code.