Record some useful repos

This repo is used to store some good and useful github repositories 💾

Python 🐍

• spider 🪲
  • awesome-python-login-model - python模拟登陆一些大型网站，还有一些简单的爬虫
  • zhihu-py3 - 知乎非官方API库 with Python3
  • webcrawler - 50行python爬虫代码，带你发现知乎新世界！
  • AntSpider - 1000万豆瓣电影/评论/名人/评分数据采集源码分享（内含千万电影数据集，可下载）
  • DouBanSpider - 豆瓣读书的爬虫
  • Anti-Anti-Spider - 基于CNN的验证码图片识别
  • spider-roach - 分布式定向抓取集群
  • Python-crawler - 爬虫合集：Beautiful Soup 爬虫，Scrapy 爬虫框架； 浏览器模拟爬虫；练手项目
  • python-spider - Python3网络爬虫实战：淘宝、京东、网易云、B站、12306、抖音、笔趣阁、漫画小说下载、音乐电影下载等
  • awesome-spider - 这一款爬虫，里面搜集了几乎所有可以爬取的中文网址，从知乎豆瓣到知网，抖音微博到QQ，还有很多的不可描述的网站
  • Nyspider - 这是ID为Nyloner的一个今日头条的工程师弄的.
  • awesome-python-login-model - 这个项目用于模拟各种网址登陆，也包含一些简单的爬虫. :
  • python-spider, 这是ID为Jack-Cherish的东北大学的一个学生整理的学习python爬虫的资料，star6000+，包含不少的实战项目. :https://github.com/Jack-Cherish/python-spider
  • Google，Baidu，Bing三大搜素引擎图片爬虫: https://github.com/sczhengyabin/Image-Downloader
  • 各大视频网站爬虫: https://github.com/iawia002/annie
  • spider_python - 多线程爬虫, Selenium 自动化爬虫, Scrapy 框架爬虫, Node.js 爬虫
  • spider_job - 51job, 拉勾网， boss直聘爬虫以及前端显示
  • python_spider - 房天下，简书，淘宝，知乎，观察者网站首页新闻，抖音爬虫项目
  • others: https://github.com/jhao104/proxy_pool, https://github.com/Ehco1996/Python-crawler
• tools 🔧
  • Python:https://github.com/geekcomputers/Python
  • show-me-the-code: https://github.com/Yixiaohan/show-me-the-code
  • matplotlib: plotting with Python: https://github.com/matplotlib/matplotlib
  • stock - stock，股票系统。使用python进行开发
  • python-small-examples - Python 富有体系且实用的小例子、小案例
• books 📚
  • A Programmer's Guide to Data Mining:https://github.com/zacharski/pg2dm-python
  • Python Cookbook, 3rd Edition: https://github.com/dabeaz/python-cookbook
  • Biopython Tutorial Chinese Translation: https://github.com/bigwiv/Biopython-cn
  • Python Cookbook 3rd Edition Documentation: https://python3-cookbook.readthedocs.io/zh_CN/latest/
  • Python Cookbook: https://github.com/yidao620c/python3-cookbook
  • Biopython: https://github.com/biopython/biopython
  • sklearn-doc-zh - scikit-learn（sklearn）中文文档
  • d2l-en - Interactive deep learning book with code, math, and discussions. Available in multi-frameworks
  • ggplot2-book - ggplot2: elegant graphics for data analysis

R

• tools
  • drake - An R-focused pipeline toolkit for reproducibility and high-performance computing
  • circlize - circular visualization in R
  • rmarkdown-book: https://github.com/rstudio/rmarkdown-book
  • A curated list of awesome R packages, frameworks and software： https://github.com/qinwf/awesome-R
  • A functional programming toolkit for R： https://github.com/tidyverse/purrr
  • diamond - Accelerated BLAST compatible local sequence aligner
  • ggtech - ggplot2 tech themes, scales, and geoms
• books
  • Automated Data Collection with R: http://kek.ksu.ru/eos/WM/AutDataCollectR.pdf
  • Automated Data Collection with R resouce: https://github.com/crubba/Wiley-ADCR
  • materials: http://www.r-datacollection.com/materials/
  • adv-r - Advanced R: a book

Bioinformatics

• KEGG: https://github.com/param-p-singh/KEGG
• RNA-seq-scripts: https://github.com/LenzLab/RNA-seq-scripts
• rna-seq-diff-exprn: https://github.com/olgabot/rna-seq-diff-exprn
• NGS-pipeline: https://github.com/jmzeng1314/NGS-pipeline
• RUN-WGCNA: https://github.com/SamBuckberry/RUN-WGCNA
• megahit - Ultra-fast and memory-efficient (meta-)genome assembler
• seqkit - A cross-platform and ultrafast toolkit for FASTA/Q file manipulation in Golang
• RNA-Seq - Next Generation sequencing Data analysis
• HomBlocks - HomBlocks is a new and highly efficient pipeline that used homologous blocks searching method to construct multi-gene alignment. It can automatically recognize locally collinear blocks (LCB) among organelle genomes and excavate phylogeny informative regions to construct multi-gene involved alignment in few hours.
• Awesome-Bioinformatics - A curated list of awesome Bioinformatics libraries and software.
• ggtree - Visualization and annotation of phylogenetic trees
• taxonkit - A Cross-platform and Efficient NCBI Taxonomy Toolkit
• mag - Assembly and binning of metagenomes
• pipeLine:
  • https://github.com/winston-lab
  • https://github.com/pditommaso/awesome-pipeline

统计学习方法

• lihang-code - 《统计学习方法》第二版的代码实现
• Statistical-Learning-Method_Code - 手写实现李航《统计学习方法》书中全部算法
• Lihang - Statistical learning methods, 统计学习方法
• Statistic-study-notes - 李航统计学习方法（第二版）的学习笔记
• -

算法

• LeetCodeAnimation - Demonstrate all the questions on LeetCode in the form of animation.（用动画的形式呈现解LeetCode题目的思路）
• Algorithms - 数据结构和算法专项训练营
• Algorithms-Javascript - A repository for All algorithms implemented in Javascript
• algorithm-pattern - 算法模板，最科学的刷题方式，最快速的刷题路径
• leetcode - Python & JAVA Solutions for Leetcode

Others

• tools
  • Emoji-Cheat-Sheet.com: https://github.com/WebpageFX/emoji-cheat-sheet.com
  • Concise, consistent, and legible badges in SVG and raster format: https://github.com/badges/shields
  • GitHub-Chinese-Top-Charts - GitHub中文排行榜
  • nficano/pytube - A lightweight, dependency-free Python library (and command-line utility) for downloading YouTube Videos.
  • git-tips: https://github.com/521xueweihan/git-tips
  • shell: https://github.com/fengyuhetao/shell
  • Pyevolve: https://github.com/perone/Pyevolve
  • ideabook: A Growth Engineering Idea in Action.https://github.com/phodal/ideabook
  • DataWarehouse: https://github.com/ljtyduyu/DataWarehouse
  • awesome-mac:  This repo is a collection of awesome Mac applications and tools for developers and designers. https://github.com/jaywcjlove/awesome-mac
  • awk Tutorial: https://awk.readthedocs.io/en/latest/chapter-one.html
  • Curated list of awesome lists： https://github.com/sindresorhus/awesome

Mechine learning

• AiLearning - AiLearning: 机器学习 - MachineLearning - ML、深度学习 - DeepLearning - DL、自然语言处理 NLP
• MachineLearningDeomoCode:https://github.com/spartajet/MachineLearningDeomoCode