Skip to content
This repository has been archived by the owner on Apr 12, 2023. It is now read-only.

Latest commit

 

History

History
56 lines (42 loc) · 2.58 KB

README.md

File metadata and controls

56 lines (42 loc) · 2.58 KB
Raw

Alibrary

Database toolkit for aliyundrive share links

Goals

Currently, many people share huge pack of files via 阿里云盘. For example, one can find such share links in UP云搜, 万人迷吧, 找资源 and 云盘资源网. Given those abundant resources, we create Alibrary project to index and update shared files. This project SHOULD reach the following goals:

  1. store index data reliably;
  2. provide rapid search API;
  3. update and validate share links efficiently.

Dependencies

We use the following projects:

  1. aligo, python3 API of aliyundrive,
  2. PostgreSQL with full-text search extension pg_jieba, database storage with Chinese segemntation,
  3. psycopg2, pthon3 API for PostgreSQL,
  4. python-prompt-toolkit, search prompt interface,
  5. humanize, show file size,
  6. aria2, optional download utility.

Demo

The following host demo sites are mirrors to each other:

  1. on github.io,
  2. on onerender.com,
  3. on netlify.app.

Their datasets are the same, alibrary.sql in v2.0.

Usage

To begin with, you can download alibrary.sql in the release page as a sample dataset and load it into PostgresSQL. To load it, you must have the pg_jieba extension installed. This sample includes 552,544 records without duplications.

After this, you can search indexes in our sample database or index your costume share links using aliyun-share, see comments inside it for usage details. As for search syntax, please refer to the tsquery.

Development plans

  • Migrate database to redis
  • Implement search API
  • Add cli prompt interface
  • Improve prompt interface
  • Run as cloud service
  • User-friendly front end for public usage
  • Migrate database to PostgresSQL
  • Add more resource categories
  • Add systemd integration
  • Index share folders