Alpha 0.4.0

0.4.0 - 2024-09-05

Changes

• OpenSearch backend now uses multiple indices to store document metadata, this avoids unnecessary duplication of said metadata and allows us to more easily reference specific documents in the collection.
• Documents are inserted into OpenSearch database instead of uploads directory.
• Some of the CLI scripts have been renamed to be more consistent and better fit the new database schema.
• Volumes are managed by Docker instead of mounting directories from the host OS. This allows us to resolve some issues with permissions that may have been preventing Linux users from using the app.
• Chat UI uses new chatbot interface provided by Shiny for Python.

Added

• Install script makes necessary changes if previously installed version is incompatible with the one being installed. As we approach 1.0 we will refine this system to minimize data loss when upgrading, while still in Alpha phase we make no such promises!

Alpha 0.3.0

Changes

• Vector Database backend now uses OpenSearch instead of Milvus. This will give us many more options with managing metadata from the ingested documents as well as strong RBAC features.
• install scripts should be a little more intuitive to use now.
• Loader page has been merged into Collection Management.
• The production version of Concierge now runs entirely in Docker, this should limit the number of issues relating to Python configurations.
• The user no longer needs to download the repository from GitHub to install Concierge, it is now done via the PyPI package manager.
• Default port set to 15130

Added

• delete_index command
• documents command
• list_indices command
• delete_document command
• Ability to view documents in collection
• Ability to delete documents from collection
• Ability to set web app port in environment variables

Alpha 0.2.0

Changes

• Web GUI ported from Streamlit to Shiny for Python: we have found Shiny to be much more robust, especially with handling long tasks such as ingesting documents.
• launch.py and install.py improved to (hopefully) work on more Operating Systems.

Added

• Theme selector for Web GUI

Alpha 0.1.3

Added

• launch.py script to make starting Concierge simpler.
• Collaborator Guide to clarify our internal policy on handling branches and versioning.

Alpha 0.1.0

Initial release of Data Concierge