Skip to content

Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.

License

Notifications You must be signed in to change notification settings

cohere-ai/cohere-toolkit

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Cohere Toolkit

Toolkit is a deployable all-in-one RAG application that enables users to quickly build their LLM-based product.

Try Now:

There are two main ways for quickly running Toolkit: local and cloud. See the specific instructions given below.

Local

You will need to have Docker, Docker-compose >= 2.22, and Poetry installed. Go here for a more detailed setup.
Note: to include community tools when building locally, set the INSTALL_COMMUNITY_DEPS build arg in the docker-compose.yml to true.

Both options will serve the frontend at http://localhost:4000.

Using make

Use the provided Makefile to simplify and automate your development workflow with Cohere Toolkit, including Docker Compose management, testing, linting, and environment setup.

git clone https://github.com/cohere-ai/cohere-toolkit.git
cd cohere-toolkit
make first-run

Docker Compose only

Use Docker Compose directly if you want to quickly spin up and manage your container environment without the additional automation provided by the Makefile.

git clone https://github.com/cohere-ai/cohere-toolkit.git
cd cohere-toolkit
docker compose up
docker compose run --build backend alembic -c src/backend/alembic.ini upgrade head

Cloud

GitHub Codespaces

To run this project using GitHub Codespaces, please refer to our Codespaces Setup Guide.

About Toolkit

  • Interfaces - any client-side UI, currently contains two web apps, one agentic and one basic, and a Slack bot implementation.
    • Defaults to Cohere's Web UI at src/interfaces/assistants_web - A web app built in Next.js. Includes a simple SQL database out of the box to store conversation history in the app.
    • You can change the Web UI using the docker compose file.
  • Backend API - in src/backend this follows a similar structure to the Cohere Chat API but also include customizable elements:
    • Model - you can customize with which provider you access Cohere's Command models. By default included in the toolkit is Cohere's Platform, Sagemaker, Azure, Bedrock, HuggingFace, local models. More details here.
    • Retrieval- you can customize tools and data sources that the application is run with.
  • Service Deployment Guides - we also include guides for how to deploy the toolkit services in production including with AWS, GCP and Azure. More details here.

Contributing

Contributions are what drive an open source community, any contributions made are greatly appreciated. To get started, check out our documentation.

Contributors

Made with contrib.rocks.