Quarkus LangChain4j

This repository contains Quarkus extensions that facilitate seamless integration between Quarkus and LangChain4j, enabling easy incorporation of Large Language Models (LLMs) into your Quarkus applications.

Features

Here is a non-exhaustive list of features that are currently supported:

• Declarative AI services
• Integration with diverse LLMs (OpenAI GPTs, Hugging Faces, Ollama...)
• Tool support
• Embedding support
• Document store integration (Redis, Chroma, Infinispan...)
• Native compilation support
• Integration with Quarkus observability stack (metrics, tracing...)
• Pluggable auth providers

Documentation

Refer to the comprehensive documentation for detailed information and usage guidelines.

Samples

Check out the samples and integration tests to gain practical insights on how to use these extensions effectively.

Getting Started

To incorporate Quarkus LangChain4j into your Quarkus project, add the following Maven dependency:

<dependency>
    <groupId>io.quarkiverse.langchain4j</groupId>
    <artifactId>quarkus-langchain4j-openai</artifactId>
    <version>0.22.0.CR1</version>
</dependency>

or, to use Ollama:

<dependency>
    <groupId>io.quarkiverse.langchain4j</groupId>
    <artifactId>quarkus-langchain4j-ollama</artifactId>
    <version>0.22.0.CR1</version>
</dependency>

Contributing

Feel free to contribute to this project by submitting issues or pull requests.

License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.