Skip to content

Leveraging state-of-the-art (SOTA) language models (LLMs) and orchestration frameworks like LangChain, Vox optimizes multimodal interactions, enhancing communication tasks with personalized assistance and enriched user experiences.

Notifications You must be signed in to change notification settings

alirashidAR/structor.io

Repository files navigation

Vox

Introduction

Vox is a multimodal assistant framework designed to enhance user communication and interaction experience. It provides a range of features to streamline communication tasks, facilitate multilingual conversations, understand context, offer personalized assistance, and customize the personality of the personal assistant.

Features

Email Service Integration

Vox seamlessly integrates with email services, allowing users to manage their emails using voice commands. This feature simplifies communication tasks, enabling users to stay organized and efficient.

Contextual Understanding

Leveraging advanced AI algorithms, Vox understands the context of conversations. This enables more natural interactions, where the assistant can anticipate user needs and provide relevant assistance.

Adaptive Learning

Vox learns from user interactions to provide personalized recommendations and assistance. Over time, the assistant becomes more attuned to the user's preferences and behavior, offering tailored support.

Pre-requisites

Before using Vox, ensure that you have the following:

  • Python installed on your system.
  • Access to the Gmail API.
  • Necessary permissions to access and manage your Gmail account.
  • ollama, llama2, and llava models downloaded on your system.

Installation

To install Vox and its dependencies, follow these steps:

  1. Install llama2 and llava models on your system. Ensure you have the necessary permissions to access and use these models.

  2. Use the following command to install all the dependencies:

     pip install -r requirements.txt
    

How to Use

Run the following files to test the functionalities: chatwithdata.py, personal_assistant.py, multimodal_assistant.py and app.py.

About

Leveraging state-of-the-art (SOTA) language models (LLMs) and orchestration frameworks like LangChain, Vox optimizes multimodal interactions, enhancing communication tasks with personalized assistance and enriched user experiences.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages