-
Notifications
You must be signed in to change notification settings - Fork 1
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Arthur Leung
committed
Sep 29, 2024
1 parent
e94ade3
commit df8fb59
Showing
2 changed files
with
14 additions
and
3 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,6 +1,17 @@ | ||
# Setup | ||
# LLM-NVR | ||
|
||
This project is a proof of concept for using multi-modal LLMs to integrate with NVRs and perform narration, explanation on top of object detection and tracking. | ||
|
||
## Setup | ||
|
||
1. Install python3 and activate the venv: `python3 -m venv venv` | ||
2. Install requirements: `pip install -r requirements.txt` | ||
3. Run docker compose to bring the frontend and backend up: `docker-compose up -d` | ||
4. Run the jupyter notebook in analyze.ipynb | ||
3. Edit configs in frigate/ subdirectory and bring up Frigate with docker compose: `cd frigate && docker-compose up -d frigate nvr` | ||
4. Run docker compose to bring the frontend and backend up: `docker-compose up -d` | ||
5. Run the jupyter notebook in analyze.ipynb | ||
|
||
## Demo | ||
[Link](https://x.com/arcyleung/status/1835194959290327250) | ||
|
||
## Architecture | ||
<img src="arch.jpg" alt="architecture" width="80%" style="margin: auto"/> |