Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TRY-434: queries optimization #1257

Closed
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
81ed6cd
Fix nginx /admin/ location for 1.1.x
ashutau Nov 24, 2022
c5544b3
Merge pull request #965 from exadel-inc/nginx-admin-location-fix
ashutau Nov 24, 2022
184f700
fix for python build
pospielov Nov 30, 2022
82a53d1
Merge branch '1.1.x' of github.com:exadel-inc/CompreFace into 1.1.x
pospielov Nov 30, 2022
40b1139
EFRS-1357 Update nginx ssl config with templates
ashutau Jan 23, 2023
51be9f5
Merge branch '1.1.x' into update-nginx-conf
ashutau Feb 3, 2023
50882bd
Merge pull request #1023 from exadel-inc/update-nginx-conf
ashutau Feb 3, 2023
4f9272e
Add arm64 build to 1.1.x
ashutau Feb 22, 2023
995a694
Merge pull request #1031 from exadel-inc/arm64-to-1.1.x
ashutau Feb 23, 2023
628fc33
Close the JDWP debug port by default
ashutau Feb 23, 2023
741b15e
Merge pull request #1033 from exadel-inc/disable-debug-1.1.x
ashutau Feb 24, 2023
274dd55
Update libraries to versions with arm64 wheels
NHellFire Jan 22, 2023
488c9a5
Build imagecodecs from source (no arm64 wheels available)
NHellFire Jan 22, 2023
df5183e
Update imagecodecs so it can find openjpeg 2.4
NHellFire Jan 22, 2023
d862a4e
Update tensorflow so we have arm64 wheels
NHellFire Jan 23, 2023
b222d8d
provide more granular way to manage embedding cache
ivan-kripakov-m10 Nov 6, 2023
f2b3ac7
fix workflowsw
timofey-kurakin-m10 Nov 7, 2023
3ce1b99
fix
timofey-kurakin-m10 Nov 7, 2023
a25d89e
fix env
timofey-kurakin-m10 Nov 7, 2023
3a0da98
fix
timofey-kurakin-m10 Nov 7, 2023
48f161e
enable push
timofey-kurakin-m10 Nov 7, 2023
9dceec5
Revert "enable push"
ivan-kripakov-m10 Nov 15, 2023
3e06ced
Revert "fix"
ivan-kripakov-m10 Nov 15, 2023
8fb0996
Revert "fix env"
ivan-kripakov-m10 Nov 15, 2023
99da149
Revert "fix"
ivan-kripakov-m10 Nov 15, 2023
872ebbb
Revert "fix workflowsw"
ivan-kripakov-m10 Nov 15, 2023
5fde8c2
fix build
timofey-kurakin-m10 Nov 15, 2023
d9a69d3
minor fixes
ivan-kripakov-m10 Nov 16, 2023
139f1ad
pass actuator as skip request URI
ivan-kripakov-m10 Nov 16, 2023
416a1e2
add metrics exposure
ivan-kripakov-m10 Nov 16, 2023
fdc432b
add query hints
ivan-kripakov-m10 Nov 17, 2023
5aa59f0
get or load embedding collection with lock
ivan-kripakov-m10 Nov 17, 2023
223fbc8
fix conversion
ivan-kripakov-m10 Nov 17, 2023
55c7648
use custom query to avoid no session exception
ivan-kripakov-m10 Nov 20, 2023
3d14c6d
get rid of read lock
ivan-kripakov-m10 Nov 21, 2023
56258c3
fix tests
ivan-kripakov-m10 Nov 21, 2023
177d64e
disable liveness readiness endpoints by default & set management.endp…
ivan-kripakov-m10 Nov 21, 2023
98e6177
TRY-166: Provide more granular approach for embeddings' cache updating
ivan-kripakov-m10 Nov 21, 2023
6c1b106
TRY-198: use apache-commons-math3 lib & new API for subject-based fac…
ivan-kripakov-m10 Jan 23, 2024
7adfadf
TRY-324: make it possible to associate attributes with source images …
ivan-kripakov-m10 Apr 25, 2024
e7b9151
TRY-321: also build compreface admin image (#5)
ivan-kripakov-m10 Apr 29, 2024
8c218b6
TRY-321: include new change log
ivan-kripakov-m10 May 2, 2024
0d14799
TRY-321: fix workflow
timofey-kurakin-m10 May 2, 2024
e71d829
TRY-321: return 204
ivan-kripakov-m10 May 2, 2024
e15c749
TRY-410: add possibility to initialize caches by api-keys on app star…
ivan-kripakov-m10 May 16, 2024
cdf9156
TRY-321: add possibility to retrieve expaned embeddings representatio…
ivan-kripakov-m10 May 20, 2024
5e89351
TRY-321: move dialect to common-service & fix query (#8)
ivan-kripakov-m10 May 20, 2024
6a6601e
TRY-410: bugfix of cache initialization (add order by clause) (#9)
ivan-kripakov-m10 May 24, 2024
b68df89
TRY-321: add indexes to optimize embeddings fetching by subject name
ivan-kripakov-m10 Jun 14, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
59 changes: 0 additions & 59 deletions .github/workflows/AWS-CompreFace-image.yml

This file was deleted.

40 changes: 0 additions & 40 deletions .github/workflows/AWS-Сompreface-packer-image.yml

This file was deleted.

38 changes: 0 additions & 38 deletions .github/workflows/Release-Push-Single-Image-to-Dockerhub.yml

This file was deleted.

49 changes: 21 additions & 28 deletions .github/workflows/Release-default.yml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
name: (Release) Build and Push Default CompreFace version

on:
on:
workflow_dispatch:
inputs:
version:
Expand All @@ -10,31 +10,24 @@ jobs:
build:
runs-on: ubuntu-latest
steps:
- name: Check Out Repo
uses: actions/checkout@v2
- name: Build images
env:
VERSION: ${{ github.event.inputs.version }}
APPERY_API_KEY: ${{ secrets.APPERY_API_KEY }}
working-directory: ./dev/
run: |
sed -i 's/registry=/registry=exadel\//g' .env
docker-compose build --build-arg APPERY_API_KEY=${APPERY_API_KEY}
sed -i 's/latest/${VERSION}/g' .env
docker-compose build --build-arg APPERY_API_KEY=${APPERY_API_KEY}
docker images
- name: Login to Docker Hub
uses: docker/login-action@v1
with:
username: ${{ secrets.DOCKER_HUB_LOGIN }}
password: ${{ secrets.DOCKER_HUB_PWD }}
- name: Push images to Docker Hub
working-directory: ./dev/
env:
VERSION: ${{ github.event.inputs.version }}
run: |
docker-compose push
sed -i 's/${VERSION}/latest/g' .env
docker-compose push

- name: Check Out Repo
uses: actions/checkout@v2
- name: Build images
env:
VERSION: ${{ github.event.inputs.version }}
#APPERY_API_KEY: ${{ secrets.APPERY_API_KEY }}
working-directory: ./dev/
run: |
sed -i 's/latest/${VERSION}/g' .env
docker-compose build
docker images

- name: Login to GitHub Packages
run: echo "${{ secrets.GH_TOKEN_WRITE_PACKAGES }}" | docker login ghcr.io -u admin-m10 --password-stdin

- name: Push images to Docker Hub
working-directory: ./dev/
env:
VERSION: ${{ github.event.inputs.version }}
run: |
docker-compose push
37 changes: 0 additions & 37 deletions .github/workflows/Saving-visitors-statistics-to-S3.yml

This file was deleted.

23 changes: 0 additions & 23 deletions .github/workflows/cla.yml

This file was deleted.

2 changes: 1 addition & 1 deletion dev/.env
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
registry=
registry=ghcr.io/m10-payments/
postgres_password=postgres
postgres_username=postgres
postgres_db=frs
Expand Down
8 changes: 4 additions & 4 deletions dev/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
FROM maven:3.6.3-jdk-11-slim as build
FROM maven:3.8.2-eclipse-temurin-17 AS build
ARG ND4J_CLASSIFIER
WORKDIR /workspace/compreface
LABEL intermidiate_frs=true
Expand All @@ -12,14 +12,14 @@ COPY admin admin
COPY common common
RUN mvn package -Dmaven.test.skip=true -Dmaven.site.skip=true -Dmaven.javadoc.skip=true -Dnd4j.classifier=$ND4J_CLASSIFIER

FROM openjdk:11.0.8-jre-slim as frs_core
FROM eclipse-temurin:17-jre-focal AS frs_core
ARG DIR=/workspace/compreface
COPY --from=build ${DIR}/api/target/*.jar /home/app.jar
ENTRYPOINT ["sh","-c","java $API_JAVA_OPTS -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=*:5005 -jar /home/app.jar"]

FROM openjdk:11.0.8-jre-slim as frs_crud
FROM eclipse-temurin:17-jre-focal AS frs_crud
ARG DIR=/workspace/compreface
COPY --from=build ${DIR}/admin/target/*.jar /home/app.jar
ARG APPERY_API_KEY
ENV APPERY_API_KEY ${APPERY_API_KEY}
ENTRYPOINT ["sh","-c","java $ADMIN_JAVA_OPTS -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=*:5005 -jar /home/app.jar"]
ENTRYPOINT ["sh","-c","java $ADMIN_JAVA_OPTS -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=*:5005 -jar /home/app.jar"]
7 changes: 4 additions & 3 deletions dev/docker-compose.env.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,9 +15,10 @@ volumes:
services:
compreface-fe:
volumes:
- ./nginx/conf.d:/etc/nginx/conf.d:ro
- /etc/letsencrypt/archive/$HOSTNAME/fullchain1.pem:/etc/nginx/ssl/fullchain.pem:ro
- /etc/letsencrypt/archive/$HOSTNAME/privkey1.pem:/etc/nginx/ssl/privkey.pem:ro
- ./nginx/templates:/etc/nginx/templates:ro
- /etc/letsencrypt:/etc/letsencrypt:ro
environment:
- NGINX_HOST=$HOSTNAME
ports:
- "8000:80"
- "443:443"
32 changes: 32 additions & 0 deletions dev/docker-compose.multiplatform.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
version: '3.4'

services:
compreface-postgres-db:
build:
platforms:
- "linux/amd64"
- "linux/arm64"

compreface-admin:
build:
platforms:
- "linux/amd64"
- "linux/arm64"

compreface-api:
build:
platforms:
- "linux/amd64"
- "linux/arm64"

compreface-fe:
build:
platforms:
- "linux/amd64"
- "linux/arm64"

compreface-core:
build:
platforms:
- "linux/amd64"
- "linux/arm64"
Loading
Loading