Commit Graph

87 Commits (b8777d7739c8a8f037cb6e6aa6df81bcf7d2c024)

Author SHA1 Message Date
Alexandre Bouijoux b8777d7739
Add french documentation (#4010)
* Copy original README for online editing

* Translate to french

* Add link from other documentations

* Add machine-learning french doc

* Typos

* Missing word

---------

Co-authored-by: Alexandre Bouijoux <alexandre@bouijoux.fr>
2023-09-08 13:48:39 +07:00
Mert 0a24ff90bb
fix(ml): set higher default worker timeout (#4007) 2023-09-07 08:27:29 +07:00
Alex The Bot 608543da0b Version v1.77.0 2023-09-06 03:30:44 +07:00
Mert 3cf0f5f11b
fix(ml): model downloading improvements (#3988)
* handle ort `NoSuchFile` error, stricter file check

* keep exception order
2023-09-06 08:48:40 +07:00
Mert b7fd5dcb4a
dev(ml): fixed `docker-compose.dev.yml`, updated locust (#3951)
* fixed dev docker compose

* updated locustfile

* deleted old script, moved comments to locustfile
2023-09-01 21:59:17 +07:00
Daniele Ricci c7d53a5006
docs: remove obsolete environment variables (#3926)
* Obsolete environment variables

* Review fixes

* Review fixes

* Review fixes
2023-09-01 18:05:45 +07:00
Mert 41461e0d5d
chore(ml): memory optimisations (#3934) 2023-08-31 18:30:53 +07:00
Alex The Bot 58ae734fc2 Version v1.76.1 2023-08-30 08:26:04 +07:00
Mert 54b2779b79
chore(ml): improved logging (#3918)
* fixed `minScore` not being set correctly

* apply to init

* don't send `enabled`

* fix eslint warning

* added logger

* added logging

* refinements

* enable access log for info level

* formatting

* merged strings

---------

Co-authored-by: Alex <alex.tran1502@gmail.com>
2023-08-30 08:22:01 +07:00
Mert df26e12db6
fix(ml): `minScore` not being set correctly (#3916)
* fixed `minScore` not being set correctly

* apply to init

* don't send `enabled`

* fix eslint warning

* better error message
2023-08-30 03:16:00 +07:00
Alex The Bot 49c2d4d115 Version v1.76.0 2023-08-29 19:24:43 +07:00
Mert bcc36d14a1
feat(ml)!: customizable ML settings (#3891)
* consolidated endpoints, added live configuration

* added ml settings to server

* added settings dashboard

* updated deps, fixed typos

* simplified modelconfig

updated tests

* Added ml setting accordion for admin page

updated tests

* merge `clipText` and `clipVision`

* added face distance setting

clarified setting

* add clip mode in request, dropdown for face models

* polished ml settings

updated descriptions

* update clip field on error

* removed unused import

* add description for image classification threshold

* pin safetensors for arm wheel

updated poetry lock

* moved dto

* set model type only in ml repository

* revert form-data package install

use fetch instead of axios

* added slotted description with link

updated facial recognition description

clarified effect of disabling tasks

* validation before model load

* removed unnecessary getconfig call

* added migration

* updated api

updated api

updated api

---------

Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2023-08-29 08:58:00 +07:00
Alex The Bot f1027d7807 Version v1.75.2 2023-08-26 22:34:54 +07:00
Alex The Bot cc1fecfffd Version v1.75.1 2023-08-26 18:31:14 +07:00
Alex The Bot 6fe214a784 Version v1.75.0 2023-08-26 04:44:39 +07:00
Mert 165b91b068
feat(ml)!: switch image classification and CLIP models to ONNX (#3809) 2023-08-25 06:28:51 +07:00
Mert 60729a091a
make lazy loading default (#3797) 2023-08-20 18:24:14 +07:00
Alex The Bot d2bad1d553 Version v1.74.0 2023-08-19 06:09:16 +07:00
Alex The Bot a3b6095b61 Version v1.73.0 2023-08-15 12:45:48 +07:00
Mert fa57853bd2
fix(ml): clear cache if bad zip file (#3600) 2023-08-08 12:33:13 +07:00
Alex The Bot 6efc2ec9be Version v1.72.2 2023-08-07 16:41:17 +07:00
Alex The Bot b3b5f063cf Version v1.72.1 2023-08-07 02:54:24 +07:00
Alex The Bot 3edb347666 Version v1.72.0 2023-08-06 19:48:25 +07:00
Mert c73832bd9c
refactor(ml): model downloading (#3545)
* download facial recognition models

* download hf models

* simplified logic

* updated `predict` for facial recognition

* ensure download method is called

* fixed repo_id for clip

* fixed download destination

* use st's own `snapshot_download`

* conditional download

* fixed predict method

* check if loaded

* minor fixes

* updated mypy overrides

* added pytest-mock

* updated tests

* updated lock
2023-08-05 21:45:13 +07:00
Jorge Avila 1cf3378499
Add Spanish translations of Readme (#3511) 2023-08-02 06:51:08 +07:00
Alex The Bot 3f1cf44717 Version v1.71.0 2023-07-28 18:32:33 +07:00
Alex The Bot 2872886e77 Version v1.70.0 2023-07-27 03:40:16 +07:00
Alex The Bot f41e1159d1 Version v1.69.0 2023-07-23 17:40:02 +07:00
Mert 8f08100a30
moved deps (#3379) 2023-07-22 15:04:52 +07:00
bt90 bc885f3644
fix(server): properly handle SIGTERM (#3350)
* use tini init

* Move python into CMD

* Use tini as entrypoint

* Toggle executable bit

* Avoid compose changes

* Adapt web entrypoint
2023-07-21 09:20:04 +07:00
Alex The Bot 1835fbae49 Version v1.68.0 2023-07-20 03:06:12 +07:00
Alex The Bot 81e07fda08 Version v1.67.2 2023-07-14 14:01:20 +07:00
Alex The Bot 2d4e2af629 Version v1.67.1 2023-07-14 02:45:02 +07:00
Alex The Bot cd184cf366 Version v1.67.0 2023-07-14 00:39:54 +07:00
Mert 848ba685eb
fix(ml): race condition when loading models (#3207)
* sync model loading, disabled model ttl by default

* disable revalidation if model unloading disabled

* moved lock
2023-07-11 12:01:21 +07:00
Alex The Bot 0d30ceb284 Version v1.66.1 2023-07-05 02:50:53 +07:00
Alex The Bot 8a3ab5be3e Version v1.66.0 2023-07-04 15:51:53 +07:00
Alex The Bot df9c05bef3 Version v1.65.0 2023-06-30 03:01:48 +07:00
Mert df1e8679d9
chore(ml): added testing and github workflow (#2969)
* added testing

* github action for python, made mypy happy

* formatted with black

* minor fixes and styling

* test model cache

* cache test dependencies

* narrowed model cache tests

* moved endpoint tests to their own class

* cleaned up fixtures

* formatting

* removed unused dep
2023-06-27 18:21:33 +07:00
Mert 47982641b2
fix(ml): clear model cache on load error (#2951)
* clear model cache on load error

* updated caught exceptions
2023-06-27 16:01:24 +07:00
Mert 4d3ce0a65e
fixed setting different clip, removed unused stubs (#2987) 2023-06-27 12:21:50 +07:00
Alex The Bot b258f3552a Version v1.64.0 2023-06-26 18:06:11 +07:00
Mert a58482cb2b
added locustfile (#2926) 2023-06-25 13:20:45 +07:00
Mert a2f5674bbb
refactor(ml): modularization and styling (#2835)
* basic refactor and styling

* removed batching

* module entrypoint

* removed unused imports

* model superclass,  model cache now in app state

* fixed cache dir and enforced abstract method

---------

Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2023-06-24 22:18:09 +07:00
Mert 837ad24f58
fix(deps): install poetry in pump workflow (#2938)
* install poetry in pump workflow

* formatting
2023-06-24 22:03:50 +07:00
Zeeshan Khan 34201be74c
feat(ml) backend takes image over HTTP (#2783)
* using pydantic BaseSetting

* ML API takes image file as input

* keeping image in memory

* reducing duplicate code

* using bytes instead of UploadFile & other small code improvements

* removed form-multipart, using HTTP body

* format code

---------

Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2023-06-17 22:49:19 +07:00
renovate[bot] 0909335d02
chore(deps): update python:3.11.4-slim-bullseye docker digest to 91d194f (#2797)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-06-16 11:38:59 +07:00
renovate[bot] 827e4b5f75
chore(deps): update python:3.11.4-bullseye docker digest to 5b40167 (#2796)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-06-16 11:17:23 +07:00
Thomas 16171eee8d
pin image digests (#2754)
Manifest list digests can be found with:

```sh
docker buildx imagetools inspect python:3.11.4-bullseye
docker buildx imagetools inspect python:3.11.4-slim-bullseye
docker buildx imagetools inspect ghcr.io/nginxinc/nginx-unprivileged:1.25.0-alpine3.17
```

The node images are pinned in #2736

Fixes #2751
Partially fixes #2752
2023-06-16 10:28:41 +07:00
Mert d0cc231782
feat(ml): model unloading (#2661)
* model cache

* fixed revalidation when using cache namespace

* fixed ttl not being set, added lock
2023-06-06 20:48:51 +07:00