e55c5091d9
chore(deps-dev): bump werkzeug from 3.0.1 to 3.0.3 in /machine-learning ( #9480 )
2024-05-14 16:37:50 +07:00
77b8c2f330
chore(deps): update machine-learning ( #9478 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-05-14 10:57:15 +07:00
09e9e91b6a
fix(deps): update machine-learning ( #9304 )
...
* fix(deps): update machine-learning
* use fastapi-slim
* fix lock
---------
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2024-05-14 14:46:20 +07:00
a6f557c24c
Version v1.104.0
2024-05-13 18:31:57 +07:00
8ff397527f
chore(deps): update machine-learning ( #9292 )
2024-05-06 22:21:24 +07:00
926de96ce6
chore(deps): update dependency ruff to v0.4.2 ( #9186 )
2024-04-30 14:38:05 +07:00
374a9b557b
chore(deps): update mambaorg/micromamba:bookworm-slim docker digest to f4c5c3c ( #9181 )
2024-04-30 13:37:29 +07:00
c1636ef7ab
chore(deps): update machine-learning ( #9168 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-04-30 02:24:09 +07:00
ba18776fc2
Version v1.103.1
2024-04-29 17:53:49 +07:00
4291b38769
Version v1.103.0
2024-04-29 14:42:49 +07:00
953896a35a
chore(deps): bump onnx from 1.15.0 to 1.16.0 in /machine-learning ( #9122 )
...
Bumps [onnx](https://github.com/onnx/onnx ) from 1.15.0 to 1.16.0.
- [Release notes](https://github.com/onnx/onnx/releases )
- [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog-ml.md )
- [Commits](https://github.com/onnx/onnx/compare/v1.15.0...v1.16.0 )
---
updated-dependencies:
- dependency-name: onnx
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-27 19:50:49 +07:00
70c78a09a4
chore(deps): update dependency ruff to v0.4.0 ( #9047 )
2024-04-23 17:03:32 +07:00
7a2c1bab23
chore(deps): update machine-learning ( #9029 )
2024-04-23 14:33:12 +07:00
a2180a467d
Version v1.102.3
2024-04-20 20:17:39 +07:00
25549b87c9
Version v1.102.2
2024-04-20 15:55:32 +07:00
6eb1b82541
Version v1.102.1
2024-04-20 13:43:46 +07:00
886e07604e
Version v1.102.0
2024-04-19 20:08:02 +07:00
7db07bbe61
fix(deps): update dependency gunicorn to v22 [security] ( #8863 )
2024-04-17 11:23:24 +07:00
4c4ebf769f
chore(deps): update dependency ruff to v0.3.6 ( #8850 )
2024-04-16 12:53:04 +07:00
58e516c766
Docs: minor changes ( #8814 )
...
* minor
* add image
* PR feedback
* npm run format:fix of course 4_4
* Remove what is not relevant
* pr feedback
* PR feedback
* revert npm run format
* Update docs/docs/FAQ.mdx
Co-authored-by: Ben McCann <322311+benmccann@users.noreply.github.com>
* Update FAQ.mdx
---------
Co-authored-by: Alex <alex.tran1502@gmail.com>
Co-authored-by: Ben McCann <322311+benmccann@users.noreply.github.com>
2024-04-16 07:26:12 +07:00
1c1e461936
chore(deps): update mambaorg/micromamba:bookworm-slim docker digest to 4de6145 ( #8828 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-04-16 00:40:12 +07:00
640f53fe0a
fix(deps): update dependency pillow to v10.3.0 [security] ( #8493 )
...
* fix(deps): update dependency pillow to v10.3.0 [security]
* fix typing
---------
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2024-04-11 05:48:09 +07:00
1bca1b8bde
fix(deps): update machine-learning ( #8646 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-04-11 01:38:30 +07:00
3b0fff3b3d
Version v1.101.0
2024-04-05 02:39:51 +07:00
e47a89b274
Add notes for facial recogniton models source ( #8522 )
...
Co-authored-by: LakesLab <lackeslab@gmail.com>
2024-04-04 18:42:27 +07:00
4ed68cf673
fix(deps): update dependency orjson to v3.10.0 ( #8473 )
2024-04-02 19:22:50 +07:00
e520c0d1f5
chore(deps): update dependency black to v24.3.0 [security] ( #8109 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-04-02 00:44:57 +07:00
e2d5a8c0bb
fix(deps): update machine-learning ( #8280 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-03-31 06:05:18 +07:00
16513b4a6e
Version v1.100.0
2024-03-28 18:36:38 +07:00
9fd5d2ad9c
fix(deps): update machine-learning ( #8057 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-03-20 22:59:15 +07:00
5b314ffd46
Version v1.99.0
2024-03-20 14:50:57 +07:00
e8f0f82db0
feat(ml): add cache_dir option to OpenVINO EP ( #8018 )
...
* add cache_dir option to OpenVINO EP
* update provider options test to include cache_dir
* use forward slash instead of string concatenation
* fix cache_dir placement in provider options assertion
2024-03-17 13:48:59 +07:00
3a045b33ca
chore(deps): update onnxruntime-openvino ( #7854 )
2024-03-16 00:04:45 +07:00
eea0a98090
chore(deps): update machine-learning ( #7890 )
2024-03-15 17:19:28 +07:00
37e5b91dc2
fix(server): ml gunicorn listen on ipv4 and ipv6 by default ( #7930 )
2024-03-13 12:13:56 +07:00
4b4ebe4f80
fix(deps): update machine-learning ( #7871 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-03-11 23:26:43 +07:00
4027cba4eb
Version v1.98.2
2024-03-11 14:17:12 +07:00
430561d692
Version v1.98.1
2024-03-08 23:44:13 +07:00
dbb6a8dc2a
fix(server): remove shared links during user delete ( #7696 )
...
* fix(server): remove shared links during user delete
* add delete cascade for shared links
2024-03-07 17:21:23 +07:00
7dc5e0cc4f
Version v1.98.0
2024-03-07 19:22:14 +07:00
ba5d5256b1
Revert "Version v1.98.0"
...
This reverts commit 9b1a379fa6
2024-03-07 12:04:54 +07:00
9b1a379fa6
Version v1.98.0
2024-03-07 17:40:40 +07:00
4c0bb2308c
fix(deps): update machine-learning ( #7634 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-03-06 00:24:33 +07:00
e8b001f62f
feat: preloading of machine learning models ( #7540 )
2024-03-03 19:48:56 +07:00
8ce18b3403
feat(machine-learning): support cuda 12 ( #7569 )
...
* feat: support cuda12
* fix: group optional
* move to cuda 12
* pr feedback
2024-03-02 23:36:16 +07:00
6f53e83d49
Version v1.97.0
2024-02-28 22:34:00 +07:00
6d91c23f65
Version v1.96.0
2024-02-27 20:14:58 +07:00
fd301a3261
fix(deps): update dependency orjson to v3.9.15 [security] ( #7438 )
2024-02-27 10:59:28 +07:00
8965c25f54
chore(deps): update machine-learning ( #7451 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-02-27 00:53:37 +07:00
7e18e69c1c
fix(ml): only use openvino if a gpu is available ( #7450 )
...
use `device_type`
2024-02-27 00:45:14 +07:00
2a75f884d9
Fix Smart Search when using OpenVINO ( #7389 )
...
* Fix external_path loading in OpenVINO EP
* Fix ruff lint
* Wrap block in try finally
* remove static input shape code
* add unit test
* remove unused imports
* remove repeat line
* linting
* formatting
---------
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2024-02-24 18:22:27 +07:00
a771f33fa3
chore(deps): update machine-learning ( #7225 )
2024-02-21 01:12:38 +07:00
7c34d0595e
Version v1.95.1
2024-02-21 04:02:43 +07:00
302d98ebe1
Version v1.95.0
2024-02-20 16:52:23 +07:00
ddae707ea9
fix: shell scripts ( #7186 )
...
* fix: bash scripts
* pr feedback
* wrong variable
* ci: add shellcheck workflow
* fix: missing scripts
2024-02-18 17:03:01 +07:00
3cfe2dd31f
chore(deps): update machine-learning ( #7084 )
2024-02-13 16:04:40 +07:00
a0159251d9
chore(deps): update machine-learning ( #7074 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-02-13 09:02:32 +07:00
2b8ec30767
chore(deps): update machine-learning (major) ( #6934 )
...
* chore(deps): update machine-learning
* formatting
---------
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2024-02-12 22:29:15 +07:00
bfba81de94
chore(deps): update machine-learning ( #6931 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-02-12 21:08:17 +07:00
a8fefe4467
fix(deps): update dependency python-multipart to v0.0.7 [security] ( #7054 )
2024-02-12 13:32:12 +07:00
49c378d706
fix(ml): re-enable ARMNN integration ( #7053 )
2024-02-12 13:29:55 +07:00
0c4df216d7
feat(ml): improve test coverage ( #7041 )
...
* update e2e
* tokenizer tests
* more tests, remove unnecessary code
* fix e2e setting
* add tests for loading model
* update workflow
* fixed test
2024-02-11 17:58:56 +07:00
c9b7f4e690
chore(ml): make execution provider log info-level ( #7024 )
...
* change debug log to info
* update test
2024-02-11 06:12:11 +07:00
f7d0a8ed0a
fix(deps): update dependency fastapi to v0.109.1 [security] ( #6923 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-02-06 12:21:24 +07:00
79d3342c3d
fix(ml): openvino not working with dynamic axes ( #6871 )
...
* convert to static
* add comment about gross code
* formatting
* fixed test
* fix typing
* cleanup
* formatting
* Revert "formatting"
This reverts commit 073965c47ebb56bd3297
2024-02-03 05:35:26 +07:00
07466fa7b7
Version v1.94.1
2024-01-31 19:21:00 +07:00
a7ed2b7132
Version v1.94.0
2024-01-31 15:41:53 +07:00
2bcba526df
fix(deps): update machine-learning ( #6745 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-01-29 20:43:14 +07:00
f52994e8ca
fix(ml): model paths not working ( #6705 )
...
* fix str enum string repr
* fixed typing
2024-01-28 20:54:33 +07:00
a84b6f5fb1
feat(ml): conditionally download .armnn models ( #6650 )
2024-01-28 10:31:59 +07:00
2249f7d42a
fix(ml): handle missing `context_length` field ( #6695 )
...
* handle missing `context_length` field
* specify list type
2024-01-27 19:50:50 +07:00
ca28e1e7a8
fix(ml): error logging ( #6646 )
...
* fix ml error logging
* exclude certain libraries from traceback
2024-01-26 00:26:27 +07:00
1c35110806
fix(deps): update dependency orjson to v3.9.12 ( #6600 )
2024-01-23 18:10:10 +07:00
871d0c725f
chore(deps): pin dependencies ( #6436 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-01-22 11:08:00 +07:00
95cfe22866
feat(ml)!: cuda and openvino acceleration ( #5619 )
...
* cuda and openvino ep, refactor, update dockerfile
* updated workflow
* typing fixes
* added tests
* updated ml test gh action
* updated README
* updated docker-compose
* added compute to hwaccel.yml
* updated gh matrix
updated gh matrix
updated gh matrix
updated gh matrix
updated gh matrix
give up
* remove cuda/arm64 build
* add hwaccel image tags to docker-compose
* remove unnecessary quotes
* add suffix to git tag
* fixed kwargs in base model
* armnn ld_library_path
* update pyproject.toml
* add armnn workflow
* formatting
* consolidate hwaccel files, update docker compose
* update hw transcoding docs
* add ml hwaccel docs
* update dev and prod docker-compose
* added armnn prerequisite docs
* support 3.10
* updated docker-compose comments
* formatting
* test coverage
* don't set arena extend strategy for openvino
* working openvino
* formatting
* fix dockerfile
* added type annotation
* add wsl configuration for openvino
* updated lock file
* copy python3
* comment out extends section
* fix platforms
* simplify workflow suffix tagging
* simplify aio transcoding doc
* update docs and workflow for `hwaccel.yml` change
* revert docs
2024-01-21 18:22:39 +07:00
4ebb9974ff
Version v1.93.3
2024-01-20 16:03:18 +07:00
3dddc6b449
Version v1.93.2
2024-01-19 18:29:04 +07:00
d5af357992
Version v1.93.1
2024-01-19 15:01:17 +07:00
fa0b7c8563
Version v1.93.0
2024-01-19 02:14:46 +07:00
68f52818ae
feat(server): separate face clustering job ( #5598 )
...
* separate facial clustering job
* update api
* fixed some tests
* invert clustering
* hdbscan
* update api
* remove commented code
* wip dbscan
* cleanup
removed cluster endpoint
remove commented code
* fixes
updated tests
minor fixes and formatting
fixed queuing
refinements
* scale search range based on library size
* defer non-core faces
* optimizations
removed unused query option
* assign faces individually for correctness
fixed unit tests
remove unused method
* don't select face embedding
update sql
linting
fixed ml typing
* updated job mock
* paginate people query
* select face embeddings because typeorm
* fix setting face detection concurrency
* update sql
formatting
linting
* simplify logic
remove unused imports
* more specific delete signature
* more accurate typing for face stubs
* add migration
formatting
* chore: better typing
* don't select embedding by default
remove unused import
* updated sql
* use normal try/catch
* stricter concurrency typing and enforcement
* update api
* update job concurrency panel to show disabled queues
formatting
* check jobId in queueAll
fix tests
* remove outdated comment
* better facial recognition icon
* wording
wording
formatting
* fixed tests
* fix
* formatting & sql
* try to fix sql check
* more detailed description
* update sql
* formatting
* wording
* update `minFaces` description
---------
Co-authored-by: Jason Rasmussen <jrasm91@gmail.com>
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2024-01-18 00:08:48 +07:00
d3ff2408bc
chore(deps): update mambaorg/micromamba:bookworm-slim docker digest to 377aafa ( #6434 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-01-16 16:39:31 +07:00
e2666f0e74
fix(ml): remove unused import ( #6356 )
...
* remove unused import
* formatting
2024-01-13 00:25:26 +07:00
20be42cec0
chore(deps): update machine-learning ( #6302 )
...
* chore(deps): update machine-learning
* fix typing, use new lifespan syntax
* wrap in try / finally
* move log
---------
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2024-01-13 05:00:09 +07:00
753292956e
feat(ml): ARMNN acceleration ( #5667 )
...
* feat(ml): ARMNN acceleration for CLIP
* wrap ANN as ONNX-Session
* strict typing
* normalize ARMNN CLIP embedding
* mutex to handle concurrent execution
* make inputs contiguous
* fine-grained locking; concurrent network execution
---------
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2024-01-11 18:26:46 +07:00
df59b2099f
Version v1.92.1
2024-01-08 15:24:38 +07:00
319ddfda53
Version v1.92.0
2024-01-08 05:19:11 +07:00
3edc87f684
fix(deps): update machine-learning ( #5180 )
...
* fix(deps): update machine-learning
* updated ruff command
* use isinstance
---------
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2023-12-25 22:37:48 +07:00
612590feda
fix(deps): update dependency pillow to v10 [security] ( #5944 )
2023-12-23 14:10:05 +07:00
19ea0ead85
renovate: use in-range-only strategy for python ( #5937 )
2023-12-23 09:04:36 +07:00
4dd7412a86
pin python ( #5904 )
2023-12-21 11:54:56 +07:00
092a23fd7f
feat(server,ml): remove image tagging ( #5903 )
...
* remove image tagging
* updated lock
* fixed tests, improved logging
* be nice
* fixed tests
2023-12-20 20:47:56 +07:00
b40859551b
Version v1.91.4
2023-12-19 03:34:19 +07:00
08f66c2ae5
Version v1.91.3
2023-12-17 16:57:16 +07:00
09402eb6d0
fix(ml): disable core dumps ( #5770 )
...
* update dockerfile
* remove sysctl line
2023-12-16 20:30:29 +07:00
a15c799ba3
Version v1.91.2
2023-12-16 23:19:58 +07:00
0aae9696f6
Version v1.91.1
2023-12-16 17:26:51 +07:00
7839be3b49
Adding the new models to the whitelist ( #5736 )
2023-12-15 22:45:14 +07:00
e9a8daa924
Version v1.91.0
2023-12-15 15:22:37 +07:00
e05c7f5b76
chore(deps): update mambaorg/micromamba:bookworm-slim docker digest to 5ea70d2 ( #5707 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-14 23:09:48 +07:00
d729c863c8
chore(ml): improve shutdown ( #5689 )
2023-12-14 13:51:24 +07:00
d2ad01cd2f
chore(deps): update python:3.11-slim-bookworm docker digest to cfd7ed5 ( #5572 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-09 21:15:15 +07:00
429ad28810
Version v1.90.2
2023-12-08 14:23:04 +07:00
d2fbbe790b
Version v1.90.1
2023-12-08 04:20:27 +07:00
c174f0e871
Version v1.90.0
2023-12-07 18:32:45 +07:00
259700c45f
chore(deps): update mambaorg/micromamba:bookworm-slim docker digest to e296d47 ( #5487 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-04 19:37:08 +07:00
56aed8246d
chore(deps): update python:3.11-slim-bookworm docker digest to cc75851 ( #5462 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-04 13:26:41 +07:00
6959cf689b
chore(deps): update python:3.11-bookworm docker digest to ba7a7ac ( #5438 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-02 18:35:23 +07:00
cbdcbd3ab4
chore(deps): update python:3.11-slim-bookworm docker digest to 8f82989 ( #5435 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-01 20:24:50 +07:00
cb00d45e3d
chore(deps): update python:3.11-bookworm docker digest to 47c1829 ( #5434 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-01 20:13:23 +07:00
40964187bb
chore(deps): update python:3.11-slim-bookworm docker digest to 23f5220 ( #5388 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-01 18:36:54 +07:00
fe3d951f26
chore(deps): update python:3.11-bookworm docker digest to c56b0c6 ( #5387 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-01 18:36:30 +07:00
8b6a79ad9e
Version v1.89.0
2023-11-29 19:20:24 +07:00
1fa5e220a1
chore(deps): pin dependencies ( #5367 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-11-29 02:09:11 +07:00
6e10d15f2c
pin python ( #5272 )
2023-11-22 19:42:17 +07:00
55fa3234fd
Version v1.88.2
2023-11-21 16:09:18 +07:00
a13052e24c
Revert "Version v1.88.2"
...
This reverts commit bc2c73e499
2023-11-21 09:07:50 +07:00
bc2c73e499
Version v1.88.2
2023-11-21 15:01:06 +07:00
9cf40afaf0
Version v1.88.1
2023-11-21 03:00:19 +07:00
0f596e278c
Version v1.88.0
2023-11-20 20:47:37 +07:00
ddf04a7eb4
chore(ml): increase spool threshold to 64MiB ( #5176 )
2023-11-20 09:05:35 +07:00
f7ada7351e
update onnxruntime ( #5175 )
2023-11-20 08:44:45 +07:00
ec51a9f6d6
Version v1.87.0
2023-11-18 02:58:26 +07:00
a6af4892e3
fix(ml): better model unloading ( #3340 )
...
* restart process on inactivity
* formatting
* always update `last_called`
* load models sequentially
* renamed variable, updated docs
* formatting
* made poll env name consistent with model ttl env
2023-11-16 20:42:44 +07:00
a7cacafe25
Version v1.86.0
2023-11-14 04:08:18 +07:00
291159e7fc
fixed tests ( #5017 )
2023-11-13 19:37:39 +07:00
935f471ccb
chore(ml): use strict mypy ( #5001 )
...
* improved typing
* improved export typing
* strict mypy & check export folder
* formatting
* add formatting checks for export folder
* re-added init call
2023-11-13 10:18:46 +07:00
328a58ac0d
feat(ml): add face models ( #4952 )
...
added models to config dropdown
fixed downloading
updated tests
use hf for face models
formatting
2023-11-11 19:04:49 +07:00
37ab37bffc
Version v1.85.0
2023-11-08 03:20:59 +07:00
cf4ec06750
Version v1.84.0
2023-11-01 14:46:59 +07:00
87a0ba3db3
feat(ml): export clip models to ONNX and host models on Hugging Face ( #4700 )
...
* export clip models
* export to hf
refactored export code
* export mclip, general refactoring
cleanup
* updated conda deps
* do transforms with pillow and numpy, add tokenization config to export, general refactoring
* moved conda dockerfile, re-added poetry
* minor fixes
* updated link
* updated tests
* removed `requirements.txt` from workflow
* fixed mimalloc path
* removed torchvision
* cleaner np typing
* review suggestions
* update default model name
* update test
2023-10-31 05:02:04 +07:00
d98a2a5f79
Version v1.83.0
2023-10-28 13:32:48 +07:00
31987bc043
Version v1.82.1
2023-10-18 17:14:26 +07:00
219f99e516
Version v1.82.0
2023-10-17 01:24:08 +07:00
d8ecefaea5
chore(ml): removed vit-b check and st warning ( #4422 )
2023-10-10 12:26:30 +07:00
126dd45751
Version v1.81.1
2023-10-04 17:53:42 +07:00
81d51fbd7e
Version v1.81.0
2023-10-03 20:48:23 +07:00
66e860a08e
Version v1.80.0
2023-10-02 14:47:21 +07:00
e050121dbf
Version v1.79.1
2023-09-22 01:37:20 +07:00
86f5ceb80e
Version v1.79.0
2023-09-21 14:17:00 +07:00
a3206bf950
Version v1.78.1
2023-09-14 13:56:33 +07:00
b42ca61e1f
Version v1.78.0
2023-09-13 08:24:02 +07:00
cb437829f3
chore(docs): updated ML documentation ( #4063 )
2023-09-12 13:22:42 +07:00
258b98c262
fix(ml): load models in separate threads ( #4034 )
...
* load models in thread
* set clip mode logs to debug level
* updated tests
* made fixtures slightly less ugly
* moved responses to json file
* formatting
2023-09-09 16:02:44 +07:00
b8777d7739
Add french documentation ( #4010 )
...
* Copy original README for online editing
* Translate to french
* Add link from other documentations
* Add machine-learning french doc
* Typos
* Missing word
---------
Co-authored-by: Alexandre Bouijoux <alexandre@bouijoux.fr>
2023-09-08 13:48:39 +07:00
0a24ff90bb
fix(ml): set higher default worker timeout ( #4007 )
2023-09-07 08:27:29 +07:00
608543da0b
Version v1.77.0
2023-09-06 03:30:44 +07:00
3cf0f5f11b
fix(ml): model downloading improvements ( #3988 )
...
* handle ort `NoSuchFile` error, stricter file check
* keep exception order
2023-09-06 08:48:40 +07:00
b7fd5dcb4a
dev(ml): fixed `docker-compose.dev.yml`, updated locust ( #3951 )
...
* fixed dev docker compose
* updated locustfile
* deleted old script, moved comments to locustfile
2023-09-01 21:59:17 +07:00
c7d53a5006
docs: remove obsolete environment variables ( #3926 )
...
* Obsolete environment variables
* Review fixes
* Review fixes
* Review fixes
2023-09-01 18:05:45 +07:00
41461e0d5d
chore(ml): memory optimisations ( #3934 )
2023-08-31 18:30:53 +07:00
58ae734fc2
Version v1.76.1
2023-08-30 08:26:04 +07:00
54b2779b79
chore(ml): improved logging ( #3918 )
...
* fixed `minScore` not being set correctly
* apply to init
* don't send `enabled`
* fix eslint warning
* added logger
* added logging
* refinements
* enable access log for info level
* formatting
* merged strings
---------
Co-authored-by: Alex <alex.tran1502@gmail.com>
2023-08-30 08:22:01 +07:00
df26e12db6
fix(ml): `minScore` not being set correctly ( #3916 )
...
* fixed `minScore` not being set correctly
* apply to init
* don't send `enabled`
* fix eslint warning
* better error message
2023-08-30 03:16:00 +07:00
49c2d4d115
Version v1.76.0
2023-08-29 19:24:43 +07:00
bcc36d14a1
feat(ml)!: customizable ML settings ( #3891 )
...
* consolidated endpoints, added live configuration
* added ml settings to server
* added settings dashboard
* updated deps, fixed typos
* simplified modelconfig
updated tests
* Added ml setting accordion for admin page
updated tests
* merge `clipText` and `clipVision`
* added face distance setting
clarified setting
* add clip mode in request, dropdown for face models
* polished ml settings
updated descriptions
* update clip field on error
* removed unused import
* add description for image classification threshold
* pin safetensors for arm wheel
updated poetry lock
* moved dto
* set model type only in ml repository
* revert form-data package install
use fetch instead of axios
* added slotted description with link
updated facial recognition description
clarified effect of disabling tasks
* validation before model load
* removed unnecessary getconfig call
* added migration
* updated api
updated api
updated api
---------
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2023-08-29 08:58:00 +07:00
f1027d7807
Version v1.75.2
2023-08-26 22:34:54 +07:00
cc1fecfffd
Version v1.75.1
2023-08-26 18:31:14 +07:00
6fe214a784
Version v1.75.0
2023-08-26 04:44:39 +07:00
165b91b068
feat(ml)!: switch image classification and CLIP models to ONNX ( #3809 )
2023-08-25 06:28:51 +07:00
60729a091a
make lazy loading default ( #3797 )
2023-08-20 18:24:14 +07:00
d2bad1d553
Version v1.74.0
2023-08-19 06:09:16 +07:00
a3b6095b61
Version v1.73.0
2023-08-15 12:45:48 +07:00
fa57853bd2
fix(ml): clear cache if bad zip file ( #3600 )
2023-08-08 12:33:13 +07:00
6efc2ec9be
Version v1.72.2
2023-08-07 16:41:17 +07:00
b3b5f063cf
Version v1.72.1
2023-08-07 02:54:24 +07:00
3edb347666
Version v1.72.0
2023-08-06 19:48:25 +07:00
c73832bd9c
refactor(ml): model downloading ( #3545 )
...
* download facial recognition models
* download hf models
* simplified logic
* updated `predict` for facial recognition
* ensure download method is called
* fixed repo_id for clip
* fixed download destination
* use st's own `snapshot_download`
* conditional download
* fixed predict method
* check if loaded
* minor fixes
* updated mypy overrides
* added pytest-mock
* updated tests
* updated lock
2023-08-05 21:45:13 +07:00
1cf3378499
Add Spanish translations of Readme ( #3511 )
2023-08-02 06:51:08 +07:00
3f1cf44717
Version v1.71.0
2023-07-28 18:32:33 +07:00
2872886e77
Version v1.70.0
2023-07-27 03:40:16 +07:00
f41e1159d1
Version v1.69.0
2023-07-23 17:40:02 +07:00
8f08100a30
moved deps ( #3379 )
2023-07-22 15:04:52 +07:00
bc885f3644
fix(server): properly handle SIGTERM ( #3350 )
...
* use tini init
* Move python into CMD
* Use tini as entrypoint
* Toggle executable bit
* Avoid compose changes
* Adapt web entrypoint
2023-07-21 09:20:04 +07:00
1835fbae49
Version v1.68.0
2023-07-20 03:06:12 +07:00
81e07fda08
Version v1.67.2
2023-07-14 14:01:20 +07:00
2d4e2af629
Version v1.67.1
2023-07-14 02:45:02 +07:00
cd184cf366
Version v1.67.0
2023-07-14 00:39:54 +07:00
848ba685eb
fix(ml): race condition when loading models ( #3207 )
...
* sync model loading, disabled model ttl by default
* disable revalidation if model unloading disabled
* moved lock
2023-07-11 12:01:21 +07:00
0d30ceb284
Version v1.66.1
2023-07-05 02:50:53 +07:00
8a3ab5be3e
Version v1.66.0
2023-07-04 15:51:53 +07:00
df9c05bef3
Version v1.65.0
2023-06-30 03:01:48 +07:00
df1e8679d9
chore(ml): added testing and github workflow ( #2969 )
...
* added testing
* github action for python, made mypy happy
* formatted with black
* minor fixes and styling
* test model cache
* cache test dependencies
* narrowed model cache tests
* moved endpoint tests to their own class
* cleaned up fixtures
* formatting
* removed unused dep
2023-06-27 18:21:33 +07:00
47982641b2
fix(ml): clear model cache on load error ( #2951 )
...
* clear model cache on load error
* updated caught exceptions
2023-06-27 16:01:24 +07:00
4d3ce0a65e
fixed setting different clip, removed unused stubs ( #2987 )
2023-06-27 12:21:50 +07:00
b258f3552a
Version v1.64.0
2023-06-26 18:06:11 +07:00
a58482cb2b
added locustfile ( #2926 )
2023-06-25 13:20:45 +07:00
a2f5674bbb
refactor(ml): modularization and styling ( #2835 )
...
* basic refactor and styling
* removed batching
* module entrypoint
* removed unused imports
* model superclass, model cache now in app state
* fixed cache dir and enforced abstract method
---------
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2023-06-24 22:18:09 +07:00
837ad24f58
fix(deps): install poetry in pump workflow ( #2938 )
...
* install poetry in pump workflow
* formatting
2023-06-24 22:03:50 +07:00
34201be74c
feat(ml) backend takes image over HTTP ( #2783 )
...
* using pydantic BaseSetting
* ML API takes image file as input
* keeping image in memory
* reducing duplicate code
* using bytes instead of UploadFile & other small code improvements
* removed form-multipart, using HTTP body
* format code
---------
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2023-06-17 22:49:19 +07:00
0909335d02
chore(deps): update python:3.11.4-slim-bullseye docker digest to 91d194f ( #2797 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-06-16 11:38:59 +07:00
827e4b5f75
chore(deps): update python:3.11.4-bullseye docker digest to 5b40167 ( #2796 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-06-16 11:17:23 +07:00
16171eee8d
pin image digests ( #2754 )
...
Manifest list digests can be found with:
```sh
docker buildx imagetools inspect python:3.11.4-bullseye
docker buildx imagetools inspect python:3.11.4-slim-bullseye
docker buildx imagetools inspect ghcr.io/nginxinc/nginx-unprivileged:1.25.0-alpine3.17
```
The node images are pinned in #2736
Fixes #2751
Partially fixes #2752
2023-06-16 10:28:41 +07:00
d0cc231782
feat(ml): model unloading ( #2661 )
...
* model cache
* fixed revalidation when using cache namespace
* fixed ttl not being set, added lock
2023-06-06 20:48:51 +07:00
1e748864c5
chore(ml): updated dockerfile, added typing, packaging ( #2642 )
...
* updated dockerfile, added typing, packaging
apply env change
* added arm64 support
* added ml version pump, second try for arm64
* added linting config to pyproject.toml
* renamed ml input field
* fixed linter config
* fixed dev docker compose
2023-06-05 09:40:48 +07:00
b8de668f5f
feat(ml): env variables for tags, faces and eager startup ( #2626 )
...
* env variables for tags, faces and eager startup
* chore(server,ml): remove object detection job and endpoint (#2627 )
* removed object detection job
* removed object detection endpoint
* env variables for tags, faces and eager startup
* download without caching models if not eager
* simplified `get_cached_model`
* re-added env for clip text model
2023-06-02 21:42:47 +07:00
631f13cf2f
chore(server,ml): remove object detection job and endpoint ( #2627 )
...
* removed object detection job
* removed object detection endpoint
2023-05-31 20:49:51 +07:00
84cfa38510
chore(ml): load models on start up ( #2487 )
...
* chore(ml): load models on start up
* Download correct model
2023-05-19 22:37:01 +07:00
93863b0629
feat: facial recognition ( #2180 )
2023-05-17 12:07:17 +07:00
8cc9b08c06
chore(ml): use official pytorch channel ( #2416 )
2023-05-10 07:09:33 +07:00
b6b9f51bd7
chore(ml): Fix entrypoint path ( #2373 )
2023-05-03 14:27:35 +07:00
7e965cb6d4
chore(ml): move to fastAPI ( #2336 )
2023-04-26 05:39:24 +07:00
08b424b3df
update gitignore
2023-04-22 13:31:42 +07:00
2dcccb37a0
chore(docker): Default NODE_ENV to production for server image and update alpine version ( #2157 )
...
* default NODE_ENV to production for server image
* update node image to use 3.17 alpine in server
* update web docker image to use alpine 3.17
* remove NODE_ENV from production docker-compose
* NODE_ENV is also needed default in machine-learning
2023-04-03 15:05:29 +07:00
f56eaae019
feat(server): CLIP search integration ( #1939 )
2023-03-18 08:44:42 +07:00
d5d0624311
Feat/ml image optimisations ( #1916 )
...
* Use multi stage build to slim down ML image size
* Use gunicorn as WSGI server in ML image
* Configure gunicorn server for ML use case
* Use requirements.txt file to install python dependencies in ML image
* Make ML listen IP configurable
* Revert "Use requirements.txt file to install python dependencies in ML image"
This reverts commit 32e706c7f3
2023-03-03 16:45:20 +07:00
1cc184ed10
Revert "feat(server): Machine learning's image optimisations ( #1908 )" ( #1915 )
...
This reverts commit 977740045a
2023-03-01 11:48:35 +07:00
977740045a
feat(server): Machine learning's image optimisations ( #1908 )
...
* Use multi stage build to slim down ML image size
* Use gunicorn as WSGI server in ML image
* Configure gunicorn server for ML use case
* Use requirements.txt file to install python dependencies in ML image
* Make ML listen IP configurable
2023-03-01 09:37:12 +07:00
ab90b01122
feat(server) Enable ML support for ARM CPUs ( #1880 )
...
* Install nightly release of pytorch to enable ML support for arm CPUs
* Remove linux/arm/v7 from ML docker builds
* Add --no-cache-dir to torch installation command in ML image build
* Use PIP_NO_CACHE_DIR option in ML build to further decrease image size
2023-02-26 15:00:09 +07:00
3d468c369c
fix: machine learning only take results with > 90% confidence ( #1875 )
2023-02-25 22:02:35 +07:00
b00631d186
fix(machine-learning): Add the command to execute at startup ( #1843 )
...
* fix(machine-learning): Add the command to execute at startup
Previously it wasn't set in the Docker container but it should be.
* fix(docker): remove machine-learning command arg
* fix(docker): machine-learning CMD argument
2023-02-23 09:54:04 +07:00
a3b9a0be3a
fix(server): Flask not found ( #1830 )
...
* fix(server): Flask not found
* trial 1
2023-02-22 10:53:59 +07:00
57136e48fb
feat(machine-learning)!: move machine learning to Python based image ( #1774 )
...
BREAKING CHANGES
* Users have to update the docker-compose file, machine-learning portion.
* Temporary dropping machine-learning support for Arm64 and Armv7
2023-02-18 09:13:37 +07:00
43da8c2a72
chore: reduce docker image size ( #1523 )
...
* chore: remove @tensorflow/tfjs-node-gpu as it is unused
* chore: remove ffmpeg from machine-learning docker image
* chore: remove unneeded dependencies + move dev dependencies in server
* chore: reduce server image size
* chore: machine-learning remove extraneous dependencies
* chore: web remove extraneous dependencies
* chore: web Dockerfile reduce production image size
* chore: add exiftool-vendored.pl as a dependency
2023-02-02 21:28:34 +07:00
9d337bf4dc
feat(server/machine-learning): Configurable port ( #1386 )
...
* feat(server/machine-learning): Configurable port
* feat(server/machine-learning): Address PR comments.
* feat(server/machine-learning): Simplify
Co-authored-by: Alex <alex.tran1502@gmail.com>
2023-01-23 22:18:35 +07:00
16b763e086
fix(docker-build): start main process with exec ( #1210 )
...
* Use exec
* Appl shellcheck fixes
* Close with newline
2022-12-29 14:49:02 +07:00
2e4c005ad9
refactor: multistage builds ( #955 )
2022-11-10 22:22:17 +07:00
c3348bd068
Fixed Dockerfile not working in dev
2022-11-09 23:34:35 +07:00
cc61729f01
build(server): use github-action cache ( #949 )
...
* build(server): prune dependencies in docker builder
* fix: e2e tests
* refactor: dockerfile step order
* fix: vips build dependency
* feat: use caching
2022-11-09 19:53:21 +07:00
676ad2d34f
chore(server) revert Dockerfile ( #878 )
2022-10-27 17:21:28 +07:00
b713fb5650
feat(docker) revert ubuntu base image ( #863 )
...
* feat(docker) revert ubuntu base image
This PR reverts the base image for immich-server back to alpine
Adds LICENSE to all Images
Quiets apt-get commands when building
ensures write-permission for root group on app folders
Signed-off-by: PixelJonas <5434875+PixelJonas@users.noreply.github.com>
* Test build old Docker content
* Revert and retry
Signed-off-by: PixelJonas <5434875+PixelJonas@users.noreply.github.com>
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2022-10-25 14:18:37 +07:00
c3979f6e31
fix(machine-learning) Remove unsused database config ( #745 )
2022-09-23 19:00:47 +07:00
c436c57cc9
Fixed immich-machine-learning container not starting correctly in production
2022-08-20 23:04:10 +07:00
10ef3509dd
Fixed machine-learning container cannot start prod
2022-08-20 22:27:25 +07:00
3dc538f9e6
Fixed machine-learning container cannot start prod
2022-08-20 22:26:47 +07:00
1e29ff322d
build(server): minimal container ( #506 )
...
* build(server): update Dockerfile
* build(server): fix dockerfile
* build(machine-learning): multiple build stages
* build(server): update Dockerfile
2022-08-20 21:19:02 +07:00
a35460cb84
Bump tfjs version to 3.19.0 for arm64 support ( #368 )
...
* Add linux/arm64 to machine-learning container build
* Bump tfjs version to 3.19.0
* Fix tfjs dependency error
2022-07-23 14:15:55 +07:00
d69470e207
Add extended redis & DB port configuration via environment variables ( #330 )
...
* Add database port configuration via env variable
Add redis connection configuration via env variables
* Add redis connection configuration via env variables
2022-07-12 22:21:11 +07:00
355038a91a
Use `npm ci` for installing pacakages ( #304 )
2022-07-04 13:47:25 +07:00
c071e64a7e
infra: switch port to 3003 for machine learning container ( #290 )
...
* infra: switch port to 3003 for machine learning container
fixes #289
* Changed port of machine-learning-endpoint to match with new port
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2022-07-01 10:20:04 +07:00
a8220172f8
WIP refactor container and queuing system ( #206 )
...
* refactor microservices to machine-learning
* Update tGithub issue template with correct task syntax
* Added microservices container
* Communicate between service based on queue system
* added dependency
* Fixed problem with having to import BullQueue into the individual service
* Added todo
* refactor server into monorepo with microservices
* refactor database and entity to library
* added simple migration
* Move migrations and database config to library
* Migration works in library
* Cosmetic change in logging message
* added user dto
* Fixed issue with testing not able to find the shared library
* Clean up library mapping path
* Added webp generator to microservices
* Update Github Action build latest
* Fixed issue NPM cannot install due to conflict witl Bull Queue
* format project with prettier
* Modified docker-compose file
* Add GH Action for Staging build:
* Fixed GH action job name
* Modified GH Action to only build & push latest when pushing to main
* Added Test 2e2 Github Action
* Added Test 2e2 Github Action
* Implemented microservice to extract exif
* Added cronjob to scan and generate webp thumbnail at midnight
* Refactor to ireduce hit time to database when running microservices
* Added error handling to asset services that handle read file from disk
* Added video transcoding queue to process one video at a time
* Fixed loading spinner on web while loading covering the info panel
* Add mechanism to show new release announcement to web and mobile app (#209 )
* Added changelog page
* Fixed issues based on PR comments
* Fixed issue with video transcoding run on the server
* Change entry point content for backward combatibility when starting up server
* Added announcement box
* Added error handling to failed silently when the app version checking is not able to make the request to GITHUB
* Added new version announcement overlay
* Update message
* Added messages
* Added logic to check and show announcement
* Add method to handle saving new version
* Added button to dimiss the acknowledge message
* Up version for deployment to the app store
2022-06-11 16:12:06 +07:00
dependabot[bot]
renovate[bot]
Alex The Bot
aviv926
Lukas
Davide
Mert
Andrew Rowson
Sam Holton
DawidPietrykowski
martin
Sourav Agrawal
Fynn Petersen-Frey
Mohamed BOUSSAID
Alexandre Bouijoux
Daniele Ricci
Jorge Avila
bt90
Zeeshan Khan
Thomas
Jason Rasmussen
bo0tzz
Devin Buhl
Olly Welch
Zack Pollard
Skyler Mäntysaari
Jonas Janz
Thanh Pham
bo0tzz
Fynn Petersen-Frey
Jaime Baez