2025-03-25T15:45:54.761585150Z /package/admin/s6-overlay/libexec/preinit: info: container permissions: uid=0 (root), euid=0, gid=0 (root), egid=0 2025-03-25T15:45:54.761603653Z /package/admin/s6-overlay/libexec/preinit: info: /run permissions: uid=0 (root), gid=0 (root), perms=oxorgxgruxuwur 2025-03-25T15:45:54.849353477Z s6-rc: info: service s6rc-oneshot-runner: starting 2025-03-25T15:45:54.851120454Z s6-rc: info: service s6rc-oneshot-runner successfully started 2025-03-25T15:45:54.851305980Z s6-rc: info: service fix-attrs: starting 2025-03-25T15:45:54.851345324Z s6-rc: info: service init-migrations: starting 2025-03-25T15:45:54.851419271Z s6-rc: info: service init-envfile: starting 2025-03-25T15:45:54.854354982Z [migrations] started 2025-03-25T15:45:54.854370162Z [migrations] no migrations found 2025-03-25T15:45:54.854599879Z s6-rc: info: service init-migrations successfully started 2025-03-25T15:45:54.854694974Z s6-rc: info: service init-adduser: starting 2025-03-25T15:45:54.854789152Z s6-rc: info: service fix-attrs successfully started 2025-03-25T15:45:54.854854782Z s6-rc: info: service legacy-cont-init: starting 2025-03-25T15:45:54.855772280Z s6-rc: info: service init-envfile successfully started 2025-03-25T15:45:54.857488622Z s6-rc: info: service legacy-cont-init successfully started 2025-03-25T15:45:54.879338804Z 2025-03-25T15:45:54.879351704Z ╔═══════════════════════════════╗ 2025-03-25T15:45:54.879353650Z __ _____ _____ __ 2025-03-25T15:45:54.879354792Z / / |_ _/ ____| / / 2025-03-25T15:45:54.879355801Z / / | || | __ / / 2025-03-25T15:45:54.879356970Z / / | || | |_ | / / 2025-03-25T15:45:54.879357953Z / / _| || |__| | / / 2025-03-25T15:45:54.879358948Z /_/ |_____\_____| /_/ 2025-03-25T15:45:54.879360006Z 2025-03-25T15:45:54.879361005Z Baseimage from linuxserver.io 2025-03-25T15:45:54.880980954Z ╠═══════════════════════════════╣ 2025-03-25T15:45:54.880989519Z User/Group ID: 2025-03-25T15:45:54.880991215Z User UID: 911 2025-03-25T15:45:54.880992290Z User GID: 911 2025-03-25T15:45:54.880993365Z ╚═══════════════════════════════╝ 2025-03-25T15:45:54.882184254Z s6-rc: info: service init-adduser successfully started 2025-03-25T15:45:54.882250515Z s6-rc: info: service init-os-end: starting 2025-03-25T15:45:54.882744731Z s6-rc: info: service init-os-end successfully started 2025-03-25T15:45:54.882796495Z s6-rc: info: service init-config: starting 2025-03-25T15:45:54.883588624Z s6-rc: info: service init-config successfully started 2025-03-25T15:45:54.883657281Z s6-rc: info: service init-crontab-config: starting 2025-03-25T15:45:54.883735188Z s6-rc: info: service init-check-variables: starting 2025-03-25T15:45:54.886153444Z s6-rc: info: service init-check-variables successfully started 2025-03-25T15:45:54.886162079Z s6-rc: info: service init-config-immich: starting 2025-03-25T15:45:54.887362348Z s6-rc: info: service init-crontab-config successfully started 2025-03-25T15:45:59.787325540Z s6-rc: info: service init-config-immich successfully started 2025-03-25T15:45:59.787366679Z s6-rc: info: service init-test-run: starting 2025-03-25T15:45:59.789967871Z Configuring CI for test run 2025-03-25T15:46:31.902121730Z ALTER ROLE 2025-03-25T15:46:31.908275041Z % Total % Received % Xferd Average Speed Time Time Time Current 2025-03-25T15:46:31.908285507Z Dload Upload Total Spent Left Speed 2025-03-25T15:46:32.224604730Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2025-03-25T15:46:33.445476610Z 6 30.6M 6 2190k 0 0 1722k 0 0:00:18 0:00:01 0:00:17 1722k 100 30.6M 100 30.6M 0 0 19.9M 0 0:00:01 0:00:01 --:--:-- 107M 2025-03-25T15:46:33.468891000Z Selecting previously unselected package vectors-pg16. 2025-03-25T15:46:33.476121581Z (Reading database ... 21576 files and directories currently installed.) 2025-03-25T15:46:33.476798240Z Preparing to unpack /tmp/vectors.deb ... 2025-03-25T15:46:33.487369896Z Unpacking vectors-pg16 (0.2.0) ... 2025-03-25T15:46:34.020712217Z Setting up vectors-pg16 (0.2.0) ... 2025-03-25T15:46:34.060839660Z Processing triggers for postgresql-common (274) ... 2025-03-25T15:46:34.130901262Z debconf: unable to initialize frontend: Dialog 2025-03-25T15:46:34.130919593Z debconf: (No usable dialog-like program is installed, so the dialog based frontend cannot be used. at /usr/share/perl5/Debconf/FrontEnd/Dialog.pm line 79.) 2025-03-25T15:46:34.130921245Z debconf: falling back to frontend: Readline 2025-03-25T15:46:34.135644854Z debconf: unable to initialize frontend: Readline 2025-03-25T15:46:34.135654928Z debconf: (This frontend requires a controlling tty.) 2025-03-25T15:46:34.135656405Z debconf: falling back to frontend: Teletype 2025-03-25T15:46:34.158396289Z Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2025-03-25T15:46:34.158409160Z Removing obsolete dictionary files: 2025-03-25T15:46:34.246431706Z ALTER SYSTEM 2025-03-25T15:46:39.552495881Z CREATE EXTENSION 2025-03-25T15:46:39.553132424Z PostgreSQL/Redis started 2025-03-25T15:46:39.555433163Z s6-rc: info: service init-test-run successfully started 2025-03-25T15:46:39.555997496Z s6-rc: info: service init-video-immich: starting 2025-03-25T15:46:39.566207606Z s6-rc: info: service init-video-immich successfully started 2025-03-25T15:46:39.566307307Z s6-rc: info: service init-config-end: starting 2025-03-25T15:46:39.566915115Z s6-rc: info: service init-config-end successfully started 2025-03-25T15:46:39.566985692Z s6-rc: info: service init-mods: starting 2025-03-25T15:46:39.567533942Z s6-rc: info: service init-mods successfully started 2025-03-25T15:46:39.567604278Z s6-rc: info: service init-mods-package-install: starting 2025-03-25T15:46:39.570054624Z s6-rc: info: service init-mods-package-install successfully started 2025-03-25T15:46:39.570135472Z s6-rc: info: service init-mods-end: starting 2025-03-25T15:46:39.570678268Z s6-rc: info: service init-mods-end successfully started 2025-03-25T15:46:39.570721669Z s6-rc: info: service init-custom-files: starting 2025-03-25T15:46:39.572823306Z [custom-init] No custom files found, skipping... 2025-03-25T15:46:39.573016564Z s6-rc: info: service init-custom-files successfully started 2025-03-25T15:46:39.573067162Z s6-rc: info: service init-services: starting 2025-03-25T15:46:39.573582880Z s6-rc: info: service init-services successfully started 2025-03-25T15:46:39.573769731Z s6-rc: info: service svc-server: starting 2025-03-25T15:46:39.573945884Z s6-rc: info: service svc-cron: starting 2025-03-25T15:46:39.576414062Z s6-rc: info: service svc-cron successfully started 2025-03-25T15:46:42.527089438Z Starting api worker 2025-03-25T15:46:43.565344487Z [Nest] 2639 - 03/25/2025, 3:46:43 PM LOG [Api:EventRepository] Initialized websocket server 2025-03-25T15:46:43.638070829Z Query failed : { 2025-03-25T15:46:43.638087339Z durationMs: 1.4017820000001393, 2025-03-25T15:46:43.638089376Z error: PostgresError: relation "pg_vector_index_stat" does not exist 2025-03-25T15:46:43.638091315Z at ErrorResponse (/app/immich/server/node_modules/postgres/cjs/src/connection.js:788:26) 2025-03-25T15:46:43.638092908Z at handle (/app/immich/server/node_modules/postgres/cjs/src/connection.js:474:6) 2025-03-25T15:46:43.638094427Z at Socket.data (/app/immich/server/node_modules/postgres/cjs/src/connection.js:315:9) 2025-03-25T15:46:43.638095887Z at Socket.emit (node:events:524:28) 2025-03-25T15:46:43.638097584Z at addChunk (node:internal/streams/readable:561:12) 2025-03-25T15:46:43.638099090Z at readableAddChunkPushByteMode (node:internal/streams/readable:512:3) 2025-03-25T15:46:43.638100808Z at Readable.push (node:internal/streams/readable:392:5) 2025-03-25T15:46:43.638102434Z at TCP.onStreamRead (node:internal/stream_base_commons:191:23) { 2025-03-25T15:46:43.638104053Z severity_local: 'ERROR', 2025-03-25T15:46:43.638105536Z severity: 'ERROR', 2025-03-25T15:46:43.638118403Z code: '42P01', 2025-03-25T15:46:43.638119541Z position: '24', 2025-03-25T15:46:43.638120536Z file: 'parse_relation.c', 2025-03-25T15:46:43.638121538Z line: '1449', 2025-03-25T15:46:43.638122520Z routine: 'parserOpenTable' 2025-03-25T15:46:43.638123569Z }, 2025-03-25T15:46:43.638124520Z sql: 'SELECT idx_status FROM pg_vector_index_stat WHERE indexname = $1', 2025-03-25T15:46:43.638125628Z params: [ 'clip_index' ] 2025-03-25T15:46:43.638126629Z } 2025-03-25T15:46:43.638764219Z Query failed : { 2025-03-25T15:46:43.638775308Z durationMs: 0.41445699999985663, 2025-03-25T15:46:43.638778414Z error: PostgresError: relation "pg_vector_index_stat" does not exist 2025-03-25T15:46:43.638780800Z at ErrorResponse (/app/immich/server/node_modules/postgres/cjs/src/connection.js:788:26) 2025-03-25T15:46:43.638783060Z at handle (/app/immich/server/node_modules/postgres/cjs/src/connection.js:474:6) 2025-03-25T15:46:43.638785225Z at Socket.data (/app/immich/server/node_modules/postgres/cjs/src/connection.js:315:9) 2025-03-25T15:46:43.638787218Z at Socket.emit (node:events:524:28) 2025-03-25T15:46:43.638789045Z at addChunk (node:internal/streams/readable:561:12) 2025-03-25T15:46:43.638791076Z at readableAddChunkPushByteMode (node:internal/streams/readable:512:3) 2025-03-25T15:46:43.638799444Z at Readable.push (node:internal/streams/readable:392:5) 2025-03-25T15:46:43.638801673Z at TCP.onStreamRead (node:internal/stream_base_commons:191:23) { 2025-03-25T15:46:43.638803662Z severity_local: 'ERROR', 2025-03-25T15:46:43.638805522Z severity: 'ERROR', 2025-03-25T15:46:43.638807348Z code: '42P01', 2025-03-25T15:46:43.638809150Z position: '24', 2025-03-25T15:46:43.638811087Z file: 'parse_relation.c', 2025-03-25T15:46:43.638813022Z line: '1449', 2025-03-25T15:46:43.638814850Z routine: 'parserOpenTable' 2025-03-25T15:46:43.638816727Z }, 2025-03-25T15:46:43.638818556Z sql: 'SELECT idx_status FROM pg_vector_index_stat WHERE indexname = $1', 2025-03-25T15:46:43.638822851Z params: [ 'face_index' ] 2025-03-25T15:46:43.638824781Z } 2025-03-25T15:46:43.660940858Z [Nest] 2639 - 03/25/2025, 3:46:43 PM LOG [Api:DatabaseRepository] Running migrations, this may take a while 2025-03-25T15:46:45.672308396Z [Nest] 2639 - 03/25/2025, 3:46:45 PM LOG [Api:ServerService] Feature Flags: { 2025-03-25T15:46:45.672331344Z "smartSearch": true, 2025-03-25T15:46:45.672334959Z "facialRecognition": true, 2025-03-25T15:46:45.672346677Z "duplicateDetection": true, 2025-03-25T15:46:45.672349111Z "map": true, 2025-03-25T15:46:45.672351236Z "reverseGeocoding": true, 2025-03-25T15:46:45.672353500Z "importFaces": false, 2025-03-25T15:46:45.672355612Z "sidecar": true, 2025-03-25T15:46:45.672357454Z "search": true, 2025-03-25T15:46:45.672359249Z "trash": true, 2025-03-25T15:46:45.672361106Z "oauth": false, 2025-03-25T15:46:45.672363053Z "oauthAutoLaunch": false, 2025-03-25T15:46:45.672364928Z "passwordLogin": true, 2025-03-25T15:46:45.672366749Z "configFile": false, 2025-03-25T15:46:45.672368802Z "email": false 2025-03-25T15:46:45.672370761Z } 2025-03-25T15:46:45.673812906Z [Nest] 2639 - 03/25/2025, 3:46:45 PM LOG [Api:StorageService] Verifying system mount folder checks, current state: {"mountChecks":{}} 2025-03-25T15:46:45.673824097Z [Nest] 2639 - 03/25/2025, 3:46:45 PM LOG [Api:StorageService] Writing initial mount file for the encoded-video folder 2025-03-25T15:46:45.675586328Z [Nest] 2639 - 03/25/2025, 3:46:45 PM LOG [Api:StorageService] Writing initial mount file for the library folder 2025-03-25T15:46:45.676171383Z [Nest] 2639 - 03/25/2025, 3:46:45 PM LOG [Api:StorageService] Writing initial mount file for the upload folder 2025-03-25T15:46:45.676719278Z [Nest] 2639 - 03/25/2025, 3:46:45 PM LOG [Api:StorageService] Writing initial mount file for the profile folder 2025-03-25T15:46:45.677184407Z [Nest] 2639 - 03/25/2025, 3:46:45 PM LOG [Api:StorageService] Writing initial mount file for the thumbs folder 2025-03-25T15:46:45.677714539Z [Nest] 2639 - 03/25/2025, 3:46:45 PM LOG [Api:StorageService] Writing initial mount file for the backups folder 2025-03-25T15:46:45.683147359Z [Nest] 2639 - 03/25/2025, 3:46:45 PM LOG [Api:StorageService] Successfully enabled system mount folders checks 2025-03-25T15:46:45.683162437Z [Nest] 2639 - 03/25/2025, 3:46:45 PM LOG [Api:StorageService] Successfully verified system mount folder checks 2025-03-25T15:46:46.065863001Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:SystemConfigService] LogLevel=log (set via system config) 2025-03-25T15:46:46.072007029Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:NestFactory] Starting Nest application... 2025-03-25T15:46:46.072025987Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] BullModule dependencies initialized 2025-03-25T15:46:46.072027954Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] ClsModule dependencies initialized 2025-03-25T15:46:46.072034762Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] ClsCommonModule dependencies initialized 2025-03-25T15:46:46.072036636Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] OpenTelemetryModule dependencies initialized 2025-03-25T15:46:46.072038328Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] KyselyModule dependencies initialized 2025-03-25T15:46:46.072054943Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] KyselyCoreModule dependencies initialized 2025-03-25T15:46:46.072063963Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] DiscoveryModule dependencies initialized 2025-03-25T15:46:46.072066247Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] OpenTelemetryCoreModule dependencies initialized 2025-03-25T15:46:46.072107709Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] ClsRootModule dependencies initialized 2025-03-25T15:46:46.072120667Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] ScheduleModule dependencies initialized 2025-03-25T15:46:46.072124448Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] BullModule dependencies initialized 2025-03-25T15:46:46.072129498Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] BullModule dependencies initialized 2025-03-25T15:46:46.072131929Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:InstanceLoader] ApiModule dependencies initialized 2025-03-25T15:46:46.072137511Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] APIKeyController {/api/api-keys}: 2025-03-25T15:46:46.072147209Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys, POST} route 2025-03-25T15:46:46.072155081Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys, GET} route 2025-03-25T15:46:46.072173446Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, GET} route 2025-03-25T15:46:46.072177552Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, PUT} route 2025-03-25T15:46:46.072180064Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, DELETE} route 2025-03-25T15:46:46.072188560Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] ActivityController {/api/activities}: 2025-03-25T15:46:46.072190766Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/activities, GET} route 2025-03-25T15:46:46.072197132Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/activities, POST} route 2025-03-25T15:46:46.072204458Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/activities/statistics, GET} route 2025-03-25T15:46:46.072218976Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/activities/:id, DELETE} route 2025-03-25T15:46:46.072221566Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] AlbumController {/api/albums}: 2025-03-25T15:46:46.072228552Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/albums, GET} route 2025-03-25T15:46:46.072236538Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/albums, POST} route 2025-03-25T15:46:46.072255018Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/albums/statistics, GET} route 2025-03-25T15:46:46.072259583Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, GET} route 2025-03-25T15:46:46.072263137Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, PATCH} route 2025-03-25T15:46:46.072270074Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, DELETE} route 2025-03-25T15:46:46.072287464Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, PUT} route 2025-03-25T15:46:46.072297970Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, DELETE} route 2025-03-25T15:46:46.072301063Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/users, PUT} route 2025-03-25T15:46:46.072304150Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, PUT} route 2025-03-25T15:46:46.072330048Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, DELETE} route 2025-03-25T15:46:46.072332172Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] AppController {/api}: 2025-03-25T15:46:46.072333442Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/.well-known/immich, GET} route 2025-03-25T15:46:46.072349931Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/custom.css, GET} route 2025-03-25T15:46:46.072384564Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] AssetController {/api/assets}: 2025-03-25T15:46:46.072394344Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/memory-lane, GET} route 2025-03-25T15:46:46.072413408Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/random, GET} route 2025-03-25T15:46:46.072417787Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/device/:deviceId, GET} route 2025-03-25T15:46:46.072426852Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/statistics, GET} route 2025-03-25T15:46:46.072434648Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/jobs, POST} route 2025-03-25T15:46:46.072436750Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets, PUT} route 2025-03-25T15:46:46.072438151Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets, DELETE} route 2025-03-25T15:46:46.072463820Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id, GET} route 2025-03-25T15:46:46.072472851Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id, PUT} route 2025-03-25T15:46:46.072475602Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] AssetMediaController {/api/assets}: 2025-03-25T15:46:46.072478001Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets, POST} route 2025-03-25T15:46:46.072480168Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, GET} route 2025-03-25T15:46:46.072482425Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, PUT} route 2025-03-25T15:46:46.072484598Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/thumbnail, GET} route 2025-03-25T15:46:46.072488626Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/video/playback, GET} route 2025-03-25T15:46:46.072491221Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/exist, POST} route 2025-03-25T15:46:46.072494349Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/assets/bulk-upload-check, POST} route 2025-03-25T15:46:46.072496643Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] AuthController {/api/auth}: 2025-03-25T15:46:46.072505192Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/auth/login, POST} route 2025-03-25T15:46:46.072507308Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/auth/admin-sign-up, POST} route 2025-03-25T15:46:46.072508595Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/auth/validateToken, POST} route 2025-03-25T15:46:46.072527685Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/auth/change-password, POST} route 2025-03-25T15:46:46.072529220Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/auth/logout, POST} route 2025-03-25T15:46:46.072530417Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] DownloadController {/api/download}: 2025-03-25T15:46:46.072545639Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/download/info, POST} route 2025-03-25T15:46:46.072550663Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/download/archive, POST} route 2025-03-25T15:46:46.072553112Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] DuplicateController {/api/duplicates}: 2025-03-25T15:46:46.072556267Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/duplicates, GET} route 2025-03-25T15:46:46.072558532Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] FaceController {/api/faces}: 2025-03-25T15:46:46.072573080Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/faces, POST} route 2025-03-25T15:46:46.072575145Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/faces, GET} route 2025-03-25T15:46:46.072576318Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/faces/:id, PUT} route 2025-03-25T15:46:46.072593823Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/faces/:id, DELETE} route 2025-03-25T15:46:46.072595387Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] JobController {/api/jobs}: 2025-03-25T15:46:46.072596587Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/jobs, GET} route 2025-03-25T15:46:46.072597777Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/jobs, POST} route 2025-03-25T15:46:46.072600721Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/jobs/:id, PUT} route 2025-03-25T15:46:46.072614250Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] LibraryController {/api/libraries}: 2025-03-25T15:46:46.072615856Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/libraries, GET} route 2025-03-25T15:46:46.072626315Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/libraries, POST} route 2025-03-25T15:46:46.072630195Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, GET} route 2025-03-25T15:46:46.072633226Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, PUT} route 2025-03-25T15:46:46.072634494Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, DELETE} route 2025-03-25T15:46:46.072659468Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/validate, POST} route 2025-03-25T15:46:46.072661772Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/statistics, GET} route 2025-03-25T15:46:46.072663033Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/scan, POST} route 2025-03-25T15:46:46.072664219Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] MapController {/api/map}: 2025-03-25T15:46:46.072671290Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/map/markers, GET} route 2025-03-25T15:46:46.072673194Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/map/reverse-geocode, GET} route 2025-03-25T15:46:46.072683163Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] MemoryController {/api/memories}: 2025-03-25T15:46:46.072684577Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/memories, GET} route 2025-03-25T15:46:46.072696660Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/memories, POST} route 2025-03-25T15:46:46.072702724Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, GET} route 2025-03-25T15:46:46.072704021Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, PUT} route 2025-03-25T15:46:46.072705285Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, DELETE} route 2025-03-25T15:46:46.072719237Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, PUT} route 2025-03-25T15:46:46.072722188Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, DELETE} route 2025-03-25T15:46:46.072724954Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] NotificationController {/api/notifications}: 2025-03-25T15:46:46.072736411Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/notifications/test-email, POST} route 2025-03-25T15:46:46.072752688Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/notifications/templates/:name, POST} route 2025-03-25T15:46:46.072768200Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] OAuthController {/api/oauth}: 2025-03-25T15:46:46.072769675Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/mobile-redirect, GET} route 2025-03-25T15:46:46.072800264Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/authorize, POST} route 2025-03-25T15:46:46.072806341Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/callback, POST} route 2025-03-25T15:46:46.072809121Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/link, POST} route 2025-03-25T15:46:46.072811407Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/unlink, POST} route 2025-03-25T15:46:46.072813622Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] PartnerController {/api/partners}: 2025-03-25T15:46:46.072819594Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/partners, GET} route 2025-03-25T15:46:46.072822186Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, POST} route 2025-03-25T15:46:46.072824328Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, PUT} route 2025-03-25T15:46:46.072829653Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, DELETE} route 2025-03-25T15:46:46.072832223Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] PersonController {/api/people}: 2025-03-25T15:46:46.072840962Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/people, GET} route 2025-03-25T15:46:46.072850625Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/people, POST} route 2025-03-25T15:46:46.072860382Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/people, PUT} route 2025-03-25T15:46:46.072862743Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id, GET} route 2025-03-25T15:46:46.072873455Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id, PUT} route 2025-03-25T15:46:46.072874897Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/statistics, GET} route 2025-03-25T15:46:46.072876120Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/thumbnail, GET} route 2025-03-25T15:46:46.072878805Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/reassign, PUT} route 2025-03-25T15:46:46.072903802Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/merge, POST} route 2025-03-25T15:46:46.072908774Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] ReportController {/api/reports}: 2025-03-25T15:46:46.072911350Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/reports, GET} route 2025-03-25T15:46:46.072914857Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/reports/checksum, POST} route 2025-03-25T15:46:46.072923914Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/reports/fix, POST} route 2025-03-25T15:46:46.072925774Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] SearchController {/api/search}: 2025-03-25T15:46:46.072940542Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/search/metadata, POST} route 2025-03-25T15:46:46.072942231Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/search/random, POST} route 2025-03-25T15:46:46.072945345Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/search/smart, POST} route 2025-03-25T15:46:46.072946673Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/search/explore, GET} route 2025-03-25T15:46:46.072960971Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/search/person, GET} route 2025-03-25T15:46:46.072965132Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/search/places, GET} route 2025-03-25T15:46:46.072967510Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/search/cities, GET} route 2025-03-25T15:46:46.072970483Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/search/suggestions, GET} route 2025-03-25T15:46:46.072980662Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] ServerController {/api/server}: 2025-03-25T15:46:46.072982509Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/about, GET} route 2025-03-25T15:46:46.072985696Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/storage, GET} route 2025-03-25T15:46:46.073014410Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/ping, GET} route 2025-03-25T15:46:46.073018353Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/version, GET} route 2025-03-25T15:46:46.073020783Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/version-history, GET} route 2025-03-25T15:46:46.073023003Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/features, GET} route 2025-03-25T15:46:46.073033312Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/theme, GET} route 2025-03-25T15:46:46.073040251Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/config, GET} route 2025-03-25T15:46:46.073041949Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/statistics, GET} route 2025-03-25T15:46:46.073050949Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/media-types, GET} route 2025-03-25T15:46:46.073052516Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, PUT} route 2025-03-25T15:46:46.073053767Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, DELETE} route 2025-03-25T15:46:46.073061710Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, GET} route 2025-03-25T15:46:46.073063605Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] SessionController {/api/sessions}: 2025-03-25T15:46:46.073075839Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/sessions, GET} route 2025-03-25T15:46:46.073077798Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/sessions, DELETE} route 2025-03-25T15:46:46.073086348Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/sessions/:id, DELETE} route 2025-03-25T15:46:46.073097224Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] SharedLinkController {/api/shared-links}: 2025-03-25T15:46:46.073099098Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links, GET} route 2025-03-25T15:46:46.073104558Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/me, GET} route 2025-03-25T15:46:46.073106751Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, GET} route 2025-03-25T15:46:46.073117913Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links, POST} route 2025-03-25T15:46:46.073119629Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, PATCH} route 2025-03-25T15:46:46.073122555Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, DELETE} route 2025-03-25T15:46:46.073142316Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, PUT} route 2025-03-25T15:46:46.073150083Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, DELETE} route 2025-03-25T15:46:46.073153689Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] StackController {/api/stacks}: 2025-03-25T15:46:46.073156135Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, GET} route 2025-03-25T15:46:46.073168211Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, POST} route 2025-03-25T15:46:46.073170865Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, DELETE} route 2025-03-25T15:46:46.073173817Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, GET} route 2025-03-25T15:46:46.073176109Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, PUT} route 2025-03-25T15:46:46.073183114Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, DELETE} route 2025-03-25T15:46:46.073185294Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] SyncController {/api/sync}: 2025-03-25T15:46:46.073202300Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/sync/full-sync, POST} route 2025-03-25T15:46:46.073206407Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/sync/delta-sync, POST} route 2025-03-25T15:46:46.073208875Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/sync/stream, POST} route 2025-03-25T15:46:46.073212761Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, GET} route 2025-03-25T15:46:46.073214704Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, POST} route 2025-03-25T15:46:46.073235603Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, DELETE} route 2025-03-25T15:46:46.073239254Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] SystemConfigController {/api/system-config}: 2025-03-25T15:46:46.073244427Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/system-config, GET} route 2025-03-25T15:46:46.073247465Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/system-config/defaults, GET} route 2025-03-25T15:46:46.073254211Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/system-config, PUT} route 2025-03-25T15:46:46.073256388Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/system-config/storage-template-options, GET} route 2025-03-25T15:46:46.073271454Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] SystemMetadataController {/api/system-metadata}: 2025-03-25T15:46:46.073275234Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, GET} route 2025-03-25T15:46:46.073277632Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, POST} route 2025-03-25T15:46:46.073285290Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/reverse-geocoding-state, GET} route 2025-03-25T15:46:46.073308333Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] TagController {/api/tags}: 2025-03-25T15:46:46.073311953Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/tags, POST} route 2025-03-25T15:46:46.073314332Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/tags, GET} route 2025-03-25T15:46:46.073319858Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/tags, PUT} route 2025-03-25T15:46:46.073340170Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/tags/assets, PUT} route 2025-03-25T15:46:46.073344003Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, GET} route 2025-03-25T15:46:46.073346362Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, PUT} route 2025-03-25T15:46:46.073349508Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, DELETE} route 2025-03-25T15:46:46.073354230Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, PUT} route 2025-03-25T15:46:46.073361787Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, DELETE} route 2025-03-25T15:46:46.073363875Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] TimelineController {/api/timeline}: 2025-03-25T15:46:46.073372543Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/timeline/buckets, GET} route 2025-03-25T15:46:46.073377357Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/timeline/bucket, GET} route 2025-03-25T15:46:46.073387285Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] TrashController {/api/trash}: 2025-03-25T15:46:46.073390865Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/trash/empty, POST} route 2025-03-25T15:46:46.073392115Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/trash/restore, POST} route 2025-03-25T15:46:46.073412410Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/trash/restore/assets, POST} route 2025-03-25T15:46:46.073441566Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] UserAdminController {/api/admin/users}: 2025-03-25T15:46:46.073443439Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users, GET} route 2025-03-25T15:46:46.073446217Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users, POST} route 2025-03-25T15:46:46.073459745Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, GET} route 2025-03-25T15:46:46.073461313Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, PUT} route 2025-03-25T15:46:46.073476339Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, DELETE} route 2025-03-25T15:46:46.073477818Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, GET} route 2025-03-25T15:46:46.073480754Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, PUT} route 2025-03-25T15:46:46.073484133Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/restore, POST} route 2025-03-25T15:46:46.073507763Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] UserController {/api/users}: 2025-03-25T15:46:46.073513121Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users, GET} route 2025-03-25T15:46:46.073515704Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users/me, GET} route 2025-03-25T15:46:46.073518624Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users/me, PUT} route 2025-03-25T15:46:46.073526054Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, GET} route 2025-03-25T15:46:46.073528147Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, PUT} route 2025-03-25T15:46:46.073537203Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, GET} route 2025-03-25T15:46:46.073549920Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, PUT} route 2025-03-25T15:46:46.073551870Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, DELETE} route 2025-03-25T15:46:46.073553088Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users/:id, GET} route 2025-03-25T15:46:46.073555886Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, POST} route 2025-03-25T15:46:46.073575381Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, DELETE} route 2025-03-25T15:46:46.073579298Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/users/:id/profile-image, GET} route 2025-03-25T15:46:46.073581773Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RoutesResolver] ViewController {/api/view}: 2025-03-25T15:46:46.073587535Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/view/folder/unique-paths, GET} route 2025-03-25T15:46:46.073591391Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:RouterExplorer] Mapped {/api/view/folder, GET} route 2025-03-25T15:46:46.073593793Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:NestApplication] Nest application successfully started 2025-03-25T15:46:46.073832024Z [Nest] 2639 - 03/25/2025, 3:46:46 PM LOG [Api:Bootstrap] Immich Server is listening on http://[::1]:8080 [v1.130.0] [production] 2025-03-25T15:46:49.602131268Z Connection to localhost (::1) 8080 port [tcp/http-alt] succeeded! 2025-03-25T15:46:49.602623660Z s6-rc: info: service svc-server successfully started 2025-03-25T15:46:49.602835557Z s6-rc: info: service svc-machine-learning: starting 2025-03-25T15:46:49.604537091Z s6-rc: info: service svc-machine-learning successfully started 2025-03-25T15:46:49.604716090Z s6-rc: info: service svc-microservices: starting 2025-03-25T15:46:49.606073345Z s6-rc: info: service svc-microservices successfully started 2025-03-25T15:46:49.606118059Z s6-rc: info: service legacy-services: starting 2025-03-25T15:46:49.609600459Z Detected CPU Cores: 8 2025-03-25T15:46:49.610425663Z s6-rc: info: service legacy-services successfully started 2025-03-25T15:46:49.610464960Z s6-rc: info: service ci-service-check: starting 2025-03-25T15:46:49.611617022Z [ig-init] done. 2025-03-25T15:46:49.611745444Z s6-rc: info: service ci-service-check successfully started 2025-03-25T15:46:50.305075292Z [03/25/25 15:46:50] INFO Starting gunicorn 23.0.0 2025-03-25T15:46:50.305733336Z [03/25/25 15:46:50] INFO Listening at: http://0.0.0.0:3003 (2671) 2025-03-25T15:46:50.306152730Z [03/25/25 15:46:50] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:46:50.310359069Z [03/25/25 15:46:50] INFO Booting worker with pid: 2706 2025-03-25T15:46:50.449012107Z Starting microservices worker 2025-03-25T15:46:50.653949604Z [03/25/25 15:46:50] ERROR Exception in worker process 2025-03-25T15:46:50.653976350Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:46:50.653985739Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:50.653988079Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:46:50.653989485Z │ │ 2025-03-25T15:46:50.653990684Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:46:50.653992513Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:46:50.653993973Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:46:50.653995372Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:46:50.653996658Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:46:50.653997942Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:46:50.653999265Z │ 611 │ │ │ raise │ 2025-03-25T15:46:50.654000553Z │ │ 2025-03-25T15:46:50.654001712Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:46:50.654003377Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:46:50.654004705Z │ │ 2025-03-25T15:46:50.654005865Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:46:50.654008489Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:46:50.654009766Z │ 134 │ │ │ 2025-03-25T15:46:50.654010969Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:46:50.654012313Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:46:50.654013602Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:46:50.654014833Z │ 138 │ 2025-03-25T15:46:50.654017466Z │ │ 2025-03-25T15:46:50.654018625Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:46:50.654019787Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:46:50.654021069Z │ │ 2025-03-25T15:46:50.654022246Z │ 144 │ │ 2025-03-25T15:46:50.654023460Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:46:50.654025045Z │ 146 │ │ try: │ 2025-03-25T15:46:50.654027139Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:46:50.654029296Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:46:50.654032966Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:46:50.654035185Z │ 150 │ │ │ │ raise │ 2025-03-25T15:46:50.654037099Z │ │ 2025-03-25T15:46:50.654038256Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:50.654039447Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:46:50.654040744Z │ │ 2025-03-25T15:46:50.654041863Z │ 63 │ │ 2025-03-25T15:46:50.654043085Z │ 64 │ def wsgi(self): │ 2025-03-25T15:46:50.654044418Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:46:50.654045767Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:46:50.654047329Z │ 67 │ │ return self.callable │ 2025-03-25T15:46:50.654048640Z │ 68 │ │ 2025-03-25T15:46:50.654049875Z │ 69 │ def run(self): │ 2025-03-25T15:46:50.654051182Z │ │ 2025-03-25T15:46:50.654052325Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:50.654053497Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:46:50.654055940Z │ │ 2025-03-25T15:46:50.654057128Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:46:50.654058499Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:46:50.654059798Z │ 56 │ │ else: │ 2025-03-25T15:46:50.654061043Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:46:50.654062411Z │ 58 │ 2025-03-25T15:46:50.654063598Z │ 59 │ 2025-03-25T15:46:50.654064760Z │ 60 def run(prog=None): │ 2025-03-25T15:46:50.654066259Z │ │ 2025-03-25T15:46:50.654067565Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:50.654068768Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:46:50.654070037Z │ │ 2025-03-25T15:46:50.654071168Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:46:50.654072486Z │ 45 │ │ 2025-03-25T15:46:50.654073684Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:46:50.654076012Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:46:50.654077417Z │ 48 │ │ 2025-03-25T15:46:50.654078623Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:46:50.654079908Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:46:50.654081322Z │ │ 2025-03-25T15:46:50.654082452Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:46:50.654083638Z │ til.py:370 in import_app │ 2025-03-25T15:46:50.654084868Z │ │ 2025-03-25T15:46:50.654086115Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:46:50.654087469Z │ 368 │ │ 2025-03-25T15:46:50.654088651Z │ 369 │ try: │ 2025-03-25T15:46:50.654089878Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:46:50.654091134Z │ 371 │ except ImportError: │ 2025-03-25T15:46:50.654092443Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:46:50.654094904Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:46:50.654096235Z │ │ 2025-03-25T15:46:50.654097340Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:46:50.654098633Z │ in import_module │ 2025-03-25T15:46:50.654100094Z │ │ 2025-03-25T15:46:50.654102061Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:46:50.654104204Z │ 124 │ │ │ │ break │ 2025-03-25T15:46:50.654106167Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:46:50.654108128Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:46:50.654110466Z │ 127 │ 2025-03-25T15:46:50.654111974Z │ 128 │ 2025-03-25T15:46:50.654113140Z │ 129 _RELOADING = {} │ 2025-03-25T15:46:50.654114296Z │ in _gcd_import:1204 │ 2025-03-25T15:46:50.654115554Z │ in _find_and_load:1176 │ 2025-03-25T15:46:50.654116783Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:46:50.654117980Z │ in _load_unlocked:690 │ 2025-03-25T15:46:50.654120486Z │ in exec_module:940 │ 2025-03-25T15:46:50.654121673Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:46:50.654123226Z │ │ 2025-03-25T15:46:50.654124430Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:46:50.654126541Z │ <module> │ 2025-03-25T15:46:50.654127812Z │ │ 2025-03-25T15:46:50.654128966Z │ 13 import orjson │ 2025-03-25T15:46:50.654130383Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:46:50.654132005Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:46:50.654133432Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:46:50.654134928Z │ 17 from PIL.Image import Image │ 2025-03-25T15:46:50.654136262Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:46:50.654137550Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:46:50.654138966Z │ │ 2025-03-25T15:46:50.654140103Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:50.654142541Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:46:50.654143883Z │ │ 2025-03-25T15:46:50.654145008Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:46:50.654146432Z │ 55 │ 2025-03-25T15:46:50.654148023Z │ 56 if import_capi_exception: │ 2025-03-25T15:46:50.654149255Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:46:50.654150616Z │ 58 │ 2025-03-25T15:46:50.654151972Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:46:50.654153367Z │ F401 │ 2025-03-25T15:46:50.654154569Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:46:50.654155891Z │ │ 2025-03-25T15:46:50.654157028Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:50.654158224Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:46:50.654159490Z │ │ 2025-03-25T15:46:50.654160624Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:46:50.654162902Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:46:50.654164140Z │ 22 try: │ 2025-03-25T15:46:50.654165342Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:50.654166770Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:50.654168198Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:50.654169651Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:50.654171007Z │ │ 2025-03-25T15:46:50.654172126Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:50.654173286Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:46:50.654175335Z │ │ 2025-03-25T15:46:50.654177175Z │ 29 │ 2025-03-25T15:46:50.654179064Z │ 30 │ 2025-03-25T15:46:50.654180880Z │ 31 │ 2025-03-25T15:46:50.654182912Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:46:50.654186138Z │ 33 │ 2025-03-25T15:46:50.654187303Z │ 34 │ 2025-03-25T15:46:50.654188491Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:46:50.654189765Z ImportError: 2025-03-25T15:46:50.654190917Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:46:50.654192042Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:46:50.654193199Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:46:50.654194488Z shared object requires: Invalid argument 2025-03-25T15:46:50.654488471Z [03/25/25 15:46:50] INFO Worker exiting (pid: 2706) 2025-03-25T15:46:50.732852038Z [03/25/25 15:46:50] ERROR Worker (pid:2706) exited with code 3 2025-03-25T15:46:50.734060453Z [03/25/25 15:46:50] ERROR Shutting down: Master 2025-03-25T15:46:50.734909305Z [03/25/25 15:46:50] ERROR Reason: Worker failed to boot. 2025-03-25T15:46:51.469737073Z [Nest] 2676 - 03/25/2025, 3:46:51 PM LOG [Microservices:EventRepository] Initialized websocket server 2025-03-25T15:46:51.540548974Z [Nest] 2676 - 03/25/2025, 3:46:51 PM LOG [Microservices:DatabaseRepository] Running migrations, this may take a while 2025-03-25T15:46:51.641288035Z [Nest] 2676 - 03/25/2025, 3:46:51 PM LOG [Microservices:MetadataService] Bootstrapping metadata service 2025-03-25T15:46:51.641767033Z [Nest] 2676 - 03/25/2025, 3:46:51 PM LOG [Microservices:MetadataService] Initializing metadata service 2025-03-25T15:46:51.642367033Z [Nest] 2676 - 03/25/2025, 3:46:51 PM LOG [Microservices:MapRepository] Initializing metadata repository 2025-03-25T15:46:52.366917207Z [03/25/25 15:46:52] INFO Starting gunicorn 23.0.0 2025-03-25T15:46:52.367663836Z [03/25/25 15:46:52] INFO Listening at: http://0.0.0.0:3003 (2721) 2025-03-25T15:46:52.368107810Z [03/25/25 15:46:52] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:46:52.385608560Z [03/25/25 15:46:52] INFO Booting worker with pid: 2732 2025-03-25T15:46:52.461035526Z [Nest] 2676 - 03/25/2025, 3:46:52 PM LOG [Microservices:MapRepository] 10000 geodata records imported 2025-03-25T15:46:52.598572465Z [Nest] 2676 - 03/25/2025, 3:46:52 PM LOG [Microservices:MapRepository] 20000 geodata records imported 2025-03-25T15:46:52.598616791Z [Nest] 2676 - 03/25/2025, 3:46:52 PM LOG [Microservices:MapRepository] 30000 geodata records imported 2025-03-25T15:46:52.598736559Z [Nest] 2676 - 03/25/2025, 3:46:52 PM LOG [Microservices:MapRepository] 40000 geodata records imported 2025-03-25T15:46:52.670381896Z [03/25/25 15:46:52] ERROR Exception in worker process 2025-03-25T15:46:52.670400710Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:46:52.670403311Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:52.670404706Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:46:52.670406113Z │ │ 2025-03-25T15:46:52.670407339Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:46:52.670410240Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:46:52.670411890Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:46:52.670418345Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:46:52.670419692Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:46:52.670420965Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:46:52.670422298Z │ 611 │ │ │ raise │ 2025-03-25T15:46:52.670423564Z │ │ 2025-03-25T15:46:52.670424758Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:46:52.670426517Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:46:52.670427930Z │ │ 2025-03-25T15:46:52.670429105Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:46:52.670430335Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:46:52.670431808Z │ 134 │ │ │ 2025-03-25T15:46:52.670433060Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:46:52.670434388Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:46:52.670435719Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:46:52.670436944Z │ 138 │ 2025-03-25T15:46:52.670438685Z │ │ 2025-03-25T15:46:52.670440860Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:46:52.670442106Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:46:52.670443381Z │ │ 2025-03-25T15:46:52.670444535Z │ 144 │ │ 2025-03-25T15:46:52.670445753Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:46:52.670447231Z │ 146 │ │ try: │ 2025-03-25T15:46:52.670448668Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:46:52.670449978Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:46:52.670451356Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:46:52.670452639Z │ 150 │ │ │ │ raise │ 2025-03-25T15:46:52.670453906Z │ │ 2025-03-25T15:46:52.670455073Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:52.670456232Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:46:52.670457508Z │ │ 2025-03-25T15:46:52.670458649Z │ 63 │ │ 2025-03-25T15:46:52.670460854Z │ 64 │ def wsgi(self): │ 2025-03-25T15:46:52.670462201Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:46:52.670463557Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:46:52.670465703Z │ 67 │ │ return self.callable │ 2025-03-25T15:46:52.670466999Z │ 68 │ │ 2025-03-25T15:46:52.670468240Z │ 69 │ def run(self): │ 2025-03-25T15:46:52.670469568Z │ │ 2025-03-25T15:46:52.670470701Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:52.670471868Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:46:52.670473163Z │ │ 2025-03-25T15:46:52.670474324Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:46:52.670475670Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:46:52.670476938Z │ 56 │ │ else: │ 2025-03-25T15:46:52.670478173Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:46:52.670480629Z │ 58 │ 2025-03-25T15:46:52.670481860Z │ 59 │ 2025-03-25T15:46:52.670483049Z │ 60 def run(prog=None): │ 2025-03-25T15:46:52.670484359Z │ │ 2025-03-25T15:46:52.670485606Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:52.670486826Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:46:52.670488098Z │ │ 2025-03-25T15:46:52.670489230Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:46:52.670490570Z │ 45 │ │ 2025-03-25T15:46:52.670491753Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:46:52.670493145Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:46:52.670494557Z │ 48 │ │ 2025-03-25T15:46:52.670495736Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:46:52.670497058Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:46:52.670498480Z │ │ 2025-03-25T15:46:52.670499639Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:46:52.670501814Z │ til.py:370 in import_app │ 2025-03-25T15:46:52.670503140Z │ │ 2025-03-25T15:46:52.670504400Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:46:52.670505718Z │ 368 │ │ 2025-03-25T15:46:52.670506929Z │ 369 │ try: │ 2025-03-25T15:46:52.670508154Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:46:52.670509378Z │ 371 │ except ImportError: │ 2025-03-25T15:46:52.670510678Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:46:52.670512105Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:46:52.670513422Z │ │ 2025-03-25T15:46:52.670514586Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:46:52.670515942Z │ in import_module │ 2025-03-25T15:46:52.670517299Z │ │ 2025-03-25T15:46:52.670518421Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:46:52.670519793Z │ 124 │ │ │ │ break │ 2025-03-25T15:46:52.670521892Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:46:52.670523164Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:46:52.670524570Z │ 127 │ 2025-03-25T15:46:52.670525786Z │ 128 │ 2025-03-25T15:46:52.670526964Z │ 129 _RELOADING = {} │ 2025-03-25T15:46:52.670528117Z │ in _gcd_import:1204 │ 2025-03-25T15:46:52.670529329Z │ in _find_and_load:1176 │ 2025-03-25T15:46:52.670530569Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:46:52.670531787Z │ in _load_unlocked:690 │ 2025-03-25T15:46:52.670533002Z │ in exec_module:940 │ 2025-03-25T15:46:52.670534184Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:46:52.670535471Z │ │ 2025-03-25T15:46:52.670536585Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:46:52.670537850Z │ <module> │ 2025-03-25T15:46:52.670539135Z │ │ 2025-03-25T15:46:52.670540288Z │ 13 import orjson │ 2025-03-25T15:46:52.670542474Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:46:52.670543884Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:46:52.670545227Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:46:52.670546784Z │ 17 from PIL.Image import Image │ 2025-03-25T15:46:52.670548130Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:46:52.670549403Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:46:52.670550803Z │ │ 2025-03-25T15:46:52.670551947Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:52.670553125Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:46:52.670554474Z │ │ 2025-03-25T15:46:52.670555600Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:46:52.670557019Z │ 55 │ 2025-03-25T15:46:52.670558195Z │ 56 if import_capi_exception: │ 2025-03-25T15:46:52.670559419Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:46:52.670560786Z │ 58 │ 2025-03-25T15:46:52.670562959Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:46:52.670564341Z │ F401 │ 2025-03-25T15:46:52.670565540Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:46:52.670566904Z │ │ 2025-03-25T15:46:52.670568069Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:52.670570073Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:46:52.670571366Z │ │ 2025-03-25T15:46:52.670572512Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:46:52.670573774Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:46:52.670574970Z │ 22 try: │ 2025-03-25T15:46:52.670576187Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:52.670578014Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:52.670579463Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:52.670580931Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:52.670584435Z │ │ 2025-03-25T15:46:52.670585586Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:52.670586769Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:46:52.670588115Z │ │ 2025-03-25T15:46:52.670589284Z │ 29 │ 2025-03-25T15:46:52.670590464Z │ 30 │ 2025-03-25T15:46:52.670591639Z │ 31 │ 2025-03-25T15:46:52.670592810Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:46:52.670594305Z │ 33 │ 2025-03-25T15:46:52.670595472Z │ 34 │ 2025-03-25T15:46:52.670596679Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:46:52.670597927Z ImportError: 2025-03-25T15:46:52.670599098Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:46:52.670600232Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:46:52.670601426Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:46:52.670602710Z shared object requires: Invalid argument 2025-03-25T15:46:52.670950095Z [03/25/25 15:46:52] INFO Worker exiting (pid: 2732) 2025-03-25T15:46:52.723901021Z [03/25/25 15:46:52] ERROR Worker (pid:2732) exited with code 3 2025-03-25T15:46:52.724812543Z [03/25/25 15:46:52] ERROR Shutting down: Master 2025-03-25T15:46:52.725499593Z [03/25/25 15:46:52] ERROR Reason: Worker failed to boot. 2025-03-25T15:46:53.011642702Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 50000 geodata records imported 2025-03-25T15:46:53.019466753Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 60000 geodata records imported 2025-03-25T15:46:53.019519146Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 70000 geodata records imported 2025-03-25T15:46:53.051570523Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 80000 geodata records imported 2025-03-25T15:46:53.097903280Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 90000 geodata records imported 2025-03-25T15:46:53.432114776Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 100000 geodata records imported 2025-03-25T15:46:53.445514211Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 110000 geodata records imported 2025-03-25T15:46:53.449966976Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 120000 geodata records imported 2025-03-25T15:46:53.463818683Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 130000 geodata records imported 2025-03-25T15:46:53.854168286Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 140000 geodata records imported 2025-03-25T15:46:53.869120747Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 150000 geodata records imported 2025-03-25T15:46:53.869177493Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 160000 geodata records imported 2025-03-25T15:46:53.873773907Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 170000 geodata records imported 2025-03-25T15:46:53.917906211Z [Nest] 2676 - 03/25/2025, 3:46:53 PM LOG [Microservices:MapRepository] 180000 geodata records imported 2025-03-25T15:46:54.156024710Z [Nest] 2676 - 03/25/2025, 3:46:54 PM LOG [Microservices:MapRepository] 190000 geodata records imported 2025-03-25T15:46:54.174680959Z [Nest] 2676 - 03/25/2025, 3:46:54 PM LOG [Microservices:MapRepository] 200000 geodata records imported 2025-03-25T15:46:54.209596265Z [Nest] 2676 - 03/25/2025, 3:46:54 PM LOG [Microservices:MapRepository] 210000 geodata records imported 2025-03-25T15:46:54.348874190Z [03/25/25 15:46:54] INFO Starting gunicorn 23.0.0 2025-03-25T15:46:54.349468973Z [03/25/25 15:46:54] INFO Listening at: http://0.0.0.0:3003 (2735) 2025-03-25T15:46:54.349883671Z [03/25/25 15:46:54] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:46:54.352897089Z [03/25/25 15:46:54] INFO Booting worker with pid: 2739 2025-03-25T15:46:54.632582157Z [03/25/25 15:46:54] ERROR Exception in worker process 2025-03-25T15:46:54.632608889Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:46:54.632613256Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:54.632616093Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:46:54.632618682Z │ │ 2025-03-25T15:46:54.632620945Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:46:54.632623552Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:46:54.632632331Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:46:54.632635251Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:46:54.632637673Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:46:54.632639980Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:46:54.632642458Z │ 611 │ │ │ raise │ 2025-03-25T15:46:54.632644710Z │ │ 2025-03-25T15:46:54.632646767Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:46:54.632650178Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:46:54.632652697Z │ │ 2025-03-25T15:46:54.632654763Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:46:54.632657002Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:46:54.632659214Z │ 134 │ │ │ 2025-03-25T15:46:54.632661312Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:46:54.632663611Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:46:54.632665822Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:46:54.632670292Z │ 138 │ 2025-03-25T15:46:54.632672765Z │ │ 2025-03-25T15:46:54.632674886Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:46:54.632677028Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:46:54.632679316Z │ │ 2025-03-25T15:46:54.632681365Z │ 144 │ │ 2025-03-25T15:46:54.632683529Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:46:54.632686245Z │ 146 │ │ try: │ 2025-03-25T15:46:54.632688576Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:46:54.632690908Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:46:54.632693193Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:46:54.632698537Z │ 150 │ │ │ │ raise │ 2025-03-25T15:46:54.632700849Z │ │ 2025-03-25T15:46:54.632702904Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:54.632704953Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:46:54.632707258Z │ │ 2025-03-25T15:46:54.632711177Z │ 63 │ │ 2025-03-25T15:46:54.632713560Z │ 64 │ def wsgi(self): │ 2025-03-25T15:46:54.632715948Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:46:54.632718355Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:46:54.632721123Z │ 67 │ │ return self.callable │ 2025-03-25T15:46:54.632723520Z │ 68 │ │ 2025-03-25T15:46:54.632725749Z │ 69 │ def run(self): │ 2025-03-25T15:46:54.632728057Z │ │ 2025-03-25T15:46:54.632730201Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:54.632732239Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:46:54.632734497Z │ │ 2025-03-25T15:46:54.632736479Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:46:54.632738867Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:46:54.632741128Z │ 56 │ │ else: │ 2025-03-25T15:46:54.632743272Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:46:54.632747308Z │ 58 │ 2025-03-25T15:46:54.632749729Z │ 59 │ 2025-03-25T15:46:54.632751936Z │ 60 def run(prog=None): │ 2025-03-25T15:46:54.632755033Z │ │ 2025-03-25T15:46:54.632757426Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:54.632759678Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:46:54.632762038Z │ │ 2025-03-25T15:46:54.632764139Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:46:54.632766558Z │ 45 │ │ 2025-03-25T15:46:54.632768810Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:46:54.632771216Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:46:54.632774341Z │ 48 │ │ 2025-03-25T15:46:54.632776563Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:46:54.632778835Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:46:54.632783025Z │ │ 2025-03-25T15:46:54.632785275Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:46:54.632787444Z │ til.py:370 in import_app │ 2025-03-25T15:46:54.632789676Z │ │ 2025-03-25T15:46:54.632791948Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:46:54.632794297Z │ 368 │ │ 2025-03-25T15:46:54.632796418Z │ 369 │ try: │ 2025-03-25T15:46:54.632798581Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:46:54.632806657Z │ 371 │ except ImportError: │ 2025-03-25T15:46:54.632809389Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:46:54.632811951Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:46:54.632814289Z │ │ 2025-03-25T15:46:54.632816259Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:46:54.632818436Z │ in import_module │ 2025-03-25T15:46:54.632820504Z │ │ 2025-03-25T15:46:54.632822541Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:46:54.632826938Z │ 124 │ │ │ │ break │ 2025-03-25T15:46:54.632829364Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:46:54.632831558Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:46:54.632834155Z │ 127 │ 2025-03-25T15:46:54.632836344Z │ 128 │ 2025-03-25T15:46:54.632838429Z │ 129 _RELOADING = {} │ 2025-03-25T15:46:54.632840412Z │ in _gcd_import:1204 │ 2025-03-25T15:46:54.632842557Z │ in _find_and_load:1176 │ 2025-03-25T15:46:54.632844710Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:46:54.632846821Z │ in _load_unlocked:690 │ 2025-03-25T15:46:54.632848992Z │ in exec_module:940 │ 2025-03-25T15:46:54.632851180Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:46:54.632853362Z │ │ 2025-03-25T15:46:54.632855354Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:46:54.632857662Z │ <module> │ 2025-03-25T15:46:54.632859879Z │ │ 2025-03-25T15:46:54.632863715Z │ 13 import orjson │ 2025-03-25T15:46:54.632866162Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:46:54.632868897Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:46:54.632871458Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:46:54.632874072Z │ 17 from PIL.Image import Image │ 2025-03-25T15:46:54.632876482Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:46:54.632878737Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:46:54.632881077Z │ │ 2025-03-25T15:46:54.632883139Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:54.632885184Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:46:54.632887515Z │ │ 2025-03-25T15:46:54.632889509Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:46:54.632891911Z │ 55 │ 2025-03-25T15:46:54.632894008Z │ 56 if import_capi_exception: │ 2025-03-25T15:46:54.632897727Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:46:54.632900204Z │ 58 │ 2025-03-25T15:46:54.632902559Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:46:54.632905039Z │ F401 │ 2025-03-25T15:46:54.632907203Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:46:54.632909543Z │ │ 2025-03-25T15:46:54.632911533Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:54.632913579Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:46:54.632915890Z │ │ 2025-03-25T15:46:54.632917938Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:46:54.632920114Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:46:54.632922254Z │ 22 try: │ 2025-03-25T15:46:54.632924412Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:54.632926994Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:54.632929544Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:54.632934160Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:54.632936932Z │ │ 2025-03-25T15:46:54.632938994Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:54.632941134Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:46:54.632943458Z │ │ 2025-03-25T15:46:54.632945489Z │ 29 │ 2025-03-25T15:46:54.632947553Z │ 30 │ 2025-03-25T15:46:54.632949612Z │ 31 │ 2025-03-25T15:46:54.632951632Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:46:54.632954164Z │ 33 │ 2025-03-25T15:46:54.632956213Z │ 34 │ 2025-03-25T15:46:54.632958265Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:46:54.632960487Z ImportError: 2025-03-25T15:46:54.632962468Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:46:54.632964453Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:46:54.632966515Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:46:54.632970455Z shared object requires: Invalid argument 2025-03-25T15:46:54.633207377Z [03/25/25 15:46:54] INFO Worker exiting (pid: 2739) 2025-03-25T15:46:54.685537673Z [03/25/25 15:46:54] ERROR Worker (pid:2739) exited with code 3 2025-03-25T15:46:54.686393617Z [03/25/25 15:46:54] ERROR Shutting down: Master 2025-03-25T15:46:54.687061833Z [03/25/25 15:46:54] ERROR Reason: Worker failed to boot. 2025-03-25T15:46:56.285374198Z [03/25/25 15:46:56] INFO Starting gunicorn 23.0.0 2025-03-25T15:46:56.285964649Z [03/25/25 15:46:56] INFO Listening at: http://0.0.0.0:3003 (2741) 2025-03-25T15:46:56.286364615Z [03/25/25 15:46:56] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:46:56.289208571Z [03/25/25 15:46:56] INFO Booting worker with pid: 2744 2025-03-25T15:46:56.561158316Z [03/25/25 15:46:56] ERROR Exception in worker process 2025-03-25T15:46:56.561172882Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:46:56.561175514Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:56.561177100Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:46:56.561178553Z │ │ 2025-03-25T15:46:56.561179737Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:46:56.561181252Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:46:56.561186949Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:46:56.561188341Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:46:56.561189702Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:46:56.561193336Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:46:56.561194674Z │ 611 │ │ │ raise │ 2025-03-25T15:46:56.561195959Z │ │ 2025-03-25T15:46:56.561197106Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:46:56.561198967Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:46:56.561200322Z │ │ 2025-03-25T15:46:56.561201527Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:46:56.561202810Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:46:56.561204069Z │ 134 │ │ │ 2025-03-25T15:46:56.561205270Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:46:56.561206870Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:46:56.561208156Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:46:56.561212840Z │ 138 │ 2025-03-25T15:46:56.561214082Z │ │ 2025-03-25T15:46:56.561215243Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:46:56.561216458Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:46:56.561217732Z │ │ 2025-03-25T15:46:56.561218902Z │ 144 │ │ 2025-03-25T15:46:56.561220201Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:46:56.561221720Z │ 146 │ │ try: │ 2025-03-25T15:46:56.561222985Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:46:56.561224303Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:46:56.561225645Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:46:56.561227053Z │ 150 │ │ │ │ raise │ 2025-03-25T15:46:56.561228359Z │ │ 2025-03-25T15:46:56.561229514Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:56.561230704Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:46:56.561231999Z │ │ 2025-03-25T15:46:56.561234008Z │ 63 │ │ 2025-03-25T15:46:56.561235260Z │ 64 │ def wsgi(self): │ 2025-03-25T15:46:56.561236596Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:46:56.561237979Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:46:56.561239537Z │ 67 │ │ return self.callable │ 2025-03-25T15:46:56.561240824Z │ 68 │ │ 2025-03-25T15:46:56.561242086Z │ 69 │ def run(self): │ 2025-03-25T15:46:56.561243409Z │ │ 2025-03-25T15:46:56.561244534Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:56.561245717Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:46:56.561247067Z │ │ 2025-03-25T15:46:56.561248256Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:46:56.561249624Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:46:56.561250921Z │ 56 │ │ else: │ 2025-03-25T15:46:56.561253116Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:46:56.561254528Z │ 58 │ 2025-03-25T15:46:56.561255731Z │ 59 │ 2025-03-25T15:46:56.561256903Z │ 60 def run(prog=None): │ 2025-03-25T15:46:56.561258232Z │ │ 2025-03-25T15:46:56.561259539Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:56.561260738Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:46:56.561262018Z │ │ 2025-03-25T15:46:56.561263157Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:46:56.561264488Z │ 45 │ │ 2025-03-25T15:46:56.561265672Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:46:56.561267012Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:46:56.561268693Z │ 48 │ │ 2025-03-25T15:46:56.561269935Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:46:56.561271263Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:46:56.561273496Z │ │ 2025-03-25T15:46:56.561274692Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:46:56.561275901Z │ til.py:370 in import_app │ 2025-03-25T15:46:56.561277174Z │ │ 2025-03-25T15:46:56.561278429Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:46:56.561279731Z │ 368 │ │ 2025-03-25T15:46:56.561280950Z │ 369 │ try: │ 2025-03-25T15:46:56.561282235Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:46:56.561283490Z │ 371 │ except ImportError: │ 2025-03-25T15:46:56.561284802Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:46:56.561286213Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:46:56.561287561Z │ │ 2025-03-25T15:46:56.561288691Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:46:56.561290026Z │ in import_module │ 2025-03-25T15:46:56.561291255Z │ │ 2025-03-25T15:46:56.561292410Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:46:56.561294673Z │ 124 │ │ │ │ break │ 2025-03-25T15:46:56.561295952Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:46:56.561297254Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:46:56.561298620Z │ 127 │ 2025-03-25T15:46:56.561299855Z │ 128 │ 2025-03-25T15:46:56.561301024Z │ 129 _RELOADING = {} │ 2025-03-25T15:46:56.561302532Z │ in _gcd_import:1204 │ 2025-03-25T15:46:56.561303773Z │ in _find_and_load:1176 │ 2025-03-25T15:46:56.561305038Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:46:56.561306228Z │ in _load_unlocked:690 │ 2025-03-25T15:46:56.561307440Z │ in exec_module:940 │ 2025-03-25T15:46:56.561308659Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:46:56.561309954Z │ │ 2025-03-25T15:46:56.561311111Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:46:56.561312414Z │ <module> │ 2025-03-25T15:46:56.561313691Z │ │ 2025-03-25T15:46:56.561315728Z │ 13 import orjson │ 2025-03-25T15:46:56.561317010Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:46:56.561318496Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:46:56.561319895Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:46:56.561321464Z │ 17 from PIL.Image import Image │ 2025-03-25T15:46:56.561322804Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:46:56.561324094Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:46:56.561325517Z │ │ 2025-03-25T15:46:56.561326642Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:56.561327830Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:46:56.561329157Z │ │ 2025-03-25T15:46:56.561330300Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:46:56.561331704Z │ 55 │ 2025-03-25T15:46:56.561332888Z │ 56 if import_capi_exception: │ 2025-03-25T15:46:56.561335337Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:46:56.561336677Z │ 58 │ 2025-03-25T15:46:56.561337953Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:46:56.561339408Z │ F401 │ 2025-03-25T15:46:56.561340600Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:46:56.561341914Z │ │ 2025-03-25T15:46:56.561343105Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:56.561344285Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:46:56.561345566Z │ │ 2025-03-25T15:46:56.561346752Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:46:56.561347985Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:46:56.561349186Z │ 22 try: │ 2025-03-25T15:46:56.561350418Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:56.561351862Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:56.561353268Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:56.561355643Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:56.561357053Z │ │ 2025-03-25T15:46:56.561358215Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:56.561359388Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:46:56.561360698Z │ │ 2025-03-25T15:46:56.561361885Z │ 29 │ 2025-03-25T15:46:56.561363048Z │ 30 │ 2025-03-25T15:46:56.561364207Z │ 31 │ 2025-03-25T15:46:56.561365395Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:46:56.561366906Z │ 33 │ 2025-03-25T15:46:56.561368066Z │ 34 │ 2025-03-25T15:46:56.561369257Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:46:56.561370511Z ImportError: 2025-03-25T15:46:56.561371666Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:46:56.561372782Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:46:56.561374922Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:46:56.561376213Z shared object requires: Invalid argument 2025-03-25T15:46:56.561697756Z [03/25/25 15:46:56] INFO Worker exiting (pid: 2744) 2025-03-25T15:46:56.611314224Z [03/25/25 15:46:56] ERROR Worker (pid:2744) exited with code 3 2025-03-25T15:46:56.611838971Z [03/25/25 15:46:56] ERROR Shutting down: Master 2025-03-25T15:46:56.612195308Z [03/25/25 15:46:56] ERROR Reason: Worker failed to boot. 2025-03-25T15:46:57.740173218Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:MapRepository] Geodata import completed 2025-03-25T15:46:57.741101642Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:MetadataService] Initialized local reverse geocoder 2025-03-25T15:46:57.761782810Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:ServerService] Feature Flags: { 2025-03-25T15:46:57.761794404Z "smartSearch": true, 2025-03-25T15:46:57.761795904Z "facialRecognition": true, 2025-03-25T15:46:57.761797101Z "duplicateDetection": true, 2025-03-25T15:46:57.761798119Z "map": true, 2025-03-25T15:46:57.761799140Z "reverseGeocoding": true, 2025-03-25T15:46:57.761800171Z "importFaces": false, 2025-03-25T15:46:57.761801177Z "sidecar": true, 2025-03-25T15:46:57.761802182Z "search": true, 2025-03-25T15:46:57.761806243Z "trash": true, 2025-03-25T15:46:57.761807300Z "oauth": false, 2025-03-25T15:46:57.761808330Z "oauthAutoLaunch": false, 2025-03-25T15:46:57.761809390Z "passwordLogin": true, 2025-03-25T15:46:57.761810455Z "configFile": false, 2025-03-25T15:46:57.761811452Z "email": false 2025-03-25T15:46:57.761812621Z } 2025-03-25T15:46:57.763767885Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:StorageService] Verifying system mount folder checks, current state: {"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}} 2025-03-25T15:46:57.765246538Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:StorageService] Successfully verified system mount folder checks 2025-03-25T15:46:57.775307579Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:SystemConfigService] LogLevel=log (set via system config) 2025-03-25T15:46:57.777170913Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:NestFactory] Starting Nest application... 2025-03-25T15:46:57.777179781Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized 2025-03-25T15:46:57.777181465Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] ClsModule dependencies initialized 2025-03-25T15:46:57.777182750Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] ClsCommonModule dependencies initialized 2025-03-25T15:46:57.777184797Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] OpenTelemetryModule dependencies initialized 2025-03-25T15:46:57.777186117Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] KyselyModule dependencies initialized 2025-03-25T15:46:57.777187335Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] KyselyCoreModule dependencies initialized 2025-03-25T15:46:57.777227508Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] DiscoveryModule dependencies initialized 2025-03-25T15:46:57.777240993Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] OpenTelemetryCoreModule dependencies initialized 2025-03-25T15:46:57.777244594Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] ClsRootModule dependencies initialized 2025-03-25T15:46:57.777247189Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized 2025-03-25T15:46:57.777249710Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized 2025-03-25T15:46:57.777252023Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:InstanceLoader] MicroservicesModule dependencies initialized 2025-03-25T15:46:57.777254245Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:NestApplication] Nest application successfully started 2025-03-25T15:46:57.777256460Z [Nest] 2676 - 03/25/2025, 3:46:57 PM LOG [Microservices:Bootstrap] Immich Microservices is running [v1.130.0] [production] 2025-03-25T15:46:58.174962135Z [03/25/25 15:46:58] INFO Starting gunicorn 23.0.0 2025-03-25T15:46:58.175563899Z [03/25/25 15:46:58] INFO Listening at: http://0.0.0.0:3003 (2746) 2025-03-25T15:46:58.175928486Z [03/25/25 15:46:58] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:46:58.179828722Z [03/25/25 15:46:58] INFO Booting worker with pid: 2750 2025-03-25T15:46:58.459207197Z [03/25/25 15:46:58] ERROR Exception in worker process 2025-03-25T15:46:58.459221180Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:46:58.459223736Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:58.459225370Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:46:58.459226793Z │ │ 2025-03-25T15:46:58.459228046Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:46:58.459229546Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:46:58.459230965Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:46:58.459232290Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:46:58.459233643Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:46:58.459234923Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:46:58.459241708Z │ 611 │ │ │ raise │ 2025-03-25T15:46:58.459243087Z │ │ 2025-03-25T15:46:58.459244287Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:46:58.459245899Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:46:58.459247258Z │ │ 2025-03-25T15:46:58.459248411Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:46:58.459249870Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:46:58.459251483Z │ 134 │ │ │ 2025-03-25T15:46:58.459252769Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:46:58.459254127Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:46:58.459255391Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:46:58.459256657Z │ 138 │ 2025-03-25T15:46:58.459257823Z │ │ 2025-03-25T15:46:58.459258961Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:46:58.459260188Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:46:58.459261466Z │ │ 2025-03-25T15:46:58.459263979Z │ 144 │ │ 2025-03-25T15:46:58.459265246Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:46:58.459267227Z │ 146 │ │ try: │ 2025-03-25T15:46:58.459268477Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:46:58.459269826Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:46:58.459271195Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:46:58.459272495Z │ 150 │ │ │ │ raise │ 2025-03-25T15:46:58.459273789Z │ │ 2025-03-25T15:46:58.459274962Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:58.459276124Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:46:58.459277429Z │ │ 2025-03-25T15:46:58.459278564Z │ 63 │ │ 2025-03-25T15:46:58.459279812Z │ 64 │ def wsgi(self): │ 2025-03-25T15:46:58.459281125Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:46:58.459282505Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:46:58.459285404Z │ 67 │ │ return self.callable │ 2025-03-25T15:46:58.459286714Z │ 68 │ │ 2025-03-25T15:46:58.459287935Z │ 69 │ def run(self): │ 2025-03-25T15:46:58.459289228Z │ │ 2025-03-25T15:46:58.459290370Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:58.459291588Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:46:58.459292880Z │ │ 2025-03-25T15:46:58.459294035Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:46:58.459295476Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:46:58.459296769Z │ 56 │ │ else: │ 2025-03-25T15:46:58.459298044Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:46:58.459299459Z │ 58 │ 2025-03-25T15:46:58.459300678Z │ 59 │ 2025-03-25T15:46:58.459301892Z │ 60 def run(prog=None): │ 2025-03-25T15:46:58.459304196Z │ │ 2025-03-25T15:46:58.459305472Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:46:58.459306678Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:46:58.459307975Z │ │ 2025-03-25T15:46:58.459309135Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:46:58.459310504Z │ 45 │ │ 2025-03-25T15:46:58.459311694Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:46:58.459313003Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:46:58.459314392Z │ 48 │ │ 2025-03-25T15:46:58.459315570Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:46:58.459316901Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:46:58.459318318Z │ │ 2025-03-25T15:46:58.459319477Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:46:58.459320703Z │ til.py:370 in import_app │ 2025-03-25T15:46:58.459322003Z │ │ 2025-03-25T15:46:58.459323251Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:46:58.459325535Z │ 368 │ │ 2025-03-25T15:46:58.459326738Z │ 369 │ try: │ 2025-03-25T15:46:58.459327980Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:46:58.459329262Z │ 371 │ except ImportError: │ 2025-03-25T15:46:58.459330540Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:46:58.459331979Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:46:58.459333301Z │ │ 2025-03-25T15:46:58.459334449Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:46:58.459335747Z │ in import_module │ 2025-03-25T15:46:58.459336954Z │ │ 2025-03-25T15:46:58.459338114Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:46:58.459339531Z │ 124 │ │ │ │ break │ 2025-03-25T15:46:58.459340771Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:46:58.459341977Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:46:58.459343378Z │ 127 │ 2025-03-25T15:46:58.459345560Z │ 128 │ 2025-03-25T15:46:58.459346740Z │ 129 _RELOADING = {} │ 2025-03-25T15:46:58.459347906Z │ in _gcd_import:1204 │ 2025-03-25T15:46:58.459349136Z │ in _find_and_load:1176 │ 2025-03-25T15:46:58.459350402Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:46:58.459351643Z │ in _load_unlocked:690 │ 2025-03-25T15:46:58.459352854Z │ in exec_module:940 │ 2025-03-25T15:46:58.459354060Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:46:58.459355289Z │ │ 2025-03-25T15:46:58.459356447Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:46:58.459357711Z │ <module> │ 2025-03-25T15:46:58.459358954Z │ │ 2025-03-25T15:46:58.459360086Z │ 13 import orjson │ 2025-03-25T15:46:58.459361341Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:46:58.459362795Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:46:58.459364247Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:46:58.459367899Z │ 17 from PIL.Image import Image │ 2025-03-25T15:46:58.459369274Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:46:58.459370607Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:46:58.459372049Z │ │ 2025-03-25T15:46:58.459373208Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:58.459374421Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:46:58.459375751Z │ │ 2025-03-25T15:46:58.459376889Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:46:58.459378302Z │ 55 │ 2025-03-25T15:46:58.459379476Z │ 56 if import_capi_exception: │ 2025-03-25T15:46:58.459380909Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:46:58.459382254Z │ 58 │ 2025-03-25T15:46:58.459383522Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:46:58.459384942Z │ F401 │ 2025-03-25T15:46:58.459387034Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:46:58.459388407Z │ │ 2025-03-25T15:46:58.459389565Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:58.459390788Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:46:58.459392076Z │ │ 2025-03-25T15:46:58.459393215Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:46:58.459394487Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:46:58.459395694Z │ 22 try: │ 2025-03-25T15:46:58.459396894Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:58.459398379Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:58.459400528Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:58.459402003Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:46:58.459403440Z │ │ 2025-03-25T15:46:58.459404608Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:46:58.459406932Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:46:58.459408283Z │ │ 2025-03-25T15:46:58.459409438Z │ 29 │ 2025-03-25T15:46:58.459410609Z │ 30 │ 2025-03-25T15:46:58.459411747Z │ 31 │ 2025-03-25T15:46:58.459412910Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:46:58.459414448Z │ 33 │ 2025-03-25T15:46:58.459415639Z │ 34 │ 2025-03-25T15:46:58.459416857Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:46:58.459418096Z ImportError: 2025-03-25T15:46:58.459419268Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:46:58.459420378Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:46:58.459421569Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:46:58.459422839Z shared object requires: Invalid argument 2025-03-25T15:46:58.459774664Z [03/25/25 15:46:58] INFO Worker exiting (pid: 2750) 2025-03-25T15:46:58.505877980Z [03/25/25 15:46:58] ERROR Worker (pid:2750) exited with code 3 2025-03-25T15:46:58.506323254Z [03/25/25 15:46:58] ERROR Shutting down: Master 2025-03-25T15:46:58.506668814Z [03/25/25 15:46:58] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:00.089212859Z [03/25/25 15:47:00] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:00.089855902Z [03/25/25 15:47:00] INFO Listening at: http://0.0.0.0:3003 (2752) 2025-03-25T15:47:00.090262947Z [03/25/25 15:47:00] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:00.095593108Z [03/25/25 15:47:00] INFO Booting worker with pid: 2755 2025-03-25T15:47:00.368916365Z [03/25/25 15:47:00] ERROR Exception in worker process 2025-03-25T15:47:00.368930556Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:00.368933253Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:00.368934669Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:00.368936085Z │ │ 2025-03-25T15:47:00.368937329Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:00.368938811Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:00.368940222Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:00.368941550Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:00.368942889Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:00.368944184Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:00.368950717Z │ 611 │ │ │ raise │ 2025-03-25T15:47:00.368954201Z │ │ 2025-03-25T15:47:00.368955472Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:00.368957613Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:00.368959071Z │ │ 2025-03-25T15:47:00.368960289Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:00.368961586Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:00.368962831Z │ 134 │ │ │ 2025-03-25T15:47:00.368964032Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:00.368965319Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:00.368966637Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:00.368967886Z │ 138 │ 2025-03-25T15:47:00.368969062Z │ │ 2025-03-25T15:47:00.368970192Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:00.368971400Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:00.368974038Z │ │ 2025-03-25T15:47:00.368975189Z │ 144 │ │ 2025-03-25T15:47:00.368976381Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:00.368977852Z │ 146 │ │ try: │ 2025-03-25T15:47:00.368979132Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:00.368980429Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:00.368981790Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:00.368983128Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:00.368984376Z │ │ 2025-03-25T15:47:00.368985502Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:00.368986720Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:00.368988030Z │ │ 2025-03-25T15:47:00.368989161Z │ 63 │ │ 2025-03-25T15:47:00.368990332Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:00.368991651Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:00.368994347Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:00.368995876Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:00.368997193Z │ 68 │ │ 2025-03-25T15:47:00.368998431Z │ 69 │ def run(self): │ 2025-03-25T15:47:00.368999731Z │ │ 2025-03-25T15:47:00.369000941Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:00.369002130Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:00.369003440Z │ │ 2025-03-25T15:47:00.369004601Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:00.369006024Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:00.369007332Z │ 56 │ │ else: │ 2025-03-25T15:47:00.369008586Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:00.369009952Z │ 58 │ 2025-03-25T15:47:00.369011117Z │ 59 │ 2025-03-25T15:47:00.369012291Z │ 60 def run(prog=None): │ 2025-03-25T15:47:00.369014574Z │ │ 2025-03-25T15:47:00.369015874Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:00.369017093Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:00.369018407Z │ │ 2025-03-25T15:47:00.369019561Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:00.369020901Z │ 45 │ │ 2025-03-25T15:47:00.369022097Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:00.369023451Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:00.369024842Z │ 48 │ │ 2025-03-25T15:47:00.369026086Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:00.369027396Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:00.369028802Z │ │ 2025-03-25T15:47:00.369029973Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:00.369031210Z │ til.py:370 in import_app │ 2025-03-25T15:47:00.369032487Z │ │ 2025-03-25T15:47:00.369033740Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:00.369036029Z │ 368 │ │ 2025-03-25T15:47:00.369037256Z │ 369 │ try: │ 2025-03-25T15:47:00.369038485Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:00.369039728Z │ 371 │ except ImportError: │ 2025-03-25T15:47:00.369041011Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:00.369042421Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:00.369043745Z │ │ 2025-03-25T15:47:00.369044902Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:00.369046219Z │ in import_module │ 2025-03-25T15:47:00.369047484Z │ │ 2025-03-25T15:47:00.369048863Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:00.369050241Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:00.369051478Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:00.369052738Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:00.369054124Z │ 127 │ 2025-03-25T15:47:00.369056731Z │ 128 │ 2025-03-25T15:47:00.369057904Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:00.369059097Z │ in _gcd_import:1204 │ 2025-03-25T15:47:00.369060342Z │ in _find_and_load:1176 │ 2025-03-25T15:47:00.369061569Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:00.369062778Z │ in _load_unlocked:690 │ 2025-03-25T15:47:00.369063998Z │ in exec_module:940 │ 2025-03-25T15:47:00.369065228Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:00.369066478Z │ │ 2025-03-25T15:47:00.369067635Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:00.369068947Z │ <module> │ 2025-03-25T15:47:00.369070168Z │ │ 2025-03-25T15:47:00.369071302Z │ 13 import orjson │ 2025-03-25T15:47:00.369072546Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:00.369074008Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:00.369075391Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:00.369077859Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:00.369079174Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:00.369080514Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:00.369081918Z │ │ 2025-03-25T15:47:00.369083053Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:00.369084284Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:00.369085592Z │ │ 2025-03-25T15:47:00.369086764Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:00.369088139Z │ 55 │ 2025-03-25T15:47:00.369089377Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:00.369090705Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:00.369092119Z │ 58 │ 2025-03-25T15:47:00.369093475Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:00.369094996Z │ F401 │ 2025-03-25T15:47:00.369097254Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:00.369098660Z │ │ 2025-03-25T15:47:00.369099809Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:00.369100974Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:00.369102250Z │ │ 2025-03-25T15:47:00.369103387Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:00.369104594Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:00.369105754Z │ 22 try: │ 2025-03-25T15:47:00.369106958Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:00.369108431Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:00.369109844Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:00.369111357Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:00.369112771Z │ │ 2025-03-25T15:47:00.369113919Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:00.369116024Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:00.369117313Z │ │ 2025-03-25T15:47:00.369118448Z │ 29 │ 2025-03-25T15:47:00.369119620Z │ 30 │ 2025-03-25T15:47:00.369120842Z │ 31 │ 2025-03-25T15:47:00.369122059Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:00.369123551Z │ 33 │ 2025-03-25T15:47:00.369124775Z │ 34 │ 2025-03-25T15:47:00.369127284Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:00.369128528Z ImportError: 2025-03-25T15:47:00.369129664Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:00.369130775Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:00.369131977Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:00.369133232Z shared object requires: Invalid argument 2025-03-25T15:47:00.369489094Z [03/25/25 15:47:00] INFO Worker exiting (pid: 2755) 2025-03-25T15:47:00.413215862Z [03/25/25 15:47:00] ERROR Worker (pid:2755) exited with code 3 2025-03-25T15:47:00.413736993Z [03/25/25 15:47:00] ERROR Shutting down: Master 2025-03-25T15:47:00.414110792Z [03/25/25 15:47:00] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:02.070942891Z [03/25/25 15:47:02] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:02.071657945Z [03/25/25 15:47:02] INFO Listening at: http://0.0.0.0:3003 (2757) 2025-03-25T15:47:02.072044339Z [03/25/25 15:47:02] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:02.075121433Z [03/25/25 15:47:02] INFO Booting worker with pid: 2760 2025-03-25T15:47:02.349289885Z [03/25/25 15:47:02] ERROR Exception in worker process 2025-03-25T15:47:02.349305442Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:02.349308208Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:02.349309694Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:02.349311081Z │ │ 2025-03-25T15:47:02.349312321Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:02.349313792Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:02.349315478Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:02.349316864Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:02.349318126Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:02.349319398Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:02.349328078Z │ 611 │ │ │ raise │ 2025-03-25T15:47:02.349329397Z │ │ 2025-03-25T15:47:02.349330572Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:02.349332547Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:02.349333957Z │ │ 2025-03-25T15:47:02.349335115Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:02.349336396Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:02.349337620Z │ 134 │ │ │ 2025-03-25T15:47:02.349338853Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:02.349340188Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:02.349341544Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:02.349342809Z │ 138 │ 2025-03-25T15:47:02.349344002Z │ │ 2025-03-25T15:47:02.349345139Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:02.349346355Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:02.349348710Z │ │ 2025-03-25T15:47:02.349349859Z │ 144 │ │ 2025-03-25T15:47:02.349351053Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:02.349352482Z │ 146 │ │ try: │ 2025-03-25T15:47:02.349353767Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:02.349355089Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:02.349356420Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:02.349357754Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:02.349359076Z │ │ 2025-03-25T15:47:02.349360214Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:02.349361384Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:02.349362680Z │ │ 2025-03-25T15:47:02.349363848Z │ 63 │ │ 2025-03-25T15:47:02.349365093Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:02.349366386Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:02.349368778Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:02.349370275Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:02.349371540Z │ 68 │ │ 2025-03-25T15:47:02.349372781Z │ 69 │ def run(self): │ 2025-03-25T15:47:02.349374076Z │ │ 2025-03-25T15:47:02.349375218Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:02.349376447Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:02.349377770Z │ │ 2025-03-25T15:47:02.349378932Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:02.349380352Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:02.349381656Z │ 56 │ │ else: │ 2025-03-25T15:47:02.349382900Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:02.349384275Z │ 58 │ 2025-03-25T15:47:02.349385452Z │ 59 │ 2025-03-25T15:47:02.349386648Z │ 60 def run(prog=None): │ 2025-03-25T15:47:02.349388808Z │ │ 2025-03-25T15:47:02.349390117Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:02.349391386Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:02.349392678Z │ │ 2025-03-25T15:47:02.349393830Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:02.349395206Z │ 45 │ │ 2025-03-25T15:47:02.349396407Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:02.349397761Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:02.349399163Z │ 48 │ │ 2025-03-25T15:47:02.349400331Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:02.349401645Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:02.349403052Z │ │ 2025-03-25T15:47:02.349404185Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:02.349405396Z │ til.py:370 in import_app │ 2025-03-25T15:47:02.349406714Z │ │ 2025-03-25T15:47:02.349408850Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:02.349410214Z │ 368 │ │ 2025-03-25T15:47:02.349411422Z │ 369 │ try: │ 2025-03-25T15:47:02.349412658Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:02.349413863Z │ 371 │ except ImportError: │ 2025-03-25T15:47:02.349415130Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:02.349416544Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:02.349417876Z │ │ 2025-03-25T15:47:02.349419062Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:02.349420361Z │ in import_module │ 2025-03-25T15:47:02.349421549Z │ │ 2025-03-25T15:47:02.349422683Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:02.349424094Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:02.349425327Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:02.349426541Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:02.349428813Z │ 127 │ 2025-03-25T15:47:02.349430048Z │ 128 │ 2025-03-25T15:47:02.349431219Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:02.349432395Z │ in _gcd_import:1204 │ 2025-03-25T15:47:02.349433639Z │ in _find_and_load:1176 │ 2025-03-25T15:47:02.349434851Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:02.349436061Z │ in _load_unlocked:690 │ 2025-03-25T15:47:02.349437261Z │ in exec_module:940 │ 2025-03-25T15:47:02.349438449Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:02.349439687Z │ │ 2025-03-25T15:47:02.349440813Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:02.349442082Z │ <module> │ 2025-03-25T15:47:02.349443339Z │ │ 2025-03-25T15:47:02.349444475Z │ 13 import orjson │ 2025-03-25T15:47:02.349449803Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:02.349451382Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:02.349452779Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:02.349455406Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:02.349456746Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:02.349458009Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:02.349459438Z │ │ 2025-03-25T15:47:02.349460575Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:02.349461812Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:02.349463112Z │ │ 2025-03-25T15:47:02.349464249Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:02.349465609Z │ 55 │ 2025-03-25T15:47:02.349466796Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:02.349468020Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:02.349469399Z │ 58 │ 2025-03-25T15:47:02.349470638Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:02.349471994Z │ F401 │ 2025-03-25T15:47:02.349474310Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:02.349475755Z │ │ 2025-03-25T15:47:02.349477007Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:02.349478236Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:02.349479614Z │ │ 2025-03-25T15:47:02.349480824Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:02.349482102Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:02.349483364Z │ 22 try: │ 2025-03-25T15:47:02.349484615Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:02.349486035Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:02.349487481Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:02.349488932Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:02.349490309Z │ │ 2025-03-25T15:47:02.349491434Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:02.349493550Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:02.349494879Z │ │ 2025-03-25T15:47:02.349496000Z │ 29 │ 2025-03-25T15:47:02.349497191Z │ 30 │ 2025-03-25T15:47:02.349498353Z │ 31 │ 2025-03-25T15:47:02.349499519Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:02.349501013Z │ 33 │ 2025-03-25T15:47:02.349502198Z │ 34 │ 2025-03-25T15:47:02.349503391Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:02.349504609Z ImportError: 2025-03-25T15:47:02.349505781Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:02.349506891Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:02.349508084Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:02.349509318Z shared object requires: Invalid argument 2025-03-25T15:47:02.349908888Z [03/25/25 15:47:02] INFO Worker exiting (pid: 2760) 2025-03-25T15:47:02.394165403Z [03/25/25 15:47:02] ERROR Worker (pid:2760) exited with code 3 2025-03-25T15:47:02.394874648Z [03/25/25 15:47:02] ERROR Shutting down: Master 2025-03-25T15:47:02.395200060Z [03/25/25 15:47:02] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:03.999852369Z [03/25/25 15:47:03] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:04.000491065Z [03/25/25 15:47:03] INFO Listening at: http://0.0.0.0:3003 (2762) 2025-03-25T15:47:04.000884278Z [03/25/25 15:47:04] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:04.003869829Z [03/25/25 15:47:04] INFO Booting worker with pid: 2765 2025-03-25T15:47:04.282590474Z [03/25/25 15:47:04] ERROR Exception in worker process 2025-03-25T15:47:04.282611072Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:04.282616345Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:04.282619059Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:04.282621649Z │ │ 2025-03-25T15:47:04.282624119Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:04.282626783Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:04.282629338Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:04.282631634Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:04.282633984Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:04.282643579Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:04.282646646Z │ 611 │ │ │ raise │ 2025-03-25T15:47:04.282649059Z │ │ 2025-03-25T15:47:04.282651349Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:04.282654574Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:04.282657167Z │ │ 2025-03-25T15:47:04.282659255Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:04.282661524Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:04.282664134Z │ 134 │ │ │ 2025-03-25T15:47:04.282666970Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:04.282669529Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:04.282671930Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:04.282674200Z │ 138 │ 2025-03-25T15:47:04.282676426Z │ │ 2025-03-25T15:47:04.282678484Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:04.282680702Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:04.282685666Z │ │ 2025-03-25T15:47:04.282688066Z │ 144 │ │ 2025-03-25T15:47:04.282690336Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:04.282693096Z │ 146 │ │ try: │ 2025-03-25T15:47:04.282695418Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:04.282697812Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:04.282700182Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:04.282702539Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:04.282704749Z │ │ 2025-03-25T15:47:04.282706797Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:04.282708919Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:04.282711412Z │ │ 2025-03-25T15:47:04.282713474Z │ 63 │ │ 2025-03-25T15:47:04.282715640Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:04.282717947Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:04.282722230Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:04.282725323Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:04.282727932Z │ 68 │ │ 2025-03-25T15:47:04.282730114Z │ 69 │ def run(self): │ 2025-03-25T15:47:04.282732470Z │ │ 2025-03-25T15:47:04.282734553Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:04.282736688Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:04.282738975Z │ │ 2025-03-25T15:47:04.282741082Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:04.282743499Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:04.282745847Z │ 56 │ │ else: │ 2025-03-25T15:47:04.282748087Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:04.282750572Z │ 58 │ 2025-03-25T15:47:04.282752676Z │ 59 │ 2025-03-25T15:47:04.282754797Z │ 60 def run(prog=None): │ 2025-03-25T15:47:04.282759827Z │ │ 2025-03-25T15:47:04.282762429Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:04.282764709Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:04.282767096Z │ │ 2025-03-25T15:47:04.282769219Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:04.282771755Z │ 45 │ │ 2025-03-25T15:47:04.282773892Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:04.282776197Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:04.282778590Z │ 48 │ │ 2025-03-25T15:47:04.282780782Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:04.282783092Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:04.282785622Z │ │ 2025-03-25T15:47:04.282790622Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:04.282793083Z │ til.py:370 in import_app │ 2025-03-25T15:47:04.282795444Z │ │ 2025-03-25T15:47:04.282801184Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:04.282803888Z │ 368 │ │ 2025-03-25T15:47:04.282806270Z │ 369 │ try: │ 2025-03-25T15:47:04.282843659Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:04.282850604Z │ 371 │ except ImportError: │ 2025-03-25T15:47:04.282852319Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:04.282853962Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:04.282855372Z │ │ 2025-03-25T15:47:04.282856555Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:04.282857833Z │ in import_module │ 2025-03-25T15:47:04.282859096Z │ │ 2025-03-25T15:47:04.282860283Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:04.282861709Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:04.282863026Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:04.282864356Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:04.282870915Z │ 127 │ 2025-03-25T15:47:04.282872467Z │ 128 │ 2025-03-25T15:47:04.282873675Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:04.282874857Z │ in _gcd_import:1204 │ 2025-03-25T15:47:04.282876198Z │ in _find_and_load:1176 │ 2025-03-25T15:47:04.282877492Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:04.282878831Z │ in _load_unlocked:690 │ 2025-03-25T15:47:04.282880141Z │ in exec_module:940 │ 2025-03-25T15:47:04.282881315Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:04.282882613Z │ │ 2025-03-25T15:47:04.282883808Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:04.282885139Z │ <module> │ 2025-03-25T15:47:04.282886597Z │ │ 2025-03-25T15:47:04.282887780Z │ 13 import orjson │ 2025-03-25T15:47:04.282889196Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:04.282891258Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:04.282894821Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:04.282896411Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:04.282897811Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:04.282899090Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:04.282900480Z │ │ 2025-03-25T15:47:04.282901626Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:04.282902831Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:04.282904215Z │ │ 2025-03-25T15:47:04.282905347Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:04.282906737Z │ 55 │ 2025-03-25T15:47:04.282907894Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:04.282909104Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:04.282910477Z │ 58 │ 2025-03-25T15:47:04.282911804Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:04.282913203Z │ F401 │ 2025-03-25T15:47:04.282915452Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:04.282916758Z │ │ 2025-03-25T15:47:04.282917925Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:04.282919081Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:04.282920343Z │ │ 2025-03-25T15:47:04.282921483Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:04.282922726Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:04.282923914Z │ 22 try: │ 2025-03-25T15:47:04.282925140Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:04.282926577Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:04.282928011Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:04.282929476Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:04.282930829Z │ │ 2025-03-25T15:47:04.282931962Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:04.282934866Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:04.282936188Z │ │ 2025-03-25T15:47:04.282937414Z │ 29 │ 2025-03-25T15:47:04.282938587Z │ 30 │ 2025-03-25T15:47:04.282939773Z │ 31 │ 2025-03-25T15:47:04.282940952Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:04.282942471Z │ 33 │ 2025-03-25T15:47:04.282943608Z │ 34 │ 2025-03-25T15:47:04.282944787Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:04.282946037Z ImportError: 2025-03-25T15:47:04.282947217Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:04.282948315Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:04.282949472Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:04.282950858Z shared object requires: Invalid argument 2025-03-25T15:47:04.283451719Z [03/25/25 15:47:04] INFO Worker exiting (pid: 2765) 2025-03-25T15:47:04.332109000Z [03/25/25 15:47:04] ERROR Worker (pid:2765) exited with code 3 2025-03-25T15:47:04.332664840Z [03/25/25 15:47:04] ERROR Shutting down: Master 2025-03-25T15:47:04.333063654Z [03/25/25 15:47:04] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:05.927570631Z [03/25/25 15:47:05] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:05.928267327Z [03/25/25 15:47:05] INFO Listening at: http://0.0.0.0:3003 (2767) 2025-03-25T15:47:05.928644604Z [03/25/25 15:47:05] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:05.932807872Z [03/25/25 15:47:05] INFO Booting worker with pid: 2770 2025-03-25T15:47:06.205896183Z [03/25/25 15:47:06] ERROR Exception in worker process 2025-03-25T15:47:06.205913739Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:06.205916011Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:06.205917603Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:06.205924656Z │ │ 2025-03-25T15:47:06.205925920Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:06.205927429Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:06.205928860Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:06.205930171Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:06.205931538Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:06.205938090Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:06.205939517Z │ 611 │ │ │ raise │ 2025-03-25T15:47:06.205940802Z │ │ 2025-03-25T15:47:06.205941971Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:06.205944066Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:06.205945469Z │ │ 2025-03-25T15:47:06.205946645Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:06.205947957Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:06.205949221Z │ 134 │ │ │ 2025-03-25T15:47:06.205950933Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:06.205952275Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:06.205953587Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:06.205954860Z │ 138 │ 2025-03-25T15:47:06.205956074Z │ │ 2025-03-25T15:47:06.205957217Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:06.205958418Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:06.205961338Z │ │ 2025-03-25T15:47:06.205962554Z │ 144 │ │ 2025-03-25T15:47:06.205963742Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:06.205965178Z │ 146 │ │ try: │ 2025-03-25T15:47:06.205966436Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:06.205967777Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:06.205969118Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:06.205970409Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:06.205971704Z │ │ 2025-03-25T15:47:06.205972879Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:06.205974057Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:06.205975357Z │ │ 2025-03-25T15:47:06.205976490Z │ 63 │ │ 2025-03-25T15:47:06.205977707Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:06.205979022Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:06.205981402Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:06.205982954Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:06.205984285Z │ 68 │ │ 2025-03-25T15:47:06.205985494Z │ 69 │ def run(self): │ 2025-03-25T15:47:06.205986792Z │ │ 2025-03-25T15:47:06.205987921Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:06.205989099Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:06.205990413Z │ │ 2025-03-25T15:47:06.205991548Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:06.205992923Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:06.205994279Z │ 56 │ │ else: │ 2025-03-25T15:47:06.205995539Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:06.205996921Z │ 58 │ 2025-03-25T15:47:06.205998148Z │ 59 │ 2025-03-25T15:47:06.205999499Z │ 60 def run(prog=None): │ 2025-03-25T15:47:06.206001932Z │ │ 2025-03-25T15:47:06.206005752Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:06.206007066Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:06.206008356Z │ │ 2025-03-25T15:47:06.206009519Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:06.206010890Z │ 45 │ │ 2025-03-25T15:47:06.206012101Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:06.206013397Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:06.206014812Z │ 48 │ │ 2025-03-25T15:47:06.206016001Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:06.206017330Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:06.206018747Z │ │ 2025-03-25T15:47:06.206019897Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:06.206021121Z │ til.py:370 in import_app │ 2025-03-25T15:47:06.206022411Z │ │ 2025-03-25T15:47:06.206024740Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:06.206026109Z │ 368 │ │ 2025-03-25T15:47:06.206027367Z │ 369 │ try: │ 2025-03-25T15:47:06.206028656Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:06.206029907Z │ 371 │ except ImportError: │ 2025-03-25T15:47:06.206031195Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:06.206032636Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:06.206033960Z │ │ 2025-03-25T15:47:06.206035111Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:06.206036437Z │ in import_module │ 2025-03-25T15:47:06.206037641Z │ │ 2025-03-25T15:47:06.206038808Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:06.206040224Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:06.206041442Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:06.206042696Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:06.206045043Z │ 127 │ 2025-03-25T15:47:06.206046228Z │ 128 │ 2025-03-25T15:47:06.206047400Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:06.206048585Z │ in _gcd_import:1204 │ 2025-03-25T15:47:06.206049826Z │ in _find_and_load:1176 │ 2025-03-25T15:47:06.206051088Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:06.206052301Z │ in _load_unlocked:690 │ 2025-03-25T15:47:06.206053532Z │ in exec_module:940 │ 2025-03-25T15:47:06.206054728Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:06.206055982Z │ │ 2025-03-25T15:47:06.206057150Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:06.206058433Z │ <module> │ 2025-03-25T15:47:06.206059700Z │ │ 2025-03-25T15:47:06.206060904Z │ 13 import orjson │ 2025-03-25T15:47:06.206062164Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:06.206063581Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:06.206065923Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:06.206067485Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:06.206068811Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:06.206070079Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:06.206071469Z │ │ 2025-03-25T15:47:06.206072647Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:06.206073842Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:06.206075180Z │ │ 2025-03-25T15:47:06.206076360Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:06.206077745Z │ 55 │ 2025-03-25T15:47:06.206078941Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:06.206080145Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:06.206081503Z │ 58 │ 2025-03-25T15:47:06.206082804Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:06.206084216Z │ F401 │ 2025-03-25T15:47:06.206086413Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:06.206087807Z │ │ 2025-03-25T15:47:06.206088951Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:06.206090145Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:06.206091423Z │ │ 2025-03-25T15:47:06.206092605Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:06.206093875Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:06.206095281Z │ 22 try: │ 2025-03-25T15:47:06.206096514Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:06.206097936Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:06.206099346Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:06.206100853Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:06.206102274Z │ │ 2025-03-25T15:47:06.206103430Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:06.206105570Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:06.206106944Z │ │ 2025-03-25T15:47:06.206108090Z │ 29 │ 2025-03-25T15:47:06.206109282Z │ 30 │ 2025-03-25T15:47:06.206110471Z │ 31 │ 2025-03-25T15:47:06.206111643Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:06.206113174Z │ 33 │ 2025-03-25T15:47:06.206114344Z │ 34 │ 2025-03-25T15:47:06.206115524Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:06.206116776Z ImportError: 2025-03-25T15:47:06.206117912Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:06.206119026Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:06.206120208Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:06.206121500Z shared object requires: Invalid argument 2025-03-25T15:47:06.206459388Z [03/25/25 15:47:06] INFO Worker exiting (pid: 2770) 2025-03-25T15:47:06.250521510Z [03/25/25 15:47:06] ERROR Worker (pid:2770) exited with code 3 2025-03-25T15:47:06.251067107Z [03/25/25 15:47:06] ERROR Shutting down: Master 2025-03-25T15:47:06.251413814Z [03/25/25 15:47:06] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:07.835567924Z [03/25/25 15:47:07] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:07.836150980Z [03/25/25 15:47:07] INFO Listening at: http://0.0.0.0:3003 (2773) 2025-03-25T15:47:07.836542704Z [03/25/25 15:47:07] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:07.839269497Z [03/25/25 15:47:07] INFO Booting worker with pid: 2776 2025-03-25T15:47:08.126085062Z [03/25/25 15:47:08] ERROR Exception in worker process 2025-03-25T15:47:08.126099117Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:08.126101802Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:08.126103299Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:08.126104685Z │ │ 2025-03-25T15:47:08.126105877Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:08.126107396Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:08.126108796Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:08.126110102Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:08.126111405Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:08.126118498Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:08.126119920Z │ 611 │ │ │ raise │ 2025-03-25T15:47:08.126121239Z │ │ 2025-03-25T15:47:08.126122416Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:08.126124172Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:08.126125513Z │ │ 2025-03-25T15:47:08.126126674Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:08.126127960Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:08.126129208Z │ 134 │ │ │ 2025-03-25T15:47:08.126130412Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:08.126131689Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:08.126132947Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:08.126134233Z │ 138 │ 2025-03-25T15:47:08.126135408Z │ │ 2025-03-25T15:47:08.126136560Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:08.126137745Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:08.126140056Z │ │ 2025-03-25T15:47:08.126141220Z │ 144 │ │ 2025-03-25T15:47:08.126142469Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:08.126143912Z │ 146 │ │ try: │ 2025-03-25T15:47:08.126145157Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:08.126146471Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:08.126147812Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:08.126149115Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:08.126150402Z │ │ 2025-03-25T15:47:08.126151559Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:08.126152720Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:08.126154021Z │ │ 2025-03-25T15:47:08.126155142Z │ 63 │ │ 2025-03-25T15:47:08.126156317Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:08.126158127Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:08.126160487Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:08.126162015Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:08.126163281Z │ 68 │ │ 2025-03-25T15:47:08.126164511Z │ 69 │ def run(self): │ 2025-03-25T15:47:08.126165779Z │ │ 2025-03-25T15:47:08.126166932Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:08.126168109Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:08.126169386Z │ │ 2025-03-25T15:47:08.126170521Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:08.126171949Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:08.126173279Z │ 56 │ │ else: │ 2025-03-25T15:47:08.126174534Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:08.126175903Z │ 58 │ 2025-03-25T15:47:08.126177090Z │ 59 │ 2025-03-25T15:47:08.126178252Z │ 60 def run(prog=None): │ 2025-03-25T15:47:08.126180397Z │ │ 2025-03-25T15:47:08.126181671Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:08.126182853Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:08.126184114Z │ │ 2025-03-25T15:47:08.126185251Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:08.126186583Z │ 45 │ │ 2025-03-25T15:47:08.126187763Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:08.126189110Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:08.126190498Z │ 48 │ │ 2025-03-25T15:47:08.126191715Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:08.126193004Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:08.126194393Z │ │ 2025-03-25T15:47:08.126195532Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:08.126196761Z │ til.py:370 in import_app │ 2025-03-25T15:47:08.126198072Z │ │ 2025-03-25T15:47:08.126200445Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:08.126201781Z │ 368 │ │ 2025-03-25T15:47:08.126203015Z │ 369 │ try: │ 2025-03-25T15:47:08.126204264Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:08.126205504Z │ 371 │ except ImportError: │ 2025-03-25T15:47:08.126206776Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:08.126208193Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:08.126209516Z │ │ 2025-03-25T15:47:08.126210662Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:08.126211964Z │ in import_module │ 2025-03-25T15:47:08.126213180Z │ │ 2025-03-25T15:47:08.126214342Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:08.126215690Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:08.126216976Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:08.126218215Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:08.126220542Z │ 127 │ 2025-03-25T15:47:08.126221760Z │ 128 │ 2025-03-25T15:47:08.126222928Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:08.126224133Z │ in _gcd_import:1204 │ 2025-03-25T15:47:08.126225389Z │ in _find_and_load:1176 │ 2025-03-25T15:47:08.126226683Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:08.126227886Z │ in _load_unlocked:690 │ 2025-03-25T15:47:08.126229098Z │ in exec_module:940 │ 2025-03-25T15:47:08.126230295Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:08.126231508Z │ │ 2025-03-25T15:47:08.126232631Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:08.126233910Z │ <module> │ 2025-03-25T15:47:08.126235188Z │ │ 2025-03-25T15:47:08.126236309Z │ 13 import orjson │ 2025-03-25T15:47:08.126237546Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:08.126238993Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:08.126241278Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:08.126242829Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:08.126244160Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:08.126245463Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:08.126246863Z │ │ 2025-03-25T15:47:08.126248019Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:08.126249204Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:08.126250520Z │ │ 2025-03-25T15:47:08.126251665Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:08.126253046Z │ 55 │ 2025-03-25T15:47:08.126254221Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:08.126255473Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:08.126256793Z │ 58 │ 2025-03-25T15:47:08.126258034Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:08.126259431Z │ F401 │ 2025-03-25T15:47:08.126261970Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:08.126263336Z │ │ 2025-03-25T15:47:08.126264482Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:08.126265660Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:08.126266960Z │ │ 2025-03-25T15:47:08.126268085Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:08.126269294Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:08.126270474Z │ 22 try: │ 2025-03-25T15:47:08.126271711Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:08.126273114Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:08.126274548Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:08.126276023Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:08.126277413Z │ │ 2025-03-25T15:47:08.126278574Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:08.126282204Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:08.126283553Z │ │ 2025-03-25T15:47:08.126284698Z │ 29 │ 2025-03-25T15:47:08.126285861Z │ 30 │ 2025-03-25T15:47:08.126287009Z │ 31 │ 2025-03-25T15:47:08.126288199Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:08.126291822Z │ 33 │ 2025-03-25T15:47:08.126293014Z │ 34 │ 2025-03-25T15:47:08.126294228Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:08.126295461Z ImportError: 2025-03-25T15:47:08.126296642Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:08.126297797Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:08.126298974Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:08.126300287Z shared object requires: Invalid argument 2025-03-25T15:47:08.126630542Z [03/25/25 15:47:08] INFO Worker exiting (pid: 2776) 2025-03-25T15:47:08.177231550Z [03/25/25 15:47:08] ERROR Worker (pid:2776) exited with code 3 2025-03-25T15:47:08.177748735Z [03/25/25 15:47:08] ERROR Shutting down: Master 2025-03-25T15:47:08.178106792Z [03/25/25 15:47:08] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:09.747523961Z [03/25/25 15:47:09] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:09.748059749Z [03/25/25 15:47:09] INFO Listening at: http://0.0.0.0:3003 (2778) 2025-03-25T15:47:09.748466138Z [03/25/25 15:47:09] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:09.751288973Z [03/25/25 15:47:09] INFO Booting worker with pid: 2781 2025-03-25T15:47:10.024908261Z [03/25/25 15:47:09] ERROR Exception in worker process 2025-03-25T15:47:10.024921090Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:10.024923721Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:10.024925176Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:10.024926516Z │ │ 2025-03-25T15:47:10.024927721Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:10.024929207Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:10.024930756Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:10.024932233Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:10.024933560Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:10.024939040Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:10.024940415Z │ 611 │ │ │ raise │ 2025-03-25T15:47:10.024942072Z │ │ 2025-03-25T15:47:10.024943238Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:10.024944853Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:10.024946287Z │ │ 2025-03-25T15:47:10.024947431Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:10.024948665Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:10.024949878Z │ 134 │ │ │ 2025-03-25T15:47:10.024951061Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:10.024952388Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:10.024953650Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:10.024954890Z │ 138 │ 2025-03-25T15:47:10.024956090Z │ │ 2025-03-25T15:47:10.024957260Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:10.024958450Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:10.024960826Z │ │ 2025-03-25T15:47:10.024961993Z │ 144 │ │ 2025-03-25T15:47:10.024963256Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:10.024967349Z │ 146 │ │ try: │ 2025-03-25T15:47:10.024968618Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:10.024969968Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:10.024971348Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:10.024972653Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:10.024973928Z │ │ 2025-03-25T15:47:10.024975067Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:10.024976241Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:10.024977505Z │ │ 2025-03-25T15:47:10.024978656Z │ 63 │ │ 2025-03-25T15:47:10.024979889Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:10.024981195Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:10.024983578Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:10.024985140Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:10.024986438Z │ 68 │ │ 2025-03-25T15:47:10.024987672Z │ 69 │ def run(self): │ 2025-03-25T15:47:10.024988957Z │ │ 2025-03-25T15:47:10.024990104Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:10.024991324Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:10.024992628Z │ │ 2025-03-25T15:47:10.024993792Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:10.024995139Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:10.024996431Z │ 56 │ │ else: │ 2025-03-25T15:47:10.024997672Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:10.024999045Z │ 58 │ 2025-03-25T15:47:10.025000234Z │ 59 │ 2025-03-25T15:47:10.025001413Z │ 60 def run(prog=None): │ 2025-03-25T15:47:10.025004895Z │ │ 2025-03-25T15:47:10.025006152Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:10.025007350Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:10.025008658Z │ │ 2025-03-25T15:47:10.025009821Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:10.025011148Z │ 45 │ │ 2025-03-25T15:47:10.025012375Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:10.025013728Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:10.025015364Z │ 48 │ │ 2025-03-25T15:47:10.025016552Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:10.025017876Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:10.025019279Z │ │ 2025-03-25T15:47:10.025020408Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:10.025021664Z │ til.py:370 in import_app │ 2025-03-25T15:47:10.025022977Z │ │ 2025-03-25T15:47:10.025025874Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:10.025027223Z │ 368 │ │ 2025-03-25T15:47:10.025028408Z │ 369 │ try: │ 2025-03-25T15:47:10.025029645Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:10.025030883Z │ 371 │ except ImportError: │ 2025-03-25T15:47:10.025032179Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:10.025033606Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:10.025034949Z │ │ 2025-03-25T15:47:10.025036125Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:10.025038261Z │ in import_module │ 2025-03-25T15:47:10.025039449Z │ │ 2025-03-25T15:47:10.025040629Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:10.025041967Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:10.025043199Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:10.025044445Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:10.025046850Z │ 127 │ 2025-03-25T15:47:10.025048057Z │ 128 │ 2025-03-25T15:47:10.025049215Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:10.025050353Z │ in _gcd_import:1204 │ 2025-03-25T15:47:10.025051555Z │ in _find_and_load:1176 │ 2025-03-25T15:47:10.025052799Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:10.025054012Z │ in _load_unlocked:690 │ 2025-03-25T15:47:10.025055215Z │ in exec_module:940 │ 2025-03-25T15:47:10.025056446Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:10.025057734Z │ │ 2025-03-25T15:47:10.025058864Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:10.025060155Z │ <module> │ 2025-03-25T15:47:10.025061439Z │ │ 2025-03-25T15:47:10.025062582Z │ 13 import orjson │ 2025-03-25T15:47:10.025063821Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:10.025065419Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:10.025067778Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:10.025069374Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:10.025070719Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:10.025071991Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:10.025073372Z │ │ 2025-03-25T15:47:10.025074501Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:10.025075699Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:10.025076977Z │ │ 2025-03-25T15:47:10.025078143Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:10.025079548Z │ 55 │ 2025-03-25T15:47:10.025080739Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:10.025081982Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:10.025083326Z │ 58 │ 2025-03-25T15:47:10.025084634Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:10.025086023Z │ F401 │ 2025-03-25T15:47:10.025088160Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:10.025089549Z │ │ 2025-03-25T15:47:10.025090703Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:10.025091865Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:10.025093158Z │ │ 2025-03-25T15:47:10.025094305Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:10.025095519Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:10.025096685Z │ 22 try: │ 2025-03-25T15:47:10.025097892Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:10.025099349Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:10.025100768Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:10.025102294Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:10.025103673Z │ │ 2025-03-25T15:47:10.025106957Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:10.025108159Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:10.025109475Z │ │ 2025-03-25T15:47:10.025110618Z │ 29 │ 2025-03-25T15:47:10.025111804Z │ 30 │ 2025-03-25T15:47:10.025113001Z │ 31 │ 2025-03-25T15:47:10.025114188Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:10.025115660Z │ 33 │ 2025-03-25T15:47:10.025116823Z │ 34 │ 2025-03-25T15:47:10.025118171Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:10.025119422Z ImportError: 2025-03-25T15:47:10.025120552Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:10.025121682Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:10.025122860Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:10.025124145Z shared object requires: Invalid argument 2025-03-25T15:47:10.025491177Z [03/25/25 15:47:10] INFO Worker exiting (pid: 2781) 2025-03-25T15:47:10.070666820Z [03/25/25 15:47:10] ERROR Worker (pid:2781) exited with code 3 2025-03-25T15:47:10.071219905Z [03/25/25 15:47:10] ERROR Shutting down: Master 2025-03-25T15:47:10.071560963Z [03/25/25 15:47:10] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:11.644635995Z [03/25/25 15:47:11] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:11.645248043Z [03/25/25 15:47:11] INFO Listening at: http://0.0.0.0:3003 (2783) 2025-03-25T15:47:11.645641608Z [03/25/25 15:47:11] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:11.648614503Z [03/25/25 15:47:11] INFO Booting worker with pid: 2786 2025-03-25T15:47:11.925942348Z [03/25/25 15:47:11] ERROR Exception in worker process 2025-03-25T15:47:11.925955844Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:11.925958617Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:11.925960054Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:11.925961480Z │ │ 2025-03-25T15:47:11.925963032Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:11.925964592Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:11.925966043Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:11.925967385Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:11.925968674Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:11.925976486Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:11.925977904Z │ 611 │ │ │ raise │ 2025-03-25T15:47:11.925979228Z │ │ 2025-03-25T15:47:11.925980389Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:11.925982214Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:11.925983623Z │ │ 2025-03-25T15:47:11.925984752Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:11.925985968Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:11.925987219Z │ 134 │ │ │ 2025-03-25T15:47:11.925988415Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:11.925989920Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:11.925991306Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:11.925992571Z │ 138 │ 2025-03-25T15:47:11.925993850Z │ │ 2025-03-25T15:47:11.925995060Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:11.925996321Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:11.926001867Z │ │ 2025-03-25T15:47:11.926003009Z │ 144 │ │ 2025-03-25T15:47:11.926004185Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:11.926005736Z │ 146 │ │ try: │ 2025-03-25T15:47:11.926006972Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:11.926008318Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:11.926009649Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:11.926010935Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:11.926012207Z │ │ 2025-03-25T15:47:11.926013330Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:11.926014476Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:11.926015771Z │ │ 2025-03-25T15:47:11.926016878Z │ 63 │ │ 2025-03-25T15:47:11.926018047Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:11.926019321Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:11.926021731Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:11.926023263Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:11.926024532Z │ 68 │ │ 2025-03-25T15:47:11.926025733Z │ 69 │ def run(self): │ 2025-03-25T15:47:11.926027002Z │ │ 2025-03-25T15:47:11.926028144Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:11.926029312Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:11.926030577Z │ │ 2025-03-25T15:47:11.926031714Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:11.926033086Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:11.926034332Z │ 56 │ │ else: │ 2025-03-25T15:47:11.926035602Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:11.926036935Z │ 58 │ 2025-03-25T15:47:11.926038123Z │ 59 │ 2025-03-25T15:47:11.926039249Z │ 60 def run(prog=None): │ 2025-03-25T15:47:11.926041476Z │ │ 2025-03-25T15:47:11.926042697Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:11.926043851Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:11.926045118Z │ │ 2025-03-25T15:47:11.926046233Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:11.926047612Z │ 45 │ │ 2025-03-25T15:47:11.926048766Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:11.926050089Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:11.926051461Z │ 48 │ │ 2025-03-25T15:47:11.926052697Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:11.926054047Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:11.926055412Z │ │ 2025-03-25T15:47:11.926056532Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:11.926057834Z │ til.py:370 in import_app │ 2025-03-25T15:47:11.926059126Z │ │ 2025-03-25T15:47:11.926061347Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:11.926062638Z │ 368 │ │ 2025-03-25T15:47:11.926063808Z │ 369 │ try: │ 2025-03-25T15:47:11.926064997Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:11.926066180Z │ 371 │ except ImportError: │ 2025-03-25T15:47:11.926067471Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:11.926068880Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:11.926070214Z │ │ 2025-03-25T15:47:11.926071296Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:11.926072560Z │ in import_module │ 2025-03-25T15:47:11.926073758Z │ │ 2025-03-25T15:47:11.926074858Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:11.926076290Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:11.926077500Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:11.926081411Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:11.926084907Z │ 127 │ 2025-03-25T15:47:11.926086784Z │ 128 │ 2025-03-25T15:47:11.926088548Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:11.926090848Z │ in _gcd_import:1204 │ 2025-03-25T15:47:11.926092106Z │ in _find_and_load:1176 │ 2025-03-25T15:47:11.926093327Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:11.926094554Z │ in _load_unlocked:690 │ 2025-03-25T15:47:11.926095750Z │ in exec_module:940 │ 2025-03-25T15:47:11.926096948Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:11.926098147Z │ │ 2025-03-25T15:47:11.926099261Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:11.926100524Z │ <module> │ 2025-03-25T15:47:11.926101757Z │ │ 2025-03-25T15:47:11.926102870Z │ 13 import orjson │ 2025-03-25T15:47:11.926104101Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:11.926105606Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:11.926107862Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:11.926109405Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:11.926110768Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:11.926114586Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:11.926116024Z │ │ 2025-03-25T15:47:11.926118687Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:11.926119987Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:11.926121306Z │ │ 2025-03-25T15:47:11.926122441Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:11.926123838Z │ 55 │ 2025-03-25T15:47:11.926124992Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:11.926126187Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:11.926127500Z │ 58 │ 2025-03-25T15:47:11.926128846Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:11.926131657Z │ F401 │ 2025-03-25T15:47:11.926132909Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:11.926134208Z │ │ 2025-03-25T15:47:11.926135358Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:11.926136556Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:11.926137821Z │ │ 2025-03-25T15:47:11.926138936Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:11.926140151Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:11.926141327Z │ 22 try: │ 2025-03-25T15:47:11.926143322Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:11.926145442Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:11.926147576Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:11.926150052Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:11.926151853Z │ │ 2025-03-25T15:47:11.926154086Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:11.926155273Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:11.926156631Z │ │ 2025-03-25T15:47:11.926157788Z │ 29 │ 2025-03-25T15:47:11.926158960Z │ 30 │ 2025-03-25T15:47:11.926160090Z │ 31 │ 2025-03-25T15:47:11.926161295Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:11.926162812Z │ 33 │ 2025-03-25T15:47:11.926163980Z │ 34 │ 2025-03-25T15:47:11.926165165Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:11.926166416Z ImportError: 2025-03-25T15:47:11.926167550Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:11.926168679Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:11.926170028Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:11.926171332Z shared object requires: Invalid argument 2025-03-25T15:47:11.926548703Z [03/25/25 15:47:11] INFO Worker exiting (pid: 2786) 2025-03-25T15:47:11.971924234Z [03/25/25 15:47:11] ERROR Worker (pid:2786) exited with code 3 2025-03-25T15:47:11.972424932Z [03/25/25 15:47:11] ERROR Shutting down: Master 2025-03-25T15:47:11.972788926Z [03/25/25 15:47:11] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:13.651203810Z [03/25/25 15:47:13] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:13.651858802Z [03/25/25 15:47:13] INFO Listening at: http://0.0.0.0:3003 (2788) 2025-03-25T15:47:13.652275096Z [03/25/25 15:47:13] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:13.655387205Z [03/25/25 15:47:13] INFO Booting worker with pid: 2791 2025-03-25T15:47:13.938054256Z [03/25/25 15:47:13] ERROR Exception in worker process 2025-03-25T15:47:13.938069369Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:13.938072202Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:13.938080116Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:13.938081907Z │ │ 2025-03-25T15:47:13.938083439Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:13.938085324Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:13.938087027Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:13.938088609Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:13.938090216Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:13.938097239Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:13.938099039Z │ 611 │ │ │ raise │ 2025-03-25T15:47:13.938102748Z │ │ 2025-03-25T15:47:13.938104129Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:13.938106611Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:13.938108352Z │ │ 2025-03-25T15:47:13.938109751Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:13.938111298Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:13.938112872Z │ 134 │ │ │ 2025-03-25T15:47:13.938114340Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:13.938116232Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:13.938117789Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:13.938119298Z │ 138 │ 2025-03-25T15:47:13.938120768Z │ │ 2025-03-25T15:47:13.938122124Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:13.938123633Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:13.938126961Z │ │ 2025-03-25T15:47:13.938128385Z │ 144 │ │ 2025-03-25T15:47:13.938129885Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:13.938131671Z │ 146 │ │ try: │ 2025-03-25T15:47:13.938133176Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:13.938134803Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:13.938136412Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:13.938137955Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:13.938140076Z │ │ 2025-03-25T15:47:13.938141503Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:13.938142942Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:13.938144482Z │ │ 2025-03-25T15:47:13.938145850Z │ 63 │ │ 2025-03-25T15:47:13.938147324Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:13.938148843Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:13.938151849Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:13.938153715Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:13.938155306Z │ 68 │ │ 2025-03-25T15:47:13.938156803Z │ 69 │ def run(self): │ 2025-03-25T15:47:13.938158362Z │ │ 2025-03-25T15:47:13.938159704Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:13.938161142Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:13.938162665Z │ │ 2025-03-25T15:47:13.938164057Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:13.938165780Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:13.938167326Z │ 56 │ │ else: │ 2025-03-25T15:47:13.938168942Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:13.938170594Z │ 58 │ 2025-03-25T15:47:13.938171984Z │ 59 │ 2025-03-25T15:47:13.938173387Z │ 60 def run(prog=None): │ 2025-03-25T15:47:13.938177085Z │ │ 2025-03-25T15:47:13.938178368Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:13.938179601Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:13.938180911Z │ │ 2025-03-25T15:47:13.938182060Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:13.938183437Z │ 45 │ │ 2025-03-25T15:47:13.938184622Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:13.938185979Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:13.938187366Z │ 48 │ │ 2025-03-25T15:47:13.938188547Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:13.938189883Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:13.938191295Z │ │ 2025-03-25T15:47:13.938192450Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:13.938193694Z │ til.py:370 in import_app │ 2025-03-25T15:47:13.938195014Z │ │ 2025-03-25T15:47:13.938197280Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:13.938198633Z │ 368 │ │ 2025-03-25T15:47:13.938199827Z │ 369 │ try: │ 2025-03-25T15:47:13.938201065Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:13.938202318Z │ 371 │ except ImportError: │ 2025-03-25T15:47:13.938203569Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:13.938205013Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:13.938206592Z │ │ 2025-03-25T15:47:13.938207786Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:13.938209127Z │ in import_module │ 2025-03-25T15:47:13.938210396Z │ │ 2025-03-25T15:47:13.938211594Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:13.938212961Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:13.938214184Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:13.938215452Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:13.938218059Z │ 127 │ 2025-03-25T15:47:13.938219383Z │ 128 │ 2025-03-25T15:47:13.938220641Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:13.938221788Z │ in _gcd_import:1204 │ 2025-03-25T15:47:13.938222996Z │ in _find_and_load:1176 │ 2025-03-25T15:47:13.938224234Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:13.938225451Z │ in _load_unlocked:690 │ 2025-03-25T15:47:13.938226648Z │ in exec_module:940 │ 2025-03-25T15:47:13.938227856Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:13.938229087Z │ │ 2025-03-25T15:47:13.938230213Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:13.938231464Z │ <module> │ 2025-03-25T15:47:13.938232713Z │ │ 2025-03-25T15:47:13.938233835Z │ 13 import orjson │ 2025-03-25T15:47:13.938235065Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:13.938236498Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:13.938238944Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:13.938240492Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:13.938241822Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:13.938243105Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:13.938244482Z │ │ 2025-03-25T15:47:13.938245733Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:13.938246936Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:13.938248288Z │ │ 2025-03-25T15:47:13.938249416Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:13.938250824Z │ 55 │ 2025-03-25T15:47:13.938251994Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:13.938253218Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:13.938254583Z │ 58 │ 2025-03-25T15:47:13.938255894Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:13.938258332Z │ F401 │ 2025-03-25T15:47:13.938259558Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:13.938260889Z │ │ 2025-03-25T15:47:13.938262037Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:13.938263256Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:13.938264559Z │ │ 2025-03-25T15:47:13.938265679Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:13.938266940Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:13.938268164Z │ 22 try: │ 2025-03-25T15:47:13.938269369Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:13.938270775Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:13.938272199Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:13.938273664Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:13.938275076Z │ │ 2025-03-25T15:47:13.938277079Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:13.938278321Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:13.938279674Z │ │ 2025-03-25T15:47:13.938280801Z │ 29 │ 2025-03-25T15:47:13.938281961Z │ 30 │ 2025-03-25T15:47:13.938283110Z │ 31 │ 2025-03-25T15:47:13.938284270Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:13.938285751Z │ 33 │ 2025-03-25T15:47:13.938286902Z │ 34 │ 2025-03-25T15:47:13.938288049Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:13.938289339Z ImportError: 2025-03-25T15:47:13.938290506Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:13.938291598Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:13.938292735Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:13.938294039Z shared object requires: Invalid argument 2025-03-25T15:47:13.938661221Z [03/25/25 15:47:13] INFO Worker exiting (pid: 2791) 2025-03-25T15:47:13.986986561Z [03/25/25 15:47:13] ERROR Worker (pid:2791) exited with code 3 2025-03-25T15:47:13.987893373Z [03/25/25 15:47:13] ERROR Shutting down: Master 2025-03-25T15:47:13.988506410Z [03/25/25 15:47:13] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:15.567483421Z [03/25/25 15:47:15] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:15.568143301Z [03/25/25 15:47:15] INFO Listening at: http://0.0.0.0:3003 (2793) 2025-03-25T15:47:15.568553450Z [03/25/25 15:47:15] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:15.571468999Z [03/25/25 15:47:15] INFO Booting worker with pid: 2796 2025-03-25T15:47:15.851141837Z [03/25/25 15:47:15] ERROR Exception in worker process 2025-03-25T15:47:15.851164461Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:15.851169382Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:15.851172186Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:15.851174760Z │ │ 2025-03-25T15:47:15.851177060Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:15.851179653Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:15.851182266Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:15.851400272Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:15.851404454Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:15.851414190Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:15.851417107Z │ 611 │ │ │ raise │ 2025-03-25T15:47:15.851419529Z │ │ 2025-03-25T15:47:15.851421747Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:15.851425207Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:15.851427821Z │ │ 2025-03-25T15:47:15.851429934Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:15.851432191Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:15.851434445Z │ 134 │ │ │ 2025-03-25T15:47:15.851436706Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:15.851439027Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:15.851441344Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:15.851443593Z │ 138 │ 2025-03-25T15:47:15.851445778Z │ │ 2025-03-25T15:47:15.851447847Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:15.851450060Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:15.851454848Z │ │ 2025-03-25T15:47:15.851457160Z │ 144 │ │ 2025-03-25T15:47:15.851459435Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:15.851462161Z │ 146 │ │ try: │ 2025-03-25T15:47:15.851464457Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:15.851466818Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:15.851469188Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:15.851471598Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:15.851473835Z │ │ 2025-03-25T15:47:15.851475866Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:15.851477977Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:15.851480644Z │ │ 2025-03-25T15:47:15.851482681Z │ 63 │ │ 2025-03-25T15:47:15.851484873Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:15.851487246Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:15.851492262Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:15.851495360Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:15.851497801Z │ 68 │ │ 2025-03-25T15:47:15.851500018Z │ 69 │ def run(self): │ 2025-03-25T15:47:15.851502367Z │ │ 2025-03-25T15:47:15.851504438Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:15.851506566Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:15.851508898Z │ │ 2025-03-25T15:47:15.851510978Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:15.851513510Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:15.851515935Z │ 56 │ │ else: │ 2025-03-25T15:47:15.851518252Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:15.851520684Z │ 58 │ 2025-03-25T15:47:15.851522871Z │ 59 │ 2025-03-25T15:47:15.851525033Z │ 60 def run(prog=None): │ 2025-03-25T15:47:15.851529381Z │ │ 2025-03-25T15:47:15.851531920Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:15.851534211Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:15.851536554Z │ │ 2025-03-25T15:47:15.851538618Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:15.851541017Z │ 45 │ │ 2025-03-25T15:47:15.851543174Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:15.851686817Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:15.851690891Z │ 48 │ │ 2025-03-25T15:47:15.851693345Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:15.851695956Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:15.851698641Z │ │ 2025-03-25T15:47:15.851700960Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:15.851703235Z │ til.py:370 in import_app │ 2025-03-25T15:47:15.851705571Z │ │ 2025-03-25T15:47:15.851711247Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:15.851713989Z │ 368 │ │ 2025-03-25T15:47:15.851716302Z │ 369 │ try: │ 2025-03-25T15:47:15.851718581Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:15.851720767Z │ 371 │ except ImportError: │ 2025-03-25T15:47:15.851723198Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:15.851725786Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:15.851728218Z │ │ 2025-03-25T15:47:15.851730233Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:15.851732513Z │ in import_module │ 2025-03-25T15:47:15.851734683Z │ │ 2025-03-25T15:47:15.851736741Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:15.851739141Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:15.851741350Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:15.851743562Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:15.851747827Z │ 127 │ 2025-03-25T15:47:15.851750181Z │ 128 │ 2025-03-25T15:47:15.851752279Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:15.851754391Z │ in _gcd_import:1204 │ 2025-03-25T15:47:15.851916699Z │ in _find_and_load:1176 │ 2025-03-25T15:47:15.851921558Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:15.851924145Z │ in _load_unlocked:690 │ 2025-03-25T15:47:15.851926505Z │ in exec_module:940 │ 2025-03-25T15:47:15.851928714Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:15.851930978Z │ │ 2025-03-25T15:47:15.851933106Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:15.851935619Z │ <module> │ 2025-03-25T15:47:15.851937860Z │ │ 2025-03-25T15:47:15.851939990Z │ 13 import orjson │ 2025-03-25T15:47:15.851942288Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:15.851945740Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:15.851952808Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:15.851955801Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:15.851958290Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:15.851960657Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:15.851963133Z │ │ 2025-03-25T15:47:15.851965200Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:15.851967363Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:15.851969706Z │ │ 2025-03-25T15:47:15.851971817Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:15.851974244Z │ 55 │ 2025-03-25T15:47:15.851976365Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:15.851978576Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:15.851980924Z │ 58 │ 2025-03-25T15:47:15.851983354Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:15.851987939Z │ F401 │ 2025-03-25T15:47:15.851990281Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:15.851992747Z │ │ 2025-03-25T15:47:15.851994807Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:15.851996980Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:15.851999393Z │ │ 2025-03-25T15:47:15.852001436Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:15.852003639Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:15.852005771Z │ 22 try: │ 2025-03-25T15:47:15.852007904Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:15.852010595Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:15.852013143Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:15.852015907Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:15.852018394Z │ │ 2025-03-25T15:47:15.852023624Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:15.852025991Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:15.852028461Z │ │ 2025-03-25T15:47:15.852030569Z │ 29 │ 2025-03-25T15:47:15.852032673Z │ 30 │ 2025-03-25T15:47:15.852034722Z │ 31 │ 2025-03-25T15:47:15.852036776Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:15.852039464Z │ 33 │ 2025-03-25T15:47:15.852041489Z │ 34 │ 2025-03-25T15:47:15.852043502Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:15.852045748Z ImportError: 2025-03-25T15:47:15.852047769Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:15.852049734Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:15.852051812Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:15.852054270Z shared object requires: Invalid argument 2025-03-25T15:47:15.852056408Z [03/25/25 15:47:15] INFO Worker exiting (pid: 2796) 2025-03-25T15:47:15.903999376Z [03/25/25 15:47:15] ERROR Worker (pid:2796) exited with code 3 2025-03-25T15:47:15.904904277Z [03/25/25 15:47:15] ERROR Shutting down: Master 2025-03-25T15:47:15.905541447Z [03/25/25 15:47:15] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:17.502861481Z [03/25/25 15:47:17] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:17.503488256Z [03/25/25 15:47:17] INFO Listening at: http://0.0.0.0:3003 (2798) 2025-03-25T15:47:17.503907153Z [03/25/25 15:47:17] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:17.507904238Z [03/25/25 15:47:17] INFO Booting worker with pid: 2801 2025-03-25T15:47:17.831437316Z [03/25/25 15:47:17] ERROR Exception in worker process 2025-03-25T15:47:17.831458908Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:17.831463693Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:17.831466407Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:17.831468912Z │ │ 2025-03-25T15:47:17.831471180Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:17.831473846Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:17.831476367Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:17.831478873Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:17.831481191Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:17.831491152Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:17.831494051Z │ 611 │ │ │ raise │ 2025-03-25T15:47:17.831496355Z │ │ 2025-03-25T15:47:17.831498416Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:17.831501541Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:17.831504197Z │ │ 2025-03-25T15:47:17.831506373Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:17.831508625Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:17.831510860Z │ 134 │ │ │ 2025-03-25T15:47:17.831513049Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:17.831515377Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:17.831517618Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:17.831519779Z │ 138 │ 2025-03-25T15:47:17.831521849Z │ │ 2025-03-25T15:47:17.831523893Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:17.831525959Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:17.831530543Z │ │ 2025-03-25T15:47:17.831532894Z │ 144 │ │ 2025-03-25T15:47:17.831535101Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:17.831537827Z │ 146 │ │ try: │ 2025-03-25T15:47:17.831540121Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:17.831542440Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:17.831545064Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:17.831547474Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:17.831549843Z │ │ 2025-03-25T15:47:17.831551932Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:17.831554019Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:17.831556261Z │ │ 2025-03-25T15:47:17.831558264Z │ 63 │ │ 2025-03-25T15:47:17.831560392Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:17.831562831Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:17.831567236Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:17.831570237Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:17.831572605Z │ 68 │ │ 2025-03-25T15:47:17.831574802Z │ 69 │ def run(self): │ 2025-03-25T15:47:17.831577067Z │ │ 2025-03-25T15:47:17.831579127Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:17.831581446Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:17.831583712Z │ │ 2025-03-25T15:47:17.831585694Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:17.831588132Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:17.831590328Z │ 56 │ │ else: │ 2025-03-25T15:47:17.831592519Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:17.831594898Z │ 58 │ 2025-03-25T15:47:17.831597007Z │ 59 │ 2025-03-25T15:47:17.831599077Z │ 60 def run(prog=None): │ 2025-03-25T15:47:17.831603259Z │ │ 2025-03-25T15:47:17.831605792Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:17.831608042Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:17.831610322Z │ │ 2025-03-25T15:47:17.831612326Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:17.831614664Z │ 45 │ │ 2025-03-25T15:47:17.831616784Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:17.831619041Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:17.831621501Z │ 48 │ │ 2025-03-25T15:47:17.831623651Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:17.831625928Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:17.831628350Z │ │ 2025-03-25T15:47:17.831630353Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:17.831632529Z │ til.py:370 in import_app │ 2025-03-25T15:47:17.831634806Z │ │ 2025-03-25T15:47:17.831638981Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:17.831641548Z │ 368 │ │ 2025-03-25T15:47:17.831643782Z │ 369 │ try: │ 2025-03-25T15:47:17.831645965Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:17.831648058Z │ 371 │ except ImportError: │ 2025-03-25T15:47:17.831650359Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:17.831652836Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:17.831655151Z │ │ 2025-03-25T15:47:17.831657117Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:17.831659331Z │ in import_module │ 2025-03-25T15:47:17.831661451Z │ │ 2025-03-25T15:47:17.831663419Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:17.831665813Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:17.831667967Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:17.831670113Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:17.831674292Z │ 127 │ 2025-03-25T15:47:17.831676632Z │ 128 │ 2025-03-25T15:47:17.831678749Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:17.831680798Z │ in _gcd_import:1204 │ 2025-03-25T15:47:17.831682922Z │ in _find_and_load:1176 │ 2025-03-25T15:47:17.831685035Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:17.831687140Z │ in _load_unlocked:690 │ 2025-03-25T15:47:17.831692142Z │ in exec_module:940 │ 2025-03-25T15:47:17.831694649Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:17.831696832Z │ │ 2025-03-25T15:47:17.831698836Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:17.831701068Z │ <module> │ 2025-03-25T15:47:17.831703159Z │ │ 2025-03-25T15:47:17.831705236Z │ 13 import orjson │ 2025-03-25T15:47:17.831707493Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:17.831710140Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:17.831714603Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:17.831717462Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:17.831719892Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:17.831722191Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:17.831724610Z │ │ 2025-03-25T15:47:17.831726790Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:17.831728884Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:17.831731250Z │ │ 2025-03-25T15:47:17.831733295Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:17.831735677Z │ 55 │ 2025-03-25T15:47:17.831737799Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:17.831739969Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:17.831742286Z │ 58 │ 2025-03-25T15:47:17.831744563Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:17.831748757Z │ F401 │ 2025-03-25T15:47:17.831751034Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:17.831753473Z │ │ 2025-03-25T15:47:17.831755535Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:17.831757676Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:17.831760042Z │ │ 2025-03-25T15:47:17.831762014Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:17.831764141Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:17.831766220Z │ 22 try: │ 2025-03-25T15:47:17.831768380Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:17.831770972Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:17.831773486Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:17.831776115Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:17.831778661Z │ │ 2025-03-25T15:47:17.831782660Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:17.831784871Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:17.831787122Z │ │ 2025-03-25T15:47:17.831789126Z │ 29 │ 2025-03-25T15:47:17.831791180Z │ 30 │ 2025-03-25T15:47:17.831793198Z │ 31 │ 2025-03-25T15:47:17.831795336Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:17.831797915Z │ 33 │ 2025-03-25T15:47:17.831799952Z │ 34 │ 2025-03-25T15:47:17.831802063Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:17.831804325Z ImportError: 2025-03-25T15:47:17.831806311Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:17.831808339Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:17.831810465Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:17.831812752Z shared object requires: Invalid argument 2025-03-25T15:47:17.832050166Z [03/25/25 15:47:17] INFO Worker exiting (pid: 2801) 2025-03-25T15:47:17.877432772Z [03/25/25 15:47:17] ERROR Worker (pid:2801) exited with code 3 2025-03-25T15:47:17.877992960Z [03/25/25 15:47:17] ERROR Shutting down: Master 2025-03-25T15:47:17.878541379Z [03/25/25 15:47:17] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:19.470312323Z [03/25/25 15:47:19] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:19.470961291Z [03/25/25 15:47:19] INFO Listening at: http://0.0.0.0:3003 (2803) 2025-03-25T15:47:19.471378052Z [03/25/25 15:47:19] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:19.475059335Z [03/25/25 15:47:19] INFO Booting worker with pid: 2806 2025-03-25T15:47:19.766480494Z [03/25/25 15:47:19] ERROR Exception in worker process 2025-03-25T15:47:19.766497907Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:19.766500439Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:19.766501994Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:19.766503404Z │ │ 2025-03-25T15:47:19.766504646Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:19.766506287Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:19.766507708Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:19.766509131Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:19.766510450Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:19.766516222Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:19.766517638Z │ 611 │ │ │ raise │ 2025-03-25T15:47:19.766518935Z │ │ 2025-03-25T15:47:19.766520081Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:19.766522359Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:19.766523728Z │ │ 2025-03-25T15:47:19.766524862Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:19.766526096Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:19.766527364Z │ 134 │ │ │ 2025-03-25T15:47:19.766528682Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:19.766529995Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:19.766531289Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:19.766532530Z │ 138 │ 2025-03-25T15:47:19.766533743Z │ │ 2025-03-25T15:47:19.766534898Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:19.766536122Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:19.766538560Z │ │ 2025-03-25T15:47:19.766539710Z │ 144 │ │ 2025-03-25T15:47:19.766540971Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:19.766542425Z │ 146 │ │ try: │ 2025-03-25T15:47:19.766543682Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:19.766545036Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:19.766546389Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:19.766547689Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:19.766548957Z │ │ 2025-03-25T15:47:19.766550082Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:19.766551254Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:19.766552542Z │ │ 2025-03-25T15:47:19.766553711Z │ 63 │ │ 2025-03-25T15:47:19.766554904Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:19.766556207Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:19.766558560Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:19.766560123Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:19.766561425Z │ 68 │ │ 2025-03-25T15:47:19.766562641Z │ 69 │ def run(self): │ 2025-03-25T15:47:19.766563936Z │ │ 2025-03-25T15:47:19.766565072Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:19.766566272Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:19.766567576Z │ │ 2025-03-25T15:47:19.766568725Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:19.766570121Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:19.766571435Z │ 56 │ │ else: │ 2025-03-25T15:47:19.766572672Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:19.766574030Z │ 58 │ 2025-03-25T15:47:19.766575255Z │ 59 │ 2025-03-25T15:47:19.766577323Z │ 60 def run(prog=None): │ 2025-03-25T15:47:19.766578644Z │ │ 2025-03-25T15:47:19.766579892Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:19.766581087Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:19.766582375Z │ │ 2025-03-25T15:47:19.766583537Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:19.766584875Z │ 45 │ │ 2025-03-25T15:47:19.766586117Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:19.766587445Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:19.766588840Z │ 48 │ │ 2025-03-25T15:47:19.766590043Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:19.766591397Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:19.766592767Z │ │ 2025-03-25T15:47:19.766593886Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:19.766595146Z │ til.py:370 in import_app │ 2025-03-25T15:47:19.766597389Z │ │ 2025-03-25T15:47:19.766598635Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:19.766599919Z │ 368 │ │ 2025-03-25T15:47:19.766601090Z │ 369 │ try: │ 2025-03-25T15:47:19.766602334Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:19.766603548Z │ 371 │ except ImportError: │ 2025-03-25T15:47:19.766604818Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:19.766606273Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:19.766607590Z │ │ 2025-03-25T15:47:19.766608732Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:19.766610033Z │ in import_module │ 2025-03-25T15:47:19.766611240Z │ │ 2025-03-25T15:47:19.766612394Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:19.766613772Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:19.766618189Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:19.766619439Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:19.766621751Z │ 127 │ 2025-03-25T15:47:19.766622970Z │ 128 │ 2025-03-25T15:47:19.766624188Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:19.766625398Z │ in _gcd_import:1204 │ 2025-03-25T15:47:19.766626630Z │ in _find_and_load:1176 │ 2025-03-25T15:47:19.766627862Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:19.766629061Z │ in _load_unlocked:690 │ 2025-03-25T15:47:19.766630285Z │ in exec_module:940 │ 2025-03-25T15:47:19.766631507Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:19.766632719Z │ │ 2025-03-25T15:47:19.766633848Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:19.766635095Z │ <module> │ 2025-03-25T15:47:19.766636371Z │ │ 2025-03-25T15:47:19.766637484Z │ 13 import orjson │ 2025-03-25T15:47:19.766638727Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:19.766640184Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:19.766642659Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:19.766644163Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:19.766645546Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:19.766647042Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:19.766648398Z │ │ 2025-03-25T15:47:19.766649523Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:19.766650691Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:19.766652007Z │ │ 2025-03-25T15:47:19.766653185Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:19.766654567Z │ 55 │ 2025-03-25T15:47:19.766655725Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:19.766656917Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:19.766658262Z │ 58 │ 2025-03-25T15:47:19.766659535Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:19.766661794Z │ F401 │ 2025-03-25T15:47:19.766662983Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:19.766664313Z │ │ 2025-03-25T15:47:19.766665488Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:19.766666676Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:19.766667955Z │ │ 2025-03-25T15:47:19.766669087Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:19.766670290Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:19.766671503Z │ 22 try: │ 2025-03-25T15:47:19.766672727Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:19.766674179Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:19.766675615Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:19.766677162Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:19.766678562Z │ │ 2025-03-25T15:47:19.766680724Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:19.766683085Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:19.766684400Z │ │ 2025-03-25T15:47:19.766685613Z │ 29 │ 2025-03-25T15:47:19.766686845Z │ 30 │ 2025-03-25T15:47:19.766688015Z │ 31 │ 2025-03-25T15:47:19.766689217Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:19.766690756Z │ 33 │ 2025-03-25T15:47:19.766691917Z │ 34 │ 2025-03-25T15:47:19.766693084Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:19.766694345Z ImportError: 2025-03-25T15:47:19.766695513Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:19.766696671Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:19.766697839Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:19.766699154Z shared object requires: Invalid argument 2025-03-25T15:47:19.767106715Z [03/25/25 15:47:19] INFO Worker exiting (pid: 2806) 2025-03-25T15:47:19.824695802Z [03/25/25 15:47:19] ERROR Worker (pid:2806) exited with code 3 2025-03-25T15:47:19.825218348Z [03/25/25 15:47:19] ERROR Shutting down: Master 2025-03-25T15:47:19.825546503Z [03/25/25 15:47:19] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:21.419164291Z [03/25/25 15:47:21] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:21.420004647Z [03/25/25 15:47:21] INFO Listening at: http://0.0.0.0:3003 (2808) 2025-03-25T15:47:21.420411823Z [03/25/25 15:47:21] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:21.423997900Z [03/25/25 15:47:21] INFO Booting worker with pid: 2811 2025-03-25T15:47:21.707117818Z [03/25/25 15:47:21] ERROR Exception in worker process 2025-03-25T15:47:21.707141130Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:21.707144065Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:21.707145652Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:21.707147294Z │ │ 2025-03-25T15:47:21.707148577Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:21.707150191Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:21.707151651Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:21.707152956Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:21.707154240Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:21.707160873Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:21.707162247Z │ 611 │ │ │ raise │ 2025-03-25T15:47:21.707163589Z │ │ 2025-03-25T15:47:21.707164776Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:21.707166587Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:21.707167943Z │ │ 2025-03-25T15:47:21.707169088Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:21.707170314Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:21.707171607Z │ 134 │ │ │ 2025-03-25T15:47:21.707339395Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:21.707340880Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:21.707342254Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:21.707343490Z │ 138 │ 2025-03-25T15:47:21.707344670Z │ │ 2025-03-25T15:47:21.707345850Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:21.707348378Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:21.707349737Z │ │ 2025-03-25T15:47:21.707350842Z │ 144 │ │ 2025-03-25T15:47:21.707352074Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:21.707353629Z │ 146 │ │ try: │ 2025-03-25T15:47:21.707354900Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:21.707356271Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:21.707357658Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:21.707358953Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:21.707360222Z │ │ 2025-03-25T15:47:21.707361366Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:21.707362538Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:21.707363818Z │ │ 2025-03-25T15:47:21.707364941Z │ 63 │ │ 2025-03-25T15:47:21.707366169Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:21.707367471Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:21.707369911Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:21.707371502Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:21.707372755Z │ 68 │ │ 2025-03-25T15:47:21.707373979Z │ 69 │ def run(self): │ 2025-03-25T15:47:21.707375291Z │ │ 2025-03-25T15:47:21.707376424Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:21.707377614Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:21.707378916Z │ │ 2025-03-25T15:47:21.707380036Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:21.707381419Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:21.707382733Z │ 56 │ │ else: │ 2025-03-25T15:47:21.707384021Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:21.707385407Z │ 58 │ 2025-03-25T15:47:21.707386639Z │ 59 │ 2025-03-25T15:47:21.707388693Z │ 60 def run(prog=None): │ 2025-03-25T15:47:21.707389989Z │ │ 2025-03-25T15:47:21.707391281Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:21.707392474Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:21.707393792Z │ │ 2025-03-25T15:47:21.707394956Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:21.707396274Z │ 45 │ │ 2025-03-25T15:47:21.707397495Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:21.707398797Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:21.707400211Z │ 48 │ │ 2025-03-25T15:47:21.707401418Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:21.707402773Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:21.707404188Z │ │ 2025-03-25T15:47:21.707405333Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:21.707406575Z │ til.py:370 in import_app │ 2025-03-25T15:47:21.707408922Z │ │ 2025-03-25T15:47:21.707410220Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:21.707411537Z │ 368 │ │ 2025-03-25T15:47:21.707412763Z │ 369 │ try: │ 2025-03-25T15:47:21.707414009Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:21.707415236Z │ 371 │ except ImportError: │ 2025-03-25T15:47:21.707416528Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:21.707417965Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:21.707419333Z │ │ 2025-03-25T15:47:21.707420456Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:21.707421784Z │ in import_module │ 2025-03-25T15:47:21.707422973Z │ │ 2025-03-25T15:47:21.707424109Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:21.707425453Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:21.707426738Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:21.707427951Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:21.707430384Z │ 127 │ 2025-03-25T15:47:21.707431581Z │ 128 │ 2025-03-25T15:47:21.707432724Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:21.707433895Z │ in _gcd_import:1204 │ 2025-03-25T15:47:21.707435121Z │ in _find_and_load:1176 │ 2025-03-25T15:47:21.707436348Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:21.707437560Z │ in _load_unlocked:690 │ 2025-03-25T15:47:21.707438773Z │ in exec_module:940 │ 2025-03-25T15:47:21.707439997Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:21.707441203Z │ │ 2025-03-25T15:47:21.707442374Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:21.707443634Z │ <module> │ 2025-03-25T15:47:21.707444886Z │ │ 2025-03-25T15:47:21.707445999Z │ 13 import orjson │ 2025-03-25T15:47:21.707447265Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:21.707448742Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:21.707451125Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:21.707452649Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:21.707453958Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:21.707455233Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:21.707456595Z │ │ 2025-03-25T15:47:21.707457757Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:21.707458953Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:21.707460267Z │ │ 2025-03-25T15:47:21.707461417Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:21.707462822Z │ 55 │ 2025-03-25T15:47:21.707463975Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:21.707465289Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:21.707466617Z │ 58 │ 2025-03-25T15:47:21.707467956Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:21.707471611Z │ F401 │ 2025-03-25T15:47:21.707472811Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:21.707474138Z │ │ 2025-03-25T15:47:21.707475300Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:21.707476515Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:21.707477796Z │ │ 2025-03-25T15:47:21.707478944Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:21.707480187Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:21.707481393Z │ 22 try: │ 2025-03-25T15:47:21.707482655Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:21.707484079Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:21.707485486Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:21.707487037Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:21.707488404Z │ │ 2025-03-25T15:47:21.707491431Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:21.707492645Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:21.707494000Z │ │ 2025-03-25T15:47:21.707495185Z │ 29 │ 2025-03-25T15:47:21.707496371Z │ 30 │ 2025-03-25T15:47:21.707497530Z │ 31 │ 2025-03-25T15:47:21.707498696Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:21.707500207Z │ 33 │ 2025-03-25T15:47:21.707501354Z │ 34 │ 2025-03-25T15:47:21.707502494Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:21.707503778Z ImportError: 2025-03-25T15:47:21.707504946Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:21.707506073Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:21.707507226Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:21.707508518Z shared object requires: Invalid argument 2025-03-25T15:47:21.707917125Z [03/25/25 15:47:21] INFO Worker exiting (pid: 2811) 2025-03-25T15:47:21.768680272Z [03/25/25 15:47:21] ERROR Worker (pid:2811) exited with code 3 2025-03-25T15:47:21.769210989Z [03/25/25 15:47:21] ERROR Shutting down: Master 2025-03-25T15:47:21.769597357Z [03/25/25 15:47:21] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:23.351466399Z [03/25/25 15:47:23] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:23.352076173Z [03/25/25 15:47:23] INFO Listening at: http://0.0.0.0:3003 (2813) 2025-03-25T15:47:23.352470615Z [03/25/25 15:47:23] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:23.355268340Z [03/25/25 15:47:23] INFO Booting worker with pid: 2816 2025-03-25T15:47:23.640120899Z [03/25/25 15:47:23] ERROR Exception in worker process 2025-03-25T15:47:23.640140938Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:23.640144154Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:23.640145764Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:23.640147157Z │ │ 2025-03-25T15:47:23.640148397Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:23.640149917Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:23.640151357Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:23.640152632Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:23.640153952Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:23.640162144Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:23.640163520Z │ 611 │ │ │ raise │ 2025-03-25T15:47:23.640164908Z │ │ 2025-03-25T15:47:23.640166119Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:23.640167895Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:23.640169305Z │ │ 2025-03-25T15:47:23.640170458Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:23.640171860Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:23.640173419Z │ 134 │ │ │ 2025-03-25T15:47:23.640174634Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:23.640175969Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:23.640177270Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:23.640178527Z │ 138 │ 2025-03-25T15:47:23.640179680Z │ │ 2025-03-25T15:47:23.640180843Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:23.640183346Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:23.640184676Z │ │ 2025-03-25T15:47:23.640185795Z │ 144 │ │ 2025-03-25T15:47:23.640187014Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:23.640188576Z │ 146 │ │ try: │ 2025-03-25T15:47:23.640189833Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:23.640191162Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:23.640192519Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:23.640193818Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:23.640195131Z │ │ 2025-03-25T15:47:23.640196299Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:23.640197461Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:23.640198747Z │ │ 2025-03-25T15:47:23.640199939Z │ 63 │ │ 2025-03-25T15:47:23.640201131Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:23.640202423Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:23.640205074Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:23.640206597Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:23.640207882Z │ 68 │ │ 2025-03-25T15:47:23.640209112Z │ 69 │ def run(self): │ 2025-03-25T15:47:23.640210411Z │ │ 2025-03-25T15:47:23.640211560Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:23.640212750Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:23.640214066Z │ │ 2025-03-25T15:47:23.640215217Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:23.640216642Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:23.640217939Z │ 56 │ │ else: │ 2025-03-25T15:47:23.640219195Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:23.640220557Z │ 58 │ 2025-03-25T15:47:23.640221742Z │ 59 │ 2025-03-25T15:47:23.640224002Z │ 60 def run(prog=None): │ 2025-03-25T15:47:23.640225351Z │ │ 2025-03-25T15:47:23.640226615Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:23.640227852Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:23.640229145Z │ │ 2025-03-25T15:47:23.640230304Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:23.640231669Z │ 45 │ │ 2025-03-25T15:47:23.640232852Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:23.640234178Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:23.640235587Z │ 48 │ │ 2025-03-25T15:47:23.640236763Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:23.640238118Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:23.640239534Z │ │ 2025-03-25T15:47:23.640240659Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:23.640241863Z │ til.py:370 in import_app │ 2025-03-25T15:47:23.640244175Z │ │ 2025-03-25T15:47:23.640245423Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:23.640246726Z │ 368 │ │ 2025-03-25T15:47:23.640247951Z │ 369 │ try: │ 2025-03-25T15:47:23.640249196Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:23.640250436Z │ 371 │ except ImportError: │ 2025-03-25T15:47:23.640251723Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:23.640253129Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:23.640256590Z │ │ 2025-03-25T15:47:23.640257777Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:23.640259104Z │ in import_module │ 2025-03-25T15:47:23.640260309Z │ │ 2025-03-25T15:47:23.640261458Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:23.640262830Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:23.640264109Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:23.640266362Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:23.640267759Z │ 127 │ 2025-03-25T15:47:23.640268936Z │ 128 │ 2025-03-25T15:47:23.640270089Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:23.640271293Z │ in _gcd_import:1204 │ 2025-03-25T15:47:23.640272569Z │ in _find_and_load:1176 │ 2025-03-25T15:47:23.640273822Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:23.640275016Z │ in _load_unlocked:690 │ 2025-03-25T15:47:23.640276217Z │ in exec_module:940 │ 2025-03-25T15:47:23.640277420Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:23.640278635Z │ │ 2025-03-25T15:47:23.640279774Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:23.640281037Z │ <module> │ 2025-03-25T15:47:23.640282295Z │ │ 2025-03-25T15:47:23.640283416Z │ 13 import orjson │ 2025-03-25T15:47:23.640284643Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:23.640286088Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:23.640288594Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:23.640290154Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:23.640291497Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:23.640292796Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:23.640294238Z │ │ 2025-03-25T15:47:23.640295384Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:23.640296545Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:23.640297924Z │ │ 2025-03-25T15:47:23.640299076Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:23.640300471Z │ 55 │ 2025-03-25T15:47:23.640301621Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:23.640302826Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:23.640304171Z │ 58 │ 2025-03-25T15:47:23.640305455Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:23.640308778Z │ F401 │ 2025-03-25T15:47:23.640309977Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:23.640311331Z │ │ 2025-03-25T15:47:23.640312484Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:23.640313666Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:23.640314950Z │ │ 2025-03-25T15:47:23.640316119Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:23.640317375Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:23.640318558Z │ 22 try: │ 2025-03-25T15:47:23.640319827Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:23.640321254Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:23.640322707Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:23.640324385Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:23.640325789Z │ │ 2025-03-25T15:47:23.640328013Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:23.640329242Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:23.640330583Z │ │ 2025-03-25T15:47:23.640331736Z │ 29 │ 2025-03-25T15:47:23.640332929Z │ 30 │ 2025-03-25T15:47:23.640334102Z │ 31 │ 2025-03-25T15:47:23.640335272Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:23.640336764Z │ 33 │ 2025-03-25T15:47:23.640337945Z │ 34 │ 2025-03-25T15:47:23.640339134Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:23.640340395Z ImportError: 2025-03-25T15:47:23.640341567Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:23.640342709Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:23.640343878Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:23.640345146Z shared object requires: Invalid argument 2025-03-25T15:47:23.640737444Z [03/25/25 15:47:23] INFO Worker exiting (pid: 2816) 2025-03-25T15:47:23.687395335Z [03/25/25 15:47:23] ERROR Worker (pid:2816) exited with code 3 2025-03-25T15:47:23.687964552Z [03/25/25 15:47:23] ERROR Shutting down: Master 2025-03-25T15:47:23.688307906Z [03/25/25 15:47:23] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:25.262021766Z [03/25/25 15:47:25] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:25.262619408Z [03/25/25 15:47:25] INFO Listening at: http://0.0.0.0:3003 (2818) 2025-03-25T15:47:25.263029280Z [03/25/25 15:47:25] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:25.265943509Z [03/25/25 15:47:25] INFO Booting worker with pid: 2821 2025-03-25T15:47:25.593729932Z [03/25/25 15:47:25] ERROR Exception in worker process 2025-03-25T15:47:25.593745859Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:25.593748148Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:25.593749546Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:25.593756231Z │ │ 2025-03-25T15:47:25.593757528Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:25.593759010Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:25.593760447Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:25.593761869Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:25.593769060Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:25.593770429Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:25.593771761Z │ 611 │ │ │ raise │ 2025-03-25T15:47:25.593773054Z │ │ 2025-03-25T15:47:25.593774192Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:25.593776017Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:25.593777370Z │ │ 2025-03-25T15:47:25.593778553Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:25.593779800Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:25.593781044Z │ 134 │ │ │ 2025-03-25T15:47:25.593782246Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:25.593783529Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:25.593784782Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:25.593786001Z │ 138 │ 2025-03-25T15:47:25.593787212Z │ │ 2025-03-25T15:47:25.593788373Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:25.593791101Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:25.593792409Z │ │ 2025-03-25T15:47:25.593793560Z │ 144 │ │ 2025-03-25T15:47:25.593794792Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:25.593796234Z │ 146 │ │ try: │ 2025-03-25T15:47:25.593797510Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:25.593798848Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:25.593800224Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:25.593801544Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:25.593802790Z │ │ 2025-03-25T15:47:25.593804201Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:25.593805364Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:25.593806681Z │ │ 2025-03-25T15:47:25.593807811Z │ 63 │ │ 2025-03-25T15:47:25.593809002Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:25.593811290Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:25.593812674Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:25.593814174Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:25.593815476Z │ 68 │ │ 2025-03-25T15:47:25.593816682Z │ 69 │ def run(self): │ 2025-03-25T15:47:25.593817962Z │ │ 2025-03-25T15:47:25.593819684Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:25.593821600Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:25.593827500Z │ │ 2025-03-25T15:47:25.593829268Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:25.593831335Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:25.593833221Z │ 56 │ │ else: │ 2025-03-25T15:47:25.593834968Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:25.593837384Z │ 58 │ 2025-03-25T15:47:25.593839120Z │ 59 │ 2025-03-25T15:47:25.593842165Z │ 60 def run(prog=None): │ 2025-03-25T15:47:25.593844070Z │ │ 2025-03-25T15:47:25.593846101Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:25.593847914Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:25.593849921Z │ │ 2025-03-25T15:47:25.593851714Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:25.593853666Z │ 45 │ │ 2025-03-25T15:47:25.593855443Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:25.593857575Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:25.593859699Z │ 48 │ │ 2025-03-25T15:47:25.593861590Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:25.593863490Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:25.593865642Z │ │ 2025-03-25T15:47:25.593867623Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:25.593869619Z │ til.py:370 in import_app │ 2025-03-25T15:47:25.593872940Z │ │ 2025-03-25T15:47:25.593874805Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:25.593876789Z │ 368 │ │ 2025-03-25T15:47:25.593878871Z │ 369 │ try: │ 2025-03-25T15:47:25.593880722Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:25.593882475Z │ 371 │ except ImportError: │ 2025-03-25T15:47:25.593884575Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:25.593887143Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:25.593889271Z │ │ 2025-03-25T15:47:25.593891121Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:25.593893487Z │ in import_module │ 2025-03-25T15:47:25.593895384Z │ │ 2025-03-25T15:47:25.593897119Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:25.593899602Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:25.593901514Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:25.593904678Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:25.593907148Z │ 127 │ 2025-03-25T15:47:25.593908841Z │ 128 │ 2025-03-25T15:47:25.593911022Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:25.593912735Z │ in _gcd_import:1204 │ 2025-03-25T15:47:25.593914439Z │ in _find_and_load:1176 │ 2025-03-25T15:47:25.593916251Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:25.593918043Z │ in _load_unlocked:690 │ 2025-03-25T15:47:25.593919989Z │ in exec_module:940 │ 2025-03-25T15:47:25.593921809Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:25.593923639Z │ │ 2025-03-25T15:47:25.593925377Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:25.593927324Z │ <module> │ 2025-03-25T15:47:25.593929510Z │ │ 2025-03-25T15:47:25.593931369Z │ 13 import orjson │ 2025-03-25T15:47:25.593933569Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:25.593936166Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:25.593939805Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:25.593942145Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:25.593944288Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:25.593946331Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:25.593948468Z │ │ 2025-03-25T15:47:25.593950231Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:25.593952053Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:25.593954337Z │ │ 2025-03-25T15:47:25.593956013Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:25.593958005Z │ 55 │ 2025-03-25T15:47:25.593959669Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:25.593961990Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:25.593964045Z │ 58 │ 2025-03-25T15:47:25.593966052Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:25.593969476Z │ F401 │ 2025-03-25T15:47:25.593971381Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:25.593973512Z │ │ 2025-03-25T15:47:25.593975392Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:25.593977201Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:25.593979111Z │ │ 2025-03-25T15:47:25.593980937Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:25.593982915Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:25.593986803Z │ 22 try: │ 2025-03-25T15:47:25.593989057Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:25.593991286Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:25.593993515Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:25.593995948Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:25.593998318Z │ │ 2025-03-25T15:47:25.594001532Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:25.594003435Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:25.594005527Z │ │ 2025-03-25T15:47:25.594007273Z │ 29 │ 2025-03-25T15:47:25.594009190Z │ 30 │ 2025-03-25T15:47:25.594011331Z │ 31 │ 2025-03-25T15:47:25.594012915Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:25.594014508Z │ 33 │ 2025-03-25T15:47:25.594015673Z │ 34 │ 2025-03-25T15:47:25.594016836Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:25.594018068Z ImportError: 2025-03-25T15:47:25.594019189Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:25.594020311Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:25.594021492Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:25.594023066Z shared object requires: Invalid argument 2025-03-25T15:47:25.594337905Z [03/25/25 15:47:25] INFO Worker exiting (pid: 2821) 2025-03-25T15:47:25.644300236Z [03/25/25 15:47:25] ERROR Worker (pid:2821) exited with code 3 2025-03-25T15:47:25.644979155Z [03/25/25 15:47:25] ERROR Shutting down: Master 2025-03-25T15:47:25.645408311Z [03/25/25 15:47:25] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:27.246279592Z [03/25/25 15:47:27] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:27.246908372Z [03/25/25 15:47:27] INFO Listening at: http://0.0.0.0:3003 (2823) 2025-03-25T15:47:27.247327924Z [03/25/25 15:47:27] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:27.250306964Z [03/25/25 15:47:27] INFO Booting worker with pid: 2826 2025-03-25T15:47:27.523525177Z [03/25/25 15:47:27] ERROR Exception in worker process 2025-03-25T15:47:27.523541291Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:27.523543768Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:27.523545209Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:27.523546627Z │ │ 2025-03-25T15:47:27.523547822Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:27.523549473Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:27.523550920Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:27.523552313Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:27.523562086Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:27.523563401Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:27.523564778Z │ 611 │ │ │ raise │ 2025-03-25T15:47:27.523566084Z │ │ 2025-03-25T15:47:27.523567206Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:27.523568992Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:27.523570349Z │ │ 2025-03-25T15:47:27.523571508Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:27.523572721Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:27.523573977Z │ 134 │ │ │ 2025-03-25T15:47:27.523575169Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:27.523576463Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:27.523577827Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:27.523579059Z │ 138 │ 2025-03-25T15:47:27.523580211Z │ │ 2025-03-25T15:47:27.523581343Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:27.523583947Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:27.523585247Z │ │ 2025-03-25T15:47:27.523586434Z │ 144 │ │ 2025-03-25T15:47:27.523587660Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:27.523589137Z │ 146 │ │ try: │ 2025-03-25T15:47:27.523593313Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:27.523594661Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:27.523596018Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:27.523597323Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:27.523598628Z │ │ 2025-03-25T15:47:27.523599754Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:27.523600915Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:27.523602216Z │ │ 2025-03-25T15:47:27.523603353Z │ 63 │ │ 2025-03-25T15:47:27.523604557Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:27.523606790Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:27.523608202Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:27.523609722Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:27.523611032Z │ 68 │ │ 2025-03-25T15:47:27.523612252Z │ 69 │ def run(self): │ 2025-03-25T15:47:27.523613540Z │ │ 2025-03-25T15:47:27.523614718Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:27.523615865Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:27.523617129Z │ │ 2025-03-25T15:47:27.523618260Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:27.523619666Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:27.523620930Z │ 56 │ │ else: │ 2025-03-25T15:47:27.523622175Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:27.523623579Z │ 58 │ 2025-03-25T15:47:27.523624779Z │ 59 │ 2025-03-25T15:47:27.523626888Z │ 60 def run(prog=None): │ 2025-03-25T15:47:27.523628198Z │ │ 2025-03-25T15:47:27.523629450Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:27.523630636Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:27.523631910Z │ │ 2025-03-25T15:47:27.523633048Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:27.523634389Z │ 45 │ │ 2025-03-25T15:47:27.523635608Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:27.523636959Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:27.523638342Z │ 48 │ │ 2025-03-25T15:47:27.523639504Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:27.523640807Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:27.523642286Z │ │ 2025-03-25T15:47:27.523643411Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:27.523644649Z │ til.py:370 in import_app │ 2025-03-25T15:47:27.523646946Z │ │ 2025-03-25T15:47:27.523648177Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:27.523649503Z │ 368 │ │ 2025-03-25T15:47:27.523650726Z │ 369 │ try: │ 2025-03-25T15:47:27.523652009Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:27.523653303Z │ 371 │ except ImportError: │ 2025-03-25T15:47:27.523654586Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:27.523656020Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:27.523657388Z │ │ 2025-03-25T15:47:27.523658546Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:27.523659881Z │ in import_module │ 2025-03-25T15:47:27.523661080Z │ │ 2025-03-25T15:47:27.523662228Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:27.523663585Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:27.523664826Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:27.523667048Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:27.523668479Z │ 127 │ 2025-03-25T15:47:27.523669675Z │ 128 │ 2025-03-25T15:47:27.523670831Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:27.523671993Z │ in _gcd_import:1204 │ 2025-03-25T15:47:27.523673227Z │ in _find_and_load:1176 │ 2025-03-25T15:47:27.523674457Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:27.523675655Z │ in _load_unlocked:690 │ 2025-03-25T15:47:27.523676869Z │ in exec_module:940 │ 2025-03-25T15:47:27.523678105Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:27.523679344Z │ │ 2025-03-25T15:47:27.523680488Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:27.523681759Z │ <module> │ 2025-03-25T15:47:27.523683018Z │ │ 2025-03-25T15:47:27.523684151Z │ 13 import orjson │ 2025-03-25T15:47:27.523685380Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:27.523686825Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:27.523690636Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:27.523692197Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:27.523693533Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:27.523694810Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:27.523696238Z │ │ 2025-03-25T15:47:27.523697389Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:27.523698549Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:27.523699906Z │ │ 2025-03-25T15:47:27.523701082Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:27.523702492Z │ 55 │ 2025-03-25T15:47:27.523703654Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:27.523704859Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:27.523706255Z │ 58 │ 2025-03-25T15:47:27.523707519Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:27.523709963Z │ F401 │ 2025-03-25T15:47:27.523711175Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:27.523712535Z │ │ 2025-03-25T15:47:27.523713715Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:27.523714910Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:27.523716210Z │ │ 2025-03-25T15:47:27.523717349Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:27.523718578Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:27.523719758Z │ 22 try: │ 2025-03-25T15:47:27.523720986Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:27.523722451Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:27.523723887Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:27.523725407Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:27.523728035Z │ │ 2025-03-25T15:47:27.523729171Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:27.523730319Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:27.523731611Z │ │ 2025-03-25T15:47:27.523732754Z │ 29 │ 2025-03-25T15:47:27.523733937Z │ 30 │ 2025-03-25T15:47:27.523735102Z │ 31 │ 2025-03-25T15:47:27.523736289Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:27.523737759Z │ 33 │ 2025-03-25T15:47:27.523738904Z │ 34 │ 2025-03-25T15:47:27.523740071Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:27.523741304Z ImportError: 2025-03-25T15:47:27.523742450Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:27.523743610Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:27.523744832Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:27.523746085Z shared object requires: Invalid argument 2025-03-25T15:47:27.524145704Z [03/25/25 15:47:27] INFO Worker exiting (pid: 2826) 2025-03-25T15:47:27.569803463Z [03/25/25 15:47:27] ERROR Worker (pid:2826) exited with code 3 2025-03-25T15:47:27.570333618Z [03/25/25 15:47:27] ERROR Shutting down: Master 2025-03-25T15:47:27.570699001Z [03/25/25 15:47:27] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:29.167270935Z [03/25/25 15:47:29] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:29.167919734Z [03/25/25 15:47:29] INFO Listening at: http://0.0.0.0:3003 (2828) 2025-03-25T15:47:29.168286966Z [03/25/25 15:47:29] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:29.171290950Z [03/25/25 15:47:29] INFO Booting worker with pid: 2831 2025-03-25T15:47:29.442707837Z [03/25/25 15:47:29] ERROR Exception in worker process 2025-03-25T15:47:29.442724299Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:29.442727062Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:29.442728513Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:29.442730155Z │ │ 2025-03-25T15:47:29.442731428Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:29.442733026Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:29.442734461Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:29.442735765Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:29.442744648Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:29.442746512Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:29.442747889Z │ 611 │ │ │ raise │ 2025-03-25T15:47:29.442749201Z │ │ 2025-03-25T15:47:29.442750369Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:29.442752138Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:29.442753555Z │ │ 2025-03-25T15:47:29.442754680Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:29.442755964Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:29.442757212Z │ 134 │ │ │ 2025-03-25T15:47:29.442758451Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:29.442759784Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:29.442761055Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:29.442762294Z │ 138 │ 2025-03-25T15:47:29.442763461Z │ │ 2025-03-25T15:47:29.442764620Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:29.442767439Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:29.442768769Z │ │ 2025-03-25T15:47:29.442769949Z │ 144 │ │ 2025-03-25T15:47:29.442771215Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:29.442772728Z │ 146 │ │ try: │ 2025-03-25T15:47:29.442773969Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:29.442775306Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:29.442776660Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:29.442777966Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:29.442779259Z │ │ 2025-03-25T15:47:29.442780387Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:29.442781610Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:29.442782929Z │ │ 2025-03-25T15:47:29.442784074Z │ 63 │ │ 2025-03-25T15:47:29.442785273Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:29.442787794Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:29.442789142Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:29.442790689Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:29.442792418Z │ 68 │ │ 2025-03-25T15:47:29.442793656Z │ 69 │ def run(self): │ 2025-03-25T15:47:29.442794933Z │ │ 2025-03-25T15:47:29.442796070Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:29.442797273Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:29.442798558Z │ │ 2025-03-25T15:47:29.442799697Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:29.442801142Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:29.442802410Z │ 56 │ │ else: │ 2025-03-25T15:47:29.442803671Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:29.442805056Z │ 58 │ 2025-03-25T15:47:29.442806263Z │ 59 │ 2025-03-25T15:47:29.442808532Z │ 60 def run(prog=None): │ 2025-03-25T15:47:29.442809840Z │ │ 2025-03-25T15:47:29.442811102Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:29.442812306Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:29.442813620Z │ │ 2025-03-25T15:47:29.442814788Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:29.442816104Z │ 45 │ │ 2025-03-25T15:47:29.442817308Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:29.442818606Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:29.442820015Z │ 48 │ │ 2025-03-25T15:47:29.442821209Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:29.442822514Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:29.442823922Z │ │ 2025-03-25T15:47:29.442828316Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:29.442829603Z │ til.py:370 in import_app │ 2025-03-25T15:47:29.442831915Z │ │ 2025-03-25T15:47:29.442833216Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:29.442834551Z │ 368 │ │ 2025-03-25T15:47:29.442835750Z │ 369 │ try: │ 2025-03-25T15:47:29.442836967Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:29.442838205Z │ 371 │ except ImportError: │ 2025-03-25T15:47:29.442839494Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:29.442840920Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:29.442842258Z │ │ 2025-03-25T15:47:29.442843386Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:29.442844710Z │ in import_module │ 2025-03-25T15:47:29.442845904Z │ │ 2025-03-25T15:47:29.442847044Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:29.442848402Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:29.442849690Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:29.442851893Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:29.442853371Z │ 127 │ 2025-03-25T15:47:29.442854575Z │ 128 │ 2025-03-25T15:47:29.442855751Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:29.442856893Z │ in _gcd_import:1204 │ 2025-03-25T15:47:29.442858133Z │ in _find_and_load:1176 │ 2025-03-25T15:47:29.442859332Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:29.442860550Z │ in _load_unlocked:690 │ 2025-03-25T15:47:29.442861760Z │ in exec_module:940 │ 2025-03-25T15:47:29.442862948Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:29.442864159Z │ │ 2025-03-25T15:47:29.442865294Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:29.442866576Z │ <module> │ 2025-03-25T15:47:29.442867851Z │ │ 2025-03-25T15:47:29.442868966Z │ 13 import orjson │ 2025-03-25T15:47:29.442870211Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:29.442871717Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:29.442877879Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:29.442879430Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:29.442880786Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:29.442882055Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:29.442883422Z │ │ 2025-03-25T15:47:29.442884545Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:29.442885738Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:29.442887037Z │ │ 2025-03-25T15:47:29.442888190Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:29.442889573Z │ 55 │ 2025-03-25T15:47:29.442890725Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:29.442891943Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:29.442893291Z │ 58 │ 2025-03-25T15:47:29.442894575Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:29.442896962Z │ F401 │ 2025-03-25T15:47:29.442898171Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:29.442899625Z │ │ 2025-03-25T15:47:29.442900789Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:29.442901943Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:29.442903243Z │ │ 2025-03-25T15:47:29.442904393Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:29.442905591Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:29.442906769Z │ 22 try: │ 2025-03-25T15:47:29.442907999Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:29.442909453Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:29.442910895Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:29.442912372Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:29.442914804Z │ │ 2025-03-25T15:47:29.442916145Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:29.442917345Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:29.442918681Z │ │ 2025-03-25T15:47:29.442919802Z │ 29 │ 2025-03-25T15:47:29.442920978Z │ 30 │ 2025-03-25T15:47:29.442922140Z │ 31 │ 2025-03-25T15:47:29.442923310Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:29.442924843Z │ 33 │ 2025-03-25T15:47:29.442925997Z │ 34 │ 2025-03-25T15:47:29.442927177Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:29.442928443Z ImportError: 2025-03-25T15:47:29.442929583Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:29.442930714Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:29.442931886Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:29.442933208Z shared object requires: Invalid argument 2025-03-25T15:47:29.443331243Z [03/25/25 15:47:29] INFO Worker exiting (pid: 2831) 2025-03-25T15:47:29.487470250Z [03/25/25 15:47:29] ERROR Worker (pid:2831) exited with code 3 2025-03-25T15:47:29.488012369Z [03/25/25 15:47:29] ERROR Shutting down: Master 2025-03-25T15:47:29.488363448Z [03/25/25 15:47:29] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:31.114942378Z [03/25/25 15:47:31] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:31.115584277Z [03/25/25 15:47:31] INFO Listening at: http://0.0.0.0:3003 (2833) 2025-03-25T15:47:31.115985840Z [03/25/25 15:47:31] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:31.118908298Z [03/25/25 15:47:31] INFO Booting worker with pid: 2836 2025-03-25T15:47:31.391426660Z [03/25/25 15:47:31] ERROR Exception in worker process 2025-03-25T15:47:31.391441912Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:31.391444690Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:31.391446122Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:31.391447513Z │ │ 2025-03-25T15:47:31.391448715Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:31.391450225Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:31.391598437Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:31.391600159Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:31.391605913Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:31.391607337Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:31.391608683Z │ 611 │ │ │ raise │ 2025-03-25T15:47:31.391609969Z │ │ 2025-03-25T15:47:31.391611149Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:31.391613117Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:31.391614492Z │ │ 2025-03-25T15:47:31.391615634Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:31.391616860Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:31.391618160Z │ 134 │ │ │ 2025-03-25T15:47:31.391619461Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:31.391620780Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:31.391622076Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:31.391623324Z │ 138 │ 2025-03-25T15:47:31.391624483Z │ │ 2025-03-25T15:47:31.391625606Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:31.391628078Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:31.391629400Z │ │ 2025-03-25T15:47:31.391630570Z │ 144 │ │ 2025-03-25T15:47:31.391631784Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:31.391633278Z │ 146 │ │ try: │ 2025-03-25T15:47:31.391634524Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:31.391635849Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:31.391637205Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:31.391638506Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:31.391639770Z │ │ 2025-03-25T15:47:31.391640943Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:31.391642086Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:31.391643365Z │ │ 2025-03-25T15:47:31.391644506Z │ 63 │ │ 2025-03-25T15:47:31.391645694Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:31.391647982Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:31.391649324Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:31.391651110Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:31.391652393Z │ 68 │ │ 2025-03-25T15:47:31.391653608Z │ 69 │ def run(self): │ 2025-03-25T15:47:31.391654882Z │ │ 2025-03-25T15:47:31.391656040Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:31.391657211Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:31.391658489Z │ │ 2025-03-25T15:47:31.391659635Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:31.391661043Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:31.391662355Z │ 56 │ │ else: │ 2025-03-25T15:47:31.391663593Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:31.391664993Z │ 58 │ 2025-03-25T15:47:31.391666186Z │ 59 │ 2025-03-25T15:47:31.391668371Z │ 60 def run(prog=None): │ 2025-03-25T15:47:31.391669671Z │ │ 2025-03-25T15:47:31.391671022Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:31.391672263Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:31.391673566Z │ │ 2025-03-25T15:47:31.391674726Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:31.391676105Z │ 45 │ │ 2025-03-25T15:47:31.391677291Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:31.391678609Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:31.391680033Z │ 48 │ │ 2025-03-25T15:47:31.391681228Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:31.391682583Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:31.391684059Z │ │ 2025-03-25T15:47:31.391685177Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:31.391686404Z │ til.py:370 in import_app │ 2025-03-25T15:47:31.391688583Z │ │ 2025-03-25T15:47:31.391693139Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:31.391694557Z │ 368 │ │ 2025-03-25T15:47:31.391695798Z │ 369 │ try: │ 2025-03-25T15:47:31.391697078Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:31.391698338Z │ 371 │ except ImportError: │ 2025-03-25T15:47:31.391699636Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:31.391701064Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:31.391702395Z │ │ 2025-03-25T15:47:31.391703550Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:31.391704849Z │ in import_module │ 2025-03-25T15:47:31.391706056Z │ │ 2025-03-25T15:47:31.391707202Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:31.391708550Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:31.391709813Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:31.391711985Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:31.391713380Z │ 127 │ 2025-03-25T15:47:31.391714577Z │ 128 │ 2025-03-25T15:47:31.391715748Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:31.391716904Z │ in _gcd_import:1204 │ 2025-03-25T15:47:31.391718131Z │ in _find_and_load:1176 │ 2025-03-25T15:47:31.391719391Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:31.391720584Z │ in _load_unlocked:690 │ 2025-03-25T15:47:31.391721783Z │ in exec_module:940 │ 2025-03-25T15:47:31.391722990Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:31.391724182Z │ │ 2025-03-25T15:47:31.391725304Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:31.391726599Z │ <module> │ 2025-03-25T15:47:31.391727883Z │ │ 2025-03-25T15:47:31.391729040Z │ 13 import orjson │ 2025-03-25T15:47:31.391730275Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:31.391732558Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:31.391733961Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:31.391735491Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:31.391736841Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:31.391738146Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:31.391741648Z │ │ 2025-03-25T15:47:31.391742823Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:31.391743996Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:31.391745325Z │ │ 2025-03-25T15:47:31.391746469Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:31.391747857Z │ 55 │ 2025-03-25T15:47:31.391749026Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:31.391750240Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:31.391751600Z │ 58 │ 2025-03-25T15:47:31.391753358Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:31.391755606Z │ F401 │ 2025-03-25T15:47:31.391756809Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:31.391758157Z │ │ 2025-03-25T15:47:31.391759325Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:31.391760496Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:31.391761783Z │ │ 2025-03-25T15:47:31.391762947Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:31.391764165Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:31.391765353Z │ 22 try: │ 2025-03-25T15:47:31.391766573Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:31.391768026Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:31.391769452Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:31.391770964Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:31.391773177Z │ │ 2025-03-25T15:47:31.391774418Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:31.391775600Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:31.391776940Z │ │ 2025-03-25T15:47:31.391778083Z │ 29 │ 2025-03-25T15:47:31.391779263Z │ 30 │ 2025-03-25T15:47:31.391780437Z │ 31 │ 2025-03-25T15:47:31.391781590Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:31.391783131Z │ 33 │ 2025-03-25T15:47:31.391784310Z │ 34 │ 2025-03-25T15:47:31.391785477Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:31.391786748Z ImportError: 2025-03-25T15:47:31.391787887Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:31.391789013Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:31.391790181Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:31.391791436Z shared object requires: Invalid argument 2025-03-25T15:47:31.392034020Z [03/25/25 15:47:31] INFO Worker exiting (pid: 2836) 2025-03-25T15:47:31.440016967Z [03/25/25 15:47:31] ERROR Worker (pid:2836) exited with code 3 2025-03-25T15:47:31.440544420Z [03/25/25 15:47:31] ERROR Shutting down: Master 2025-03-25T15:47:31.440932850Z [03/25/25 15:47:31] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:33.029807933Z [03/25/25 15:47:33] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:33.030442587Z [03/25/25 15:47:33] INFO Listening at: http://0.0.0.0:3003 (2838) 2025-03-25T15:47:33.030824549Z [03/25/25 15:47:33] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:33.035604061Z [03/25/25 15:47:33] INFO Booting worker with pid: 2841 2025-03-25T15:47:33.361206768Z [03/25/25 15:47:33] ERROR Exception in worker process 2025-03-25T15:47:33.361218423Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:33.361221659Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:33.361223089Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:33.361224590Z │ │ 2025-03-25T15:47:33.361225817Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:33.361227274Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:33.361228618Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:33.361230066Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:33.361234698Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:33.361236008Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:33.361237359Z │ 611 │ │ │ raise │ 2025-03-25T15:47:33.361238639Z │ │ 2025-03-25T15:47:33.361239795Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:33.361241446Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:33.361248595Z │ │ 2025-03-25T15:47:33.361249797Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:33.361251046Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:33.361252268Z │ 134 │ │ │ 2025-03-25T15:47:33.361253497Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:33.361254838Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:33.361256123Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:33.361257336Z │ 138 │ 2025-03-25T15:47:33.361258524Z │ │ 2025-03-25T15:47:33.361259667Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:33.361261994Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:33.361263338Z │ │ 2025-03-25T15:47:33.361264483Z │ 144 │ │ 2025-03-25T15:47:33.361265698Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:33.361267197Z │ 146 │ │ try: │ 2025-03-25T15:47:33.361268451Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:33.361269769Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:33.361271164Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:33.361272510Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:33.361273844Z │ │ 2025-03-25T15:47:33.361274999Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:33.361276183Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:33.361277465Z │ │ 2025-03-25T15:47:33.361278608Z │ 63 │ │ 2025-03-25T15:47:33.361279805Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:33.361282128Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:33.361283510Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:33.361285021Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:33.361286334Z │ 68 │ │ 2025-03-25T15:47:33.361287539Z │ 69 │ def run(self): │ 2025-03-25T15:47:33.361288822Z │ │ 2025-03-25T15:47:33.361289981Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:33.361291181Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:33.361292497Z │ │ 2025-03-25T15:47:33.361293623Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:33.361294998Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:33.361296330Z │ 56 │ │ else: │ 2025-03-25T15:47:33.361297580Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:33.361299034Z │ 58 │ 2025-03-25T15:47:33.361300297Z │ 59 │ 2025-03-25T15:47:33.361302736Z │ 60 def run(prog=None): │ 2025-03-25T15:47:33.361304172Z │ │ 2025-03-25T15:47:33.361305506Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:33.361306772Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:33.361308080Z │ │ 2025-03-25T15:47:33.361309225Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:33.361310597Z │ 45 │ │ 2025-03-25T15:47:33.361311782Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:33.361313103Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:33.361314557Z │ 48 │ │ 2025-03-25T15:47:33.361315768Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:33.361317100Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:33.361318539Z │ │ 2025-03-25T15:47:33.361319690Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:33.361322563Z │ til.py:370 in import_app │ 2025-03-25T15:47:33.361324848Z │ │ 2025-03-25T15:47:33.361326073Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:33.361327418Z │ 368 │ │ 2025-03-25T15:47:33.361328636Z │ 369 │ try: │ 2025-03-25T15:47:33.361329855Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:33.361331124Z │ 371 │ except ImportError: │ 2025-03-25T15:47:33.361332387Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:33.361333776Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:33.361335143Z │ │ 2025-03-25T15:47:33.361336351Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:33.361337738Z │ in import_module │ 2025-03-25T15:47:33.361338950Z │ │ 2025-03-25T15:47:33.361340107Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:33.361341456Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:33.361342711Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:33.361344842Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:33.361346218Z │ 127 │ 2025-03-25T15:47:33.361347398Z │ 128 │ 2025-03-25T15:47:33.361348597Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:33.361349744Z │ in _gcd_import:1204 │ 2025-03-25T15:47:33.361350988Z │ in _find_and_load:1176 │ 2025-03-25T15:47:33.361352225Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:33.361353449Z │ in _load_unlocked:690 │ 2025-03-25T15:47:33.361354676Z │ in exec_module:940 │ 2025-03-25T15:47:33.361355919Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:33.361357165Z │ │ 2025-03-25T15:47:33.361358350Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:33.361359616Z │ <module> │ 2025-03-25T15:47:33.361360852Z │ │ 2025-03-25T15:47:33.361361962Z │ 13 import orjson │ 2025-03-25T15:47:33.361363196Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:33.361365532Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:33.361366907Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:33.361368440Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:33.361369820Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:33.361371105Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:33.361372468Z │ │ 2025-03-25T15:47:33.361373622Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:33.361374832Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:33.361376128Z │ │ 2025-03-25T15:47:33.361377272Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:33.361378662Z │ 55 │ 2025-03-25T15:47:33.361379825Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:33.361381050Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:33.361382408Z │ 58 │ 2025-03-25T15:47:33.361383793Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:33.361386321Z │ F401 │ 2025-03-25T15:47:33.361387536Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:33.361388864Z │ │ 2025-03-25T15:47:33.361390002Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:33.361391197Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:33.361392440Z │ │ 2025-03-25T15:47:33.361393610Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:33.361394890Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:33.361396107Z │ 22 try: │ 2025-03-25T15:47:33.361397349Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:33.361398786Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:33.361400216Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:33.361401758Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:33.361404098Z │ │ 2025-03-25T15:47:33.361405245Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:33.361406427Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:33.361407770Z │ │ 2025-03-25T15:47:33.361408940Z │ 29 │ 2025-03-25T15:47:33.361410108Z │ 30 │ 2025-03-25T15:47:33.361411262Z │ 31 │ 2025-03-25T15:47:33.361412475Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:33.361414012Z │ 33 │ 2025-03-25T15:47:33.361415216Z │ 34 │ 2025-03-25T15:47:33.361416411Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:33.361417637Z ImportError: 2025-03-25T15:47:33.361418764Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:33.361419870Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:33.361421068Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:33.361422353Z shared object requires: Invalid argument 2025-03-25T15:47:33.361810938Z [03/25/25 15:47:33] INFO Worker exiting (pid: 2841) 2025-03-25T15:47:33.411633387Z [03/25/25 15:47:33] ERROR Worker (pid:2841) exited with code 3 2025-03-25T15:47:33.412540261Z [03/25/25 15:47:33] ERROR Shutting down: Master 2025-03-25T15:47:33.413182589Z [03/25/25 15:47:33] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:34.993762514Z [03/25/25 15:47:34] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:34.994331801Z [03/25/25 15:47:34] INFO Listening at: http://0.0.0.0:3003 (2843) 2025-03-25T15:47:34.994698498Z [03/25/25 15:47:34] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:34.997592935Z [03/25/25 15:47:34] INFO Booting worker with pid: 2846 2025-03-25T15:47:35.268141463Z [03/25/25 15:47:35] ERROR Exception in worker process 2025-03-25T15:47:35.268161036Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:35.268165138Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:35.268167742Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:35.268170173Z │ │ 2025-03-25T15:47:35.268172357Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:35.268174990Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:35.268177514Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:35.268182652Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:35.268193756Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:35.268196646Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:35.268199131Z │ 611 │ │ │ raise │ 2025-03-25T15:47:35.268201549Z │ │ 2025-03-25T15:47:35.268203726Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:35.268207125Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:35.268209604Z │ │ 2025-03-25T15:47:35.268211650Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:35.268213837Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:35.268216057Z │ 134 │ │ │ 2025-03-25T15:47:35.268218190Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:35.268220509Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:35.268222794Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:35.268225045Z │ 138 │ 2025-03-25T15:47:35.268227095Z │ │ 2025-03-25T15:47:35.268229088Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:35.268233552Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:35.268236119Z │ │ 2025-03-25T15:47:35.268238160Z │ 144 │ │ 2025-03-25T15:47:35.268240284Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:35.268242877Z │ 146 │ │ try: │ 2025-03-25T15:47:35.268245250Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:35.268247557Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:35.268249837Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:35.268252142Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:35.268254379Z │ │ 2025-03-25T15:47:35.268256490Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:35.268258539Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:35.268260843Z │ │ 2025-03-25T15:47:35.268263005Z │ 63 │ │ 2025-03-25T15:47:35.268265123Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:35.268270261Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:35.268272955Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:35.268275763Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:35.268278169Z │ 68 │ │ 2025-03-25T15:47:35.268280290Z │ 69 │ def run(self): │ 2025-03-25T15:47:35.268282618Z │ │ 2025-03-25T15:47:35.268284685Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:35.268286740Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:35.268289062Z │ │ 2025-03-25T15:47:35.268291120Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:35.268293516Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:35.268295735Z │ 56 │ │ else: │ 2025-03-25T15:47:35.268297970Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:35.268300378Z │ 58 │ 2025-03-25T15:47:35.268302536Z │ 59 │ 2025-03-25T15:47:35.268306490Z │ 60 def run(prog=None): │ 2025-03-25T15:47:35.268309045Z │ │ 2025-03-25T15:47:35.268311491Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:35.268313826Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:35.268316248Z │ │ 2025-03-25T15:47:35.268318356Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:35.268320739Z │ 45 │ │ 2025-03-25T15:47:35.268322951Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:35.268325216Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:35.268327606Z │ 48 │ │ 2025-03-25T15:47:35.268329703Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:35.268332167Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:35.268334580Z │ │ 2025-03-25T15:47:35.268336688Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:35.268338879Z │ til.py:370 in import_app │ 2025-03-25T15:47:35.268344901Z │ │ 2025-03-25T15:47:35.268347448Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:35.268349879Z │ 368 │ │ 2025-03-25T15:47:35.268352014Z │ 369 │ try: │ 2025-03-25T15:47:35.268354274Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:35.268356656Z │ 371 │ except ImportError: │ 2025-03-25T15:47:35.268358980Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:35.268361437Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:35.268363786Z │ │ 2025-03-25T15:47:35.268365776Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:35.268368027Z │ in import_module │ 2025-03-25T15:47:35.268370105Z │ │ 2025-03-25T15:47:35.268372121Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:35.268374522Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:35.268376708Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:35.268380649Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:35.268383433Z │ 127 │ 2025-03-25T15:47:35.268385632Z │ 128 │ 2025-03-25T15:47:35.268387729Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:35.268389848Z │ in _gcd_import:1204 │ 2025-03-25T15:47:35.268392025Z │ in _find_and_load:1176 │ 2025-03-25T15:47:35.268394185Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:35.268396330Z │ in _load_unlocked:690 │ 2025-03-25T15:47:35.268398438Z │ in exec_module:940 │ 2025-03-25T15:47:35.268400639Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:35.268402848Z │ │ 2025-03-25T15:47:35.268404930Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:35.268407225Z │ <module> │ 2025-03-25T15:47:35.268409491Z │ │ 2025-03-25T15:47:35.268411540Z │ 13 import orjson │ 2025-03-25T15:47:35.268413824Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:35.268418635Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:35.268421468Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:35.268424011Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:35.268426349Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:35.268428605Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:35.268430972Z │ │ 2025-03-25T15:47:35.268433016Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:35.268435078Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:35.268437360Z │ │ 2025-03-25T15:47:35.268439428Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:35.268441830Z │ 55 │ 2025-03-25T15:47:35.268443936Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:35.268446062Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:35.268448377Z │ 58 │ 2025-03-25T15:47:35.268450639Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:35.268454674Z │ F401 │ 2025-03-25T15:47:35.268456970Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:35.268459463Z │ │ 2025-03-25T15:47:35.268461487Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:35.268463531Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:35.268465794Z │ │ 2025-03-25T15:47:35.268467983Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:35.268470233Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:35.268472465Z │ 22 try: │ 2025-03-25T15:47:35.268474698Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:35.268477399Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:35.268479874Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:35.268482646Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:35.268486844Z │ │ 2025-03-25T15:47:35.268489061Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:35.268491142Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:35.268493468Z │ │ 2025-03-25T15:47:35.268495470Z │ 29 │ 2025-03-25T15:47:35.268497533Z │ 30 │ 2025-03-25T15:47:35.268499556Z │ 31 │ 2025-03-25T15:47:35.268501620Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:35.268504219Z │ 33 │ 2025-03-25T15:47:35.268506273Z │ 34 │ 2025-03-25T15:47:35.268508346Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:35.268510557Z ImportError: 2025-03-25T15:47:35.268512571Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:35.268516019Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:35.268518186Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:35.268520444Z shared object requires: Invalid argument 2025-03-25T15:47:35.268665465Z [03/25/25 15:47:35] INFO Worker exiting (pid: 2846) 2025-03-25T15:47:35.310622794Z [03/25/25 15:47:35] ERROR Worker (pid:2846) exited with code 3 2025-03-25T15:47:35.311214885Z [03/25/25 15:47:35] ERROR Shutting down: Master 2025-03-25T15:47:35.311513572Z [03/25/25 15:47:35] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:36.884849512Z [03/25/25 15:47:36] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:36.885486669Z [03/25/25 15:47:36] INFO Listening at: http://0.0.0.0:3003 (2848) 2025-03-25T15:47:36.885865916Z [03/25/25 15:47:36] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:36.889223391Z [03/25/25 15:47:36] INFO Booting worker with pid: 2852 2025-03-25T15:47:37.163200636Z [03/25/25 15:47:37] ERROR Exception in worker process 2025-03-25T15:47:37.163220678Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:37.163228540Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:37.163230564Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:37.163232707Z │ │ 2025-03-25T15:47:37.163234311Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:37.163236326Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:37.163238216Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:37.163239993Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:37.163245733Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:37.163247714Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:37.163249488Z │ 611 │ │ │ raise │ 2025-03-25T15:47:37.163251136Z │ │ 2025-03-25T15:47:37.163252717Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:37.163255011Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:37.163256803Z │ │ 2025-03-25T15:47:37.163258377Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:37.163259951Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:37.163261534Z │ 134 │ │ │ 2025-03-25T15:47:37.163263492Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:37.163265345Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:37.163267335Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:37.163269261Z │ 138 │ 2025-03-25T15:47:37.163270926Z │ │ 2025-03-25T15:47:37.163272738Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:37.163276212Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:37.163278712Z │ │ 2025-03-25T15:47:37.163280505Z │ 144 │ │ 2025-03-25T15:47:37.163282263Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:37.163284394Z │ 146 │ │ try: │ 2025-03-25T15:47:37.163286143Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:37.163288109Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:37.163290230Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:37.163292200Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:37.163294276Z │ │ 2025-03-25T15:47:37.163296079Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:37.163297848Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:37.163299756Z │ │ 2025-03-25T15:47:37.163300929Z │ 63 │ │ 2025-03-25T15:47:37.163302157Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:37.163304519Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:37.163305893Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:37.163307533Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:37.163308796Z │ 68 │ │ 2025-03-25T15:47:37.163310035Z │ 69 │ def run(self): │ 2025-03-25T15:47:37.163311319Z │ │ 2025-03-25T15:47:37.163312465Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:37.163313673Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:37.163314985Z │ │ 2025-03-25T15:47:37.163316144Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:37.163317546Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:37.163318810Z │ 56 │ │ else: │ 2025-03-25T15:47:37.163320102Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:37.163321723Z │ 58 │ 2025-03-25T15:47:37.163322904Z │ 59 │ 2025-03-25T15:47:37.163324963Z │ 60 def run(prog=None): │ 2025-03-25T15:47:37.163326287Z │ │ 2025-03-25T15:47:37.163327633Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:37.163328819Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:37.163330112Z │ │ 2025-03-25T15:47:37.163331257Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:37.163332620Z │ 45 │ │ 2025-03-25T15:47:37.163333838Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:37.163335182Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:37.163336573Z │ 48 │ │ 2025-03-25T15:47:37.163337755Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:37.163339051Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:37.163340446Z │ │ 2025-03-25T15:47:37.163341599Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:37.163342817Z │ til.py:370 in import_app │ 2025-03-25T15:47:37.163345036Z │ │ 2025-03-25T15:47:37.163346378Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:37.163347688Z │ 368 │ │ 2025-03-25T15:47:37.163348882Z │ 369 │ try: │ 2025-03-25T15:47:37.163350127Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:37.163351368Z │ 371 │ except ImportError: │ 2025-03-25T15:47:37.163352688Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:37.163354095Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:37.163355420Z │ │ 2025-03-25T15:47:37.163356567Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:37.163357833Z │ in import_module │ 2025-03-25T15:47:37.163359029Z │ │ 2025-03-25T15:47:37.163360158Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:37.163361501Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:37.163362746Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:37.163364933Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:37.163366363Z │ 127 │ 2025-03-25T15:47:37.163367558Z │ 128 │ 2025-03-25T15:47:37.163368727Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:37.163369884Z │ in _gcd_import:1204 │ 2025-03-25T15:47:37.163371111Z │ in _find_and_load:1176 │ 2025-03-25T15:47:37.163372357Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:37.163373576Z │ in _load_unlocked:690 │ 2025-03-25T15:47:37.163374781Z │ in exec_module:940 │ 2025-03-25T15:47:37.163375981Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:37.163377195Z │ │ 2025-03-25T15:47:37.163378321Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:37.163379597Z │ <module> │ 2025-03-25T15:47:37.163380835Z │ │ 2025-03-25T15:47:37.163381987Z │ 13 import orjson │ 2025-03-25T15:47:37.163383255Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:37.163386155Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:37.163387532Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:37.163389057Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:37.163390417Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:37.163391696Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:37.163393077Z │ │ 2025-03-25T15:47:37.163394204Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:37.163395374Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:37.163396728Z │ │ 2025-03-25T15:47:37.163397848Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:37.163399182Z │ 55 │ 2025-03-25T15:47:37.163400372Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:37.163401583Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:37.163403191Z │ 58 │ 2025-03-25T15:47:37.163404496Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:37.163406832Z │ F401 │ 2025-03-25T15:47:37.163408006Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:37.163409322Z │ │ 2025-03-25T15:47:37.163410476Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:37.163411670Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:37.163412970Z │ │ 2025-03-25T15:47:37.163414124Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:37.163415339Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:37.163416527Z │ 22 try: │ 2025-03-25T15:47:37.163417787Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:37.163419206Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:37.163420565Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:37.163422139Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:37.163424407Z │ │ 2025-03-25T15:47:37.163425547Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:37.163426718Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:37.163428067Z │ │ 2025-03-25T15:47:37.163429198Z │ 29 │ 2025-03-25T15:47:37.163430376Z │ 30 │ 2025-03-25T15:47:37.163431548Z │ 31 │ 2025-03-25T15:47:37.163432729Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:37.163434234Z │ 33 │ 2025-03-25T15:47:37.163435383Z │ 34 │ 2025-03-25T15:47:37.163436546Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:37.163437800Z ImportError: 2025-03-25T15:47:37.163438977Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:37.163440087Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:37.163441236Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:37.163442610Z shared object requires: Invalid argument 2025-03-25T15:47:37.163443705Z [03/25/25 15:47:37] INFO Worker exiting (pid: 2852) 2025-03-25T15:47:37.209669674Z [03/25/25 15:47:37] ERROR Worker (pid:2852) exited with code 3 2025-03-25T15:47:37.210597890Z [03/25/25 15:47:37] ERROR Shutting down: Master 2025-03-25T15:47:37.211300724Z [03/25/25 15:47:37] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:38.794235193Z [03/25/25 15:47:38] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:38.794841459Z [03/25/25 15:47:38] INFO Listening at: http://0.0.0.0:3003 (2854) 2025-03-25T15:47:38.795269370Z [03/25/25 15:47:38] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:38.798077930Z [03/25/25 15:47:38] INFO Booting worker with pid: 2857 2025-03-25T15:47:39.067113769Z [03/25/25 15:47:38] ERROR Exception in worker process 2025-03-25T15:47:39.067127597Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:39.067130158Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:39.067131672Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:39.067133114Z │ │ 2025-03-25T15:47:39.067134353Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:39.067135851Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:39.067137998Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:39.067140137Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:39.067149089Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:39.067151236Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:39.067153368Z │ 611 │ │ │ raise │ 2025-03-25T15:47:39.067155266Z │ │ 2025-03-25T15:47:39.067156795Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:39.067159362Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:39.067161330Z │ │ 2025-03-25T15:47:39.067163283Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:39.067165549Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:39.067166857Z │ 134 │ │ │ 2025-03-25T15:47:39.067168111Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:39.067169486Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:39.067170783Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:39.067172019Z │ 138 │ 2025-03-25T15:47:39.067173210Z │ │ 2025-03-25T15:47:39.067174401Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:39.067177074Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:39.067178448Z │ │ 2025-03-25T15:47:39.067179654Z │ 144 │ │ 2025-03-25T15:47:39.067180879Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:39.067182376Z │ 146 │ │ try: │ 2025-03-25T15:47:39.067183620Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:39.067184956Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:39.067186314Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:39.067187635Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:39.067188928Z │ │ 2025-03-25T15:47:39.067190088Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:39.067191277Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:39.067192587Z │ │ 2025-03-25T15:47:39.067193731Z │ 63 │ │ 2025-03-25T15:47:39.067194924Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:39.067197233Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:39.067198578Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:39.067200083Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:39.067201406Z │ 68 │ │ 2025-03-25T15:47:39.067202664Z │ 69 │ def run(self): │ 2025-03-25T15:47:39.067203976Z │ │ 2025-03-25T15:47:39.067205103Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:39.067206288Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:39.067207599Z │ │ 2025-03-25T15:47:39.067208738Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:39.067210135Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:39.067211418Z │ 56 │ │ else: │ 2025-03-25T15:47:39.067212664Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:39.067214060Z │ 58 │ 2025-03-25T15:47:39.067216313Z │ 59 │ 2025-03-25T15:47:39.067217618Z │ 60 def run(prog=None): │ 2025-03-25T15:47:39.067219006Z │ │ 2025-03-25T15:47:39.067220455Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:39.067221737Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:39.067223175Z │ │ 2025-03-25T15:47:39.067224293Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:39.067225681Z │ 45 │ │ 2025-03-25T15:47:39.067226885Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:39.067228216Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:39.067229613Z │ 48 │ │ 2025-03-25T15:47:39.067230794Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:39.067232085Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:39.067233487Z │ │ 2025-03-25T15:47:39.067234650Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:39.067235867Z │ til.py:370 in import_app │ 2025-03-25T15:47:39.067238126Z │ │ 2025-03-25T15:47:39.067239641Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:39.067240971Z │ 368 │ │ 2025-03-25T15:47:39.067242173Z │ 369 │ try: │ 2025-03-25T15:47:39.067243416Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:39.067244693Z │ 371 │ except ImportError: │ 2025-03-25T15:47:39.067245944Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:39.067247329Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:39.067248653Z │ │ 2025-03-25T15:47:39.067249786Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:39.067251067Z │ in import_module │ 2025-03-25T15:47:39.067252280Z │ │ 2025-03-25T15:47:39.067253471Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:39.067254853Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:39.067256090Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:39.067258172Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:39.067259603Z │ 127 │ 2025-03-25T15:47:39.067260796Z │ 128 │ 2025-03-25T15:47:39.067261959Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:39.067263106Z │ in _gcd_import:1204 │ 2025-03-25T15:47:39.067264304Z │ in _find_and_load:1176 │ 2025-03-25T15:47:39.067265560Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:39.067266776Z │ in _load_unlocked:690 │ 2025-03-25T15:47:39.067268003Z │ in exec_module:940 │ 2025-03-25T15:47:39.067269202Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:39.067270411Z │ │ 2025-03-25T15:47:39.067271531Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:39.067272803Z │ <module> │ 2025-03-25T15:47:39.067274056Z │ │ 2025-03-25T15:47:39.067275176Z │ 13 import orjson │ 2025-03-25T15:47:39.067276437Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:39.067278890Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:39.067280319Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:39.067281857Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:39.067283199Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:39.067284489Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:39.067285876Z │ │ 2025-03-25T15:47:39.067287052Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:39.067288213Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:39.067289556Z │ │ 2025-03-25T15:47:39.067290697Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:39.067292052Z │ 55 │ 2025-03-25T15:47:39.067293245Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:39.067294454Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:39.067295811Z │ 58 │ 2025-03-25T15:47:39.067299707Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:39.067301089Z │ F401 │ 2025-03-25T15:47:39.067302297Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:39.067303688Z │ │ 2025-03-25T15:47:39.067304832Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:39.067305983Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:39.067307262Z │ │ 2025-03-25T15:47:39.067308377Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:39.067309629Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:39.067310840Z │ 22 try: │ 2025-03-25T15:47:39.067312102Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:39.067313565Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:39.067314963Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:39.067316498Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:39.067318786Z │ │ 2025-03-25T15:47:39.067319972Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:39.067321139Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:39.067322473Z │ │ 2025-03-25T15:47:39.067323622Z │ 29 │ 2025-03-25T15:47:39.067324768Z │ 30 │ 2025-03-25T15:47:39.067325902Z │ 31 │ 2025-03-25T15:47:39.067327062Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:39.067328539Z │ 33 │ 2025-03-25T15:47:39.067329741Z │ 34 │ 2025-03-25T15:47:39.067330918Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:39.067332177Z ImportError: 2025-03-25T15:47:39.067333320Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:39.067334432Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:39.067335592Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:39.067336934Z shared object requires: Invalid argument 2025-03-25T15:47:39.067655115Z [03/25/25 15:47:39] INFO Worker exiting (pid: 2857) 2025-03-25T15:47:39.110873417Z [03/25/25 15:47:39] ERROR Worker (pid:2857) exited with code 3 2025-03-25T15:47:39.111412629Z [03/25/25 15:47:39] ERROR Shutting down: Master 2025-03-25T15:47:39.111798085Z [03/25/25 15:47:39] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:40.689062256Z [03/25/25 15:47:40] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:40.689690073Z [03/25/25 15:47:40] INFO Listening at: http://0.0.0.0:3003 (2859) 2025-03-25T15:47:40.690088621Z [03/25/25 15:47:40] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:40.693984900Z [03/25/25 15:47:40] INFO Booting worker with pid: 2862 2025-03-25T15:47:40.972676842Z [03/25/25 15:47:40] ERROR Exception in worker process 2025-03-25T15:47:40.972699868Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:40.972703920Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:40.972706554Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:40.972709180Z │ │ 2025-03-25T15:47:40.972711275Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:40.972713759Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:40.972716191Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:40.972718465Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:40.972727741Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:40.972730483Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:40.972732861Z │ 611 │ │ │ raise │ 2025-03-25T15:47:40.972735110Z │ │ 2025-03-25T15:47:40.972737141Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:40.972740267Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:40.972743023Z │ │ 2025-03-25T15:47:40.972745142Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:40.972747272Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:40.972749462Z │ 134 │ │ │ 2025-03-25T15:47:40.972751530Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:40.972753809Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:40.972755979Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:40.972758075Z │ 138 │ 2025-03-25T15:47:40.972760100Z │ │ 2025-03-25T15:47:40.972764284Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:40.972766589Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:40.972768881Z │ │ 2025-03-25T15:47:40.972770893Z │ 144 │ │ 2025-03-25T15:47:40.972773044Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:40.972775606Z │ 146 │ │ try: │ 2025-03-25T15:47:40.972777846Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:40.972780177Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:40.972782468Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:40.972784773Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:40.972786984Z │ │ 2025-03-25T15:47:40.972788959Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:40.972790978Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:40.972793243Z │ │ 2025-03-25T15:47:40.972795289Z │ 63 │ │ 2025-03-25T15:47:40.972797380Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:40.972801552Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:40.972804182Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:40.972806847Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:40.972809224Z │ 68 │ │ 2025-03-25T15:47:40.972811328Z │ 69 │ def run(self): │ 2025-03-25T15:47:40.972813620Z │ │ 2025-03-25T15:47:40.972815606Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:40.972817644Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:40.972819958Z │ │ 2025-03-25T15:47:40.972822003Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:40.972824468Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:40.972826719Z │ 56 │ │ else: │ 2025-03-25T15:47:40.972828944Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:40.972831336Z │ 58 │ 2025-03-25T15:47:40.972843586Z │ 59 │ 2025-03-25T15:47:40.972846108Z │ 60 def run(prog=None): │ 2025-03-25T15:47:40.972848507Z │ │ 2025-03-25T15:47:40.972850824Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:40.972853010Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:40.972855280Z │ │ 2025-03-25T15:47:40.972857278Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:40.972859615Z │ 45 │ │ 2025-03-25T15:47:40.972861705Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:40.972863998Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:40.972866430Z │ 48 │ │ 2025-03-25T15:47:40.972868642Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:40.972870954Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:40.972873359Z │ │ 2025-03-25T15:47:40.972875391Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:40.972879374Z │ til.py:370 in import_app │ 2025-03-25T15:47:40.972881776Z │ │ 2025-03-25T15:47:40.972884064Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:40.972886439Z │ 368 │ │ 2025-03-25T15:47:40.972888586Z │ 369 │ try: │ 2025-03-25T15:47:40.972890798Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:40.972892923Z │ 371 │ except ImportError: │ 2025-03-25T15:47:40.972895138Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:40.972897553Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:40.972899887Z │ │ 2025-03-25T15:47:40.972901860Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:40.972904109Z │ in import_module │ 2025-03-25T15:47:40.972906298Z │ │ 2025-03-25T15:47:40.972908354Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:40.972910765Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:40.972912978Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:40.972916722Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:40.972919470Z │ 127 │ 2025-03-25T15:47:40.972921638Z │ 128 │ 2025-03-25T15:47:40.972923736Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:40.972925830Z │ in _gcd_import:1204 │ 2025-03-25T15:47:40.972928014Z │ in _find_and_load:1176 │ 2025-03-25T15:47:40.972930119Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:40.972934384Z │ in _load_unlocked:690 │ 2025-03-25T15:47:40.972936602Z │ in exec_module:940 │ 2025-03-25T15:47:40.972938753Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:40.972940858Z │ │ 2025-03-25T15:47:40.972942928Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:40.972945178Z │ <module> │ 2025-03-25T15:47:40.972947336Z │ │ 2025-03-25T15:47:40.972949287Z │ 13 import orjson │ 2025-03-25T15:47:40.972951446Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:40.972955653Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:40.972958367Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:40.972961019Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:40.972963457Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:40.972965694Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:40.972968041Z │ │ 2025-03-25T15:47:40.972970060Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:40.972972120Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:40.972974454Z │ │ 2025-03-25T15:47:40.972976452Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:40.972978894Z │ 55 │ 2025-03-25T15:47:40.972980938Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:40.972983092Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:40.972985398Z │ 58 │ 2025-03-25T15:47:40.972989536Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:40.972992218Z │ F401 │ 2025-03-25T15:47:40.972994344Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:40.972996688Z │ │ 2025-03-25T15:47:40.972998684Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:40.973000761Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:40.973003021Z │ │ 2025-03-25T15:47:40.973005011Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:40.973007100Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:40.973009245Z │ 22 try: │ 2025-03-25T15:47:40.973011374Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:40.973013949Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:40.973016451Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:40.973019060Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:40.973023290Z │ │ 2025-03-25T15:47:40.973025468Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:40.973027563Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:40.973029934Z │ │ 2025-03-25T15:47:40.973031971Z │ 29 │ 2025-03-25T15:47:40.973034015Z │ 30 │ 2025-03-25T15:47:40.973036052Z │ 31 │ 2025-03-25T15:47:40.973038147Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:40.973040750Z │ 33 │ 2025-03-25T15:47:40.973042819Z │ 34 │ 2025-03-25T15:47:40.973044871Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:40.973047058Z ImportError: 2025-03-25T15:47:40.973049004Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:40.973050998Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:40.973053081Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:40.973055311Z shared object requires: Invalid argument 2025-03-25T15:47:40.973057384Z [03/25/25 15:47:40] INFO Worker exiting (pid: 2862) 2025-03-25T15:47:41.014140242Z [03/25/25 15:47:41] ERROR Worker (pid:2862) exited with code 3 2025-03-25T15:47:41.014667029Z [03/25/25 15:47:41] ERROR Shutting down: Master 2025-03-25T15:47:41.015083432Z [03/25/25 15:47:41] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:42.572267425Z [03/25/25 15:47:42] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:42.572892885Z [03/25/25 15:47:42] INFO Listening at: http://0.0.0.0:3003 (2864) 2025-03-25T15:47:42.573285497Z [03/25/25 15:47:42] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:42.575996502Z [03/25/25 15:47:42] INFO Booting worker with pid: 2867 2025-03-25T15:47:42.846686527Z [03/25/25 15:47:42] ERROR Exception in worker process 2025-03-25T15:47:42.846705617Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:42.846707956Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:42.846709406Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:42.846710867Z │ │ 2025-03-25T15:47:42.846712082Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:42.846713763Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:42.846715162Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:42.846716535Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:42.846723669Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:42.846725058Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:42.846726364Z │ 611 │ │ │ raise │ 2025-03-25T15:47:42.846727626Z │ │ 2025-03-25T15:47:42.846728799Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:42.846730552Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:42.846731900Z │ │ 2025-03-25T15:47:42.846733142Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:42.846734422Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:42.846735662Z │ 134 │ │ │ 2025-03-25T15:47:42.846736869Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:42.846738204Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:42.846739471Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:42.846740717Z │ 138 │ 2025-03-25T15:47:42.846741898Z │ │ 2025-03-25T15:47:42.846744164Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:42.846745366Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:42.846746640Z │ │ 2025-03-25T15:47:42.846747791Z │ 144 │ │ 2025-03-25T15:47:42.846749019Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:42.846750466Z │ 146 │ │ try: │ 2025-03-25T15:47:42.846751718Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:42.846753063Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:42.846754448Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:42.846755786Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:42.846757055Z │ │ 2025-03-25T15:47:42.846758200Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:42.846759377Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:42.846760666Z │ │ 2025-03-25T15:47:42.846761789Z │ 63 │ │ 2025-03-25T15:47:42.846762958Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:42.846765215Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:42.846766589Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:42.846768162Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:42.846769466Z │ 68 │ │ 2025-03-25T15:47:42.846770695Z │ 69 │ def run(self): │ 2025-03-25T15:47:42.846771964Z │ │ 2025-03-25T15:47:42.846773107Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:42.846774292Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:42.846775592Z │ │ 2025-03-25T15:47:42.846776748Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:42.846778121Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:42.846779416Z │ 56 │ │ else: │ 2025-03-25T15:47:42.846780667Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:42.846782018Z │ 58 │ 2025-03-25T15:47:42.846784139Z │ 59 │ 2025-03-25T15:47:42.846785339Z │ 60 def run(prog=None): │ 2025-03-25T15:47:42.846786656Z │ │ 2025-03-25T15:47:42.846787912Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:42.846789115Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:42.846790403Z │ │ 2025-03-25T15:47:42.846791540Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:42.846792874Z │ 45 │ │ 2025-03-25T15:47:42.846794064Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:42.846795396Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:42.846796888Z │ 48 │ │ 2025-03-25T15:47:42.846798093Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:42.846799408Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:42.846800833Z │ │ 2025-03-25T15:47:42.846801975Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:42.846804156Z │ til.py:370 in import_app │ 2025-03-25T15:47:42.846805459Z │ │ 2025-03-25T15:47:42.846806937Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:42.846808252Z │ 368 │ │ 2025-03-25T15:47:42.846809465Z │ 369 │ try: │ 2025-03-25T15:47:42.846810697Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:42.846811941Z │ 371 │ except ImportError: │ 2025-03-25T15:47:42.846813211Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:42.846814608Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:42.846815925Z │ │ 2025-03-25T15:47:42.846817053Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:42.846818354Z │ in import_module │ 2025-03-25T15:47:42.846819541Z │ │ 2025-03-25T15:47:42.846820687Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:42.846822028Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:42.846823258Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:42.846825419Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:42.846826751Z │ 127 │ 2025-03-25T15:47:42.846827931Z │ 128 │ 2025-03-25T15:47:42.846829125Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:42.846830281Z │ in _gcd_import:1204 │ 2025-03-25T15:47:42.846831485Z │ in _find_and_load:1176 │ 2025-03-25T15:47:42.846832663Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:42.846838879Z │ in _load_unlocked:690 │ 2025-03-25T15:47:42.846840183Z │ in exec_module:940 │ 2025-03-25T15:47:42.846841432Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:42.846842681Z │ │ 2025-03-25T15:47:42.846843856Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:42.846845111Z │ <module> │ 2025-03-25T15:47:42.846846358Z │ │ 2025-03-25T15:47:42.846847489Z │ 13 import orjson │ 2025-03-25T15:47:42.846848728Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:42.846851124Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:42.846852483Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:42.846854042Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:42.846855400Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:42.846856674Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:42.846858077Z │ │ 2025-03-25T15:47:42.846859215Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:42.846860394Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:42.846861699Z │ │ 2025-03-25T15:47:42.846862836Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:42.846864210Z │ 55 │ 2025-03-25T15:47:42.846865397Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:42.846866598Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:42.846867905Z │ 58 │ 2025-03-25T15:47:42.846870109Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:42.846871473Z │ F401 │ 2025-03-25T15:47:42.846872658Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:42.846873995Z │ │ 2025-03-25T15:47:42.846875122Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:42.846876357Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:42.846877604Z │ │ 2025-03-25T15:47:42.846878746Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:42.846880009Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:42.846881203Z │ 22 try: │ 2025-03-25T15:47:42.846882425Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:42.846883838Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:42.846885215Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:42.846886667Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:42.846889021Z │ │ 2025-03-25T15:47:42.846890180Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:42.846891389Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:42.846892680Z │ │ 2025-03-25T15:47:42.846893816Z │ 29 │ 2025-03-25T15:47:42.846895006Z │ 30 │ 2025-03-25T15:47:42.846896161Z │ 31 │ 2025-03-25T15:47:42.846897365Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:42.846898841Z │ 33 │ 2025-03-25T15:47:42.846899989Z │ 34 │ 2025-03-25T15:47:42.846901154Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:42.846902354Z ImportError: 2025-03-25T15:47:42.846903508Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:42.846904614Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:42.846905784Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:42.846907035Z shared object requires: Invalid argument 2025-03-25T15:47:42.847190442Z [03/25/25 15:47:42] INFO Worker exiting (pid: 2867) 2025-03-25T15:47:42.887238359Z [03/25/25 15:47:42] ERROR Worker (pid:2867) exited with code 3 2025-03-25T15:47:42.887749036Z [03/25/25 15:47:42] ERROR Shutting down: Master 2025-03-25T15:47:42.888097545Z [03/25/25 15:47:42] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:44.448530710Z [03/25/25 15:47:44] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:44.449101453Z [03/25/25 15:47:44] INFO Listening at: http://0.0.0.0:3003 (2869) 2025-03-25T15:47:44.449492383Z [03/25/25 15:47:44] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:44.452343218Z [03/25/25 15:47:44] INFO Booting worker with pid: 2872 2025-03-25T15:47:44.721480694Z [03/25/25 15:47:44] ERROR Exception in worker process 2025-03-25T15:47:44.721499216Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:44.721503351Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:44.721506030Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:44.721508658Z │ │ 2025-03-25T15:47:44.721510866Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:44.721513684Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:44.721516273Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:44.721518681Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:44.721528896Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:44.721531647Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:44.721534063Z │ 611 │ │ │ raise │ 2025-03-25T15:47:44.721536343Z │ │ 2025-03-25T15:47:44.721538445Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:44.721541444Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:44.721543955Z │ │ 2025-03-25T15:47:44.721548669Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:44.721550926Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:44.721553089Z │ 134 │ │ │ 2025-03-25T15:47:44.721555266Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:44.721557583Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:44.721559885Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:44.721562097Z │ 138 │ 2025-03-25T15:47:44.721564195Z │ │ 2025-03-25T15:47:44.721568639Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:44.721570977Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:44.721573289Z │ │ 2025-03-25T15:47:44.721575257Z │ 144 │ │ 2025-03-25T15:47:44.721577398Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:44.721580001Z │ 146 │ │ try: │ 2025-03-25T15:47:44.721582357Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:44.721584662Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:44.721587009Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:44.721589298Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:44.721591485Z │ │ 2025-03-25T15:47:44.721593491Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:44.721595543Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:44.721597840Z │ │ 2025-03-25T15:47:44.721599925Z │ 63 │ │ 2025-03-25T15:47:44.721602095Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:44.721606226Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:44.721608786Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:44.721611423Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:44.721613796Z │ 68 │ │ 2025-03-25T15:47:44.721615880Z │ 69 │ def run(self): │ 2025-03-25T15:47:44.721618219Z │ │ 2025-03-25T15:47:44.721620240Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:44.721622319Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:44.721624579Z │ │ 2025-03-25T15:47:44.721626544Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:44.721628947Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:44.721631226Z │ 56 │ │ else: │ 2025-03-25T15:47:44.721633402Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:44.721635752Z │ 58 │ 2025-03-25T15:47:44.721639490Z │ 59 │ 2025-03-25T15:47:44.721641719Z │ 60 def run(prog=None): │ 2025-03-25T15:47:44.721644018Z │ │ 2025-03-25T15:47:44.721646290Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:44.721648457Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:44.721650751Z │ │ 2025-03-25T15:47:44.721652772Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:44.721655092Z │ 45 │ │ 2025-03-25T15:47:44.721657318Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:44.721659680Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:44.721662082Z │ 48 │ │ 2025-03-25T15:47:44.721664190Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:44.721666469Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:44.721668880Z │ │ 2025-03-25T15:47:44.721670930Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:44.721674723Z │ til.py:370 in import_app │ 2025-03-25T15:47:44.721677216Z │ │ 2025-03-25T15:47:44.721679447Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:44.721681795Z │ 368 │ │ 2025-03-25T15:47:44.721683936Z │ 369 │ try: │ 2025-03-25T15:47:44.721686139Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:44.721688257Z │ 371 │ except ImportError: │ 2025-03-25T15:47:44.721690586Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:44.721693064Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:44.721695441Z │ │ 2025-03-25T15:47:44.721697468Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:44.721699684Z │ in import_module │ 2025-03-25T15:47:44.721701773Z │ │ 2025-03-25T15:47:44.721703753Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:44.721706123Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:44.721708287Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:44.721712225Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:44.721714965Z │ 127 │ 2025-03-25T15:47:44.721717126Z │ 128 │ 2025-03-25T15:47:44.721719201Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:44.721721224Z │ in _gcd_import:1204 │ 2025-03-25T15:47:44.721723368Z │ in _find_and_load:1176 │ 2025-03-25T15:47:44.721725456Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:44.721727570Z │ in _load_unlocked:690 │ 2025-03-25T15:47:44.721729739Z │ in exec_module:940 │ 2025-03-25T15:47:44.721731964Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:44.721734148Z │ │ 2025-03-25T15:47:44.721736160Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:44.721738409Z │ <module> │ 2025-03-25T15:47:44.721740575Z │ │ 2025-03-25T15:47:44.721742610Z │ 13 import orjson │ 2025-03-25T15:47:44.721744810Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:44.721749063Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:44.721751832Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:44.721754493Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:44.721756878Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:44.721759159Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:44.721761537Z │ │ 2025-03-25T15:47:44.721763595Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:44.721765609Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:44.721767961Z │ │ 2025-03-25T15:47:44.721769991Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:44.721772383Z │ 55 │ 2025-03-25T15:47:44.721774431Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:44.721776547Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:44.721778789Z │ 58 │ 2025-03-25T15:47:44.721782597Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:44.721785336Z │ F401 │ 2025-03-25T15:47:44.721787482Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:44.721789893Z │ │ 2025-03-25T15:47:44.721791899Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:44.721793919Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:44.721796161Z │ │ 2025-03-25T15:47:44.721798152Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:44.721800366Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:44.721802478Z │ 22 try: │ 2025-03-25T15:47:44.721804631Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:44.721807207Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:44.721809735Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:44.721812404Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:44.721816982Z │ │ 2025-03-25T15:47:44.721819198Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:44.721821261Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:44.721823618Z │ │ 2025-03-25T15:47:44.721825635Z │ 29 │ 2025-03-25T15:47:44.721827721Z │ 30 │ 2025-03-25T15:47:44.721829753Z │ 31 │ 2025-03-25T15:47:44.721831794Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:44.721834321Z │ 33 │ 2025-03-25T15:47:44.721842640Z │ 34 │ 2025-03-25T15:47:44.721844947Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:44.721847391Z ImportError: 2025-03-25T15:47:44.721849457Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:44.721851472Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:44.721853599Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:44.721855981Z shared object requires: Invalid argument 2025-03-25T15:47:44.722060624Z [03/25/25 15:47:44] INFO Worker exiting (pid: 2872) 2025-03-25T15:47:44.761628799Z [03/25/25 15:47:44] ERROR Worker (pid:2872) exited with code 3 2025-03-25T15:47:44.762204385Z [03/25/25 15:47:44] ERROR Shutting down: Master 2025-03-25T15:47:44.762564131Z [03/25/25 15:47:44] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:46.321850019Z [03/25/25 15:47:46] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:46.322479835Z [03/25/25 15:47:46] INFO Listening at: http://0.0.0.0:3003 (2874) 2025-03-25T15:47:46.322910124Z [03/25/25 15:47:46] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:46.325648548Z [03/25/25 15:47:46] INFO Booting worker with pid: 2877 2025-03-25T15:47:46.595377028Z [03/25/25 15:47:46] ERROR Exception in worker process 2025-03-25T15:47:46.595393158Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:46.595396396Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:46.595397906Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:46.595399619Z │ │ 2025-03-25T15:47:46.595400885Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:46.595402397Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:46.595403861Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:46.595410002Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:46.595411345Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:46.595412646Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:46.595414039Z │ 611 │ │ │ raise │ 2025-03-25T15:47:46.595415358Z │ │ 2025-03-25T15:47:46.595416529Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:46.595418534Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:46.595419938Z │ │ 2025-03-25T15:47:46.595421102Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:46.595422331Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:46.595423631Z │ 134 │ │ │ 2025-03-25T15:47:46.595424861Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:46.595426217Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:46.595427494Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:46.595428722Z │ 138 │ 2025-03-25T15:47:46.595429901Z │ │ 2025-03-25T15:47:46.595432515Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:46.595433760Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:46.595435114Z │ │ 2025-03-25T15:47:46.595436280Z │ 144 │ │ 2025-03-25T15:47:46.595437594Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:46.595439171Z │ 146 │ │ try: │ 2025-03-25T15:47:46.595440475Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:46.595441823Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:46.595443183Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:46.595444508Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:46.595445770Z │ │ 2025-03-25T15:47:46.595446940Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:46.595448117Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:46.595449425Z │ │ 2025-03-25T15:47:46.595450574Z │ 63 │ │ 2025-03-25T15:47:46.595451757Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:46.595454137Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:46.595455529Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:46.595457134Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:46.595458451Z │ 68 │ │ 2025-03-25T15:47:46.595459674Z │ 69 │ def run(self): │ 2025-03-25T15:47:46.595461024Z │ │ 2025-03-25T15:47:46.595462225Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:46.595466393Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:46.595467773Z │ │ 2025-03-25T15:47:46.595468936Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:46.595470376Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:46.595471675Z │ 56 │ │ else: │ 2025-03-25T15:47:46.595472984Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:46.595474400Z │ 58 │ 2025-03-25T15:47:46.595476594Z │ 59 │ 2025-03-25T15:47:46.595477792Z │ 60 def run(prog=None): │ 2025-03-25T15:47:46.595479115Z │ │ 2025-03-25T15:47:46.595480381Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:46.595481609Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:46.595482935Z │ │ 2025-03-25T15:47:46.595484112Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:46.595485540Z │ 45 │ │ 2025-03-25T15:47:46.595486753Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:46.595488079Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:46.595489552Z │ 48 │ │ 2025-03-25T15:47:46.595490734Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:46.595492042Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:46.595493466Z │ │ 2025-03-25T15:47:46.595494630Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:46.595496891Z │ til.py:370 in import_app │ 2025-03-25T15:47:46.595498201Z │ │ 2025-03-25T15:47:46.595499447Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:46.595500804Z │ 368 │ │ 2025-03-25T15:47:46.595502057Z │ 369 │ try: │ 2025-03-25T15:47:46.595503314Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:46.595504541Z │ 371 │ except ImportError: │ 2025-03-25T15:47:46.595505852Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:46.595507266Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:46.595508625Z │ │ 2025-03-25T15:47:46.595509808Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:46.595511131Z │ in import_module │ 2025-03-25T15:47:46.595512390Z │ │ 2025-03-25T15:47:46.595513555Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:46.595514898Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:46.595517933Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:46.595519184Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:46.595520564Z │ 127 │ 2025-03-25T15:47:46.595521775Z │ 128 │ 2025-03-25T15:47:46.595523201Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:46.595524352Z │ in _gcd_import:1204 │ 2025-03-25T15:47:46.595525696Z │ in _find_and_load:1176 │ 2025-03-25T15:47:46.595527037Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:46.595528264Z │ in _load_unlocked:690 │ 2025-03-25T15:47:46.595529505Z │ in exec_module:940 │ 2025-03-25T15:47:46.595530696Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:46.595531940Z │ │ 2025-03-25T15:47:46.595533094Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:46.595534370Z │ <module> │ 2025-03-25T15:47:46.595535624Z │ │ 2025-03-25T15:47:46.595536774Z │ 13 import orjson │ 2025-03-25T15:47:46.595538042Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:46.595541256Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:46.595542664Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:46.595544236Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:46.595545632Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:46.595547003Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:46.595548484Z │ │ 2025-03-25T15:47:46.595549765Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:46.595550998Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:46.595552342Z │ │ 2025-03-25T15:47:46.595553497Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:46.595554928Z │ 55 │ 2025-03-25T15:47:46.595556107Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:46.595557329Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:46.595558685Z │ 58 │ 2025-03-25T15:47:46.595560944Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:46.595562385Z │ F401 │ 2025-03-25T15:47:46.595563629Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:46.595564980Z │ │ 2025-03-25T15:47:46.595566152Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:46.595567366Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:46.595568654Z │ │ 2025-03-25T15:47:46.595569815Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:46.595571032Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:46.595572277Z │ 22 try: │ 2025-03-25T15:47:46.595573515Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:46.595575046Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:46.595757630Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:46.595760346Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:46.595763180Z │ │ 2025-03-25T15:47:46.595764363Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:46.595765583Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:46.595767002Z │ │ 2025-03-25T15:47:46.595768162Z │ 29 │ 2025-03-25T15:47:46.595769334Z │ 30 │ 2025-03-25T15:47:46.595770493Z │ 31 │ 2025-03-25T15:47:46.595771692Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:46.595773438Z │ 33 │ 2025-03-25T15:47:46.595775476Z │ 34 │ 2025-03-25T15:47:46.595777344Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:46.595779303Z ImportError: 2025-03-25T15:47:46.595781080Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:46.595782804Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:46.595784669Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:46.595786784Z shared object requires: Invalid argument 2025-03-25T15:47:46.595941141Z [03/25/25 15:47:46] INFO Worker exiting (pid: 2877) 2025-03-25T15:47:46.641532451Z [03/25/25 15:47:46] ERROR Worker (pid:2877) exited with code 3 2025-03-25T15:47:46.642190399Z [03/25/25 15:47:46] ERROR Shutting down: Master 2025-03-25T15:47:46.642514741Z [03/25/25 15:47:46] ERROR Reason: Worker failed to boot. 2025-03-25T15:47:48.208697566Z [03/25/25 15:47:48] INFO Starting gunicorn 23.0.0 2025-03-25T15:47:48.209300736Z [03/25/25 15:47:48] INFO Listening at: http://0.0.0.0:3003 (2879) 2025-03-25T15:47:48.209679306Z [03/25/25 15:47:48] INFO Using worker: uvicorn.workers.UvicornWorker 2025-03-25T15:47:48.212397361Z [03/25/25 15:47:48] INFO Booting worker with pid: 2882 2025-03-25T15:47:48.481414116Z [03/25/25 15:47:48] ERROR Exception in worker process 2025-03-25T15:47:48.481429128Z ╭─────── Traceback (most recent call last) ───────╮ 2025-03-25T15:47:48.481431588Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:48.481432966Z │ rbiter.py:608 in spawn_worker │ 2025-03-25T15:47:48.481434336Z │ │ 2025-03-25T15:47:48.481435560Z │ 605 │ │ │ util._setproctitle("worker [% │ 2025-03-25T15:47:48.481437197Z │ 606 │ │ │ self.log.info("Booting worker │ 2025-03-25T15:47:48.481438653Z │ 607 │ │ │ self.cfg.post_fork(self, work │ 2025-03-25T15:47:48.481443583Z │ ❱ 608 │ │ │ worker.init_process() │ 2025-03-25T15:47:48.481444936Z │ 609 │ │ │ sys.exit(0) │ 2025-03-25T15:47:48.481446262Z │ 610 │ │ except SystemExit: │ 2025-03-25T15:47:48.481447629Z │ 611 │ │ │ raise │ 2025-03-25T15:47:48.481448925Z │ │ 2025-03-25T15:47:48.481450084Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:48.481451839Z │ orkers/base.py:135 in init_process │ 2025-03-25T15:47:48.481453287Z │ │ 2025-03-25T15:47:48.481454519Z │ 132 │ │ │ self.reloader = reloader_cls( │ 2025-03-25T15:47:48.481455766Z │ 133 │ │ │ │ │ │ │ │ │ │ │ 2025-03-25T15:47:48.481457024Z │ 134 │ │ │ 2025-03-25T15:47:48.481458224Z │ ❱ 135 │ │ self.load_wsgi() │ 2025-03-25T15:47:48.481459555Z │ 136 │ │ if self.reloader: │ 2025-03-25T15:47:48.481460826Z │ 137 │ │ │ self.reloader.start() │ 2025-03-25T15:47:48.481462076Z │ 138 │ 2025-03-25T15:47:48.481463333Z │ │ 2025-03-25T15:47:48.481465606Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/w │ 2025-03-25T15:47:48.481466812Z │ orkers/base.py:147 in load_wsgi │ 2025-03-25T15:47:48.481468123Z │ │ 2025-03-25T15:47:48.481469273Z │ 144 │ │ 2025-03-25T15:47:48.481470498Z │ 145 │ def load_wsgi(self): │ 2025-03-25T15:47:48.481471978Z │ 146 │ │ try: │ 2025-03-25T15:47:48.481473279Z │ ❱ 147 │ │ │ self.wsgi = self.app.wsgi() │ 2025-03-25T15:47:48.481474587Z │ 148 │ │ except SyntaxError as e: │ 2025-03-25T15:47:48.481475936Z │ 149 │ │ │ if not self.cfg.reload: │ 2025-03-25T15:47:48.481477563Z │ 150 │ │ │ │ raise │ 2025-03-25T15:47:48.481478834Z │ │ 2025-03-25T15:47:48.481479955Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:48.481481145Z │ pp/base.py:66 in wsgi │ 2025-03-25T15:47:48.481482430Z │ │ 2025-03-25T15:47:48.481483647Z │ 63 │ │ 2025-03-25T15:47:48.481485909Z │ 64 │ def wsgi(self): │ 2025-03-25T15:47:48.481487260Z │ 65 │ │ if self.callable is None: │ 2025-03-25T15:47:48.481488638Z │ ❱ 66 │ │ │ self.callable = self.load() │ 2025-03-25T15:47:48.481490183Z │ 67 │ │ return self.callable │ 2025-03-25T15:47:48.481491504Z │ 68 │ │ 2025-03-25T15:47:48.481492701Z │ 69 │ def run(self): │ 2025-03-25T15:47:48.481494006Z │ │ 2025-03-25T15:47:48.481495170Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:48.481496406Z │ pp/wsgiapp.py:57 in load │ 2025-03-25T15:47:48.481497689Z │ │ 2025-03-25T15:47:48.481498826Z │ 54 │ │ if self.cfg.paste is not None: │ 2025-03-25T15:47:48.481500280Z │ 55 │ │ │ return self.load_pasteapp() │ 2025-03-25T15:47:48.481501616Z │ 56 │ │ else: │ 2025-03-25T15:47:48.481502868Z │ ❱ 57 │ │ │ return self.load_wsgiapp() │ 2025-03-25T15:47:48.481504230Z │ 58 │ 2025-03-25T15:47:48.481506454Z │ 59 │ 2025-03-25T15:47:48.481507638Z │ 60 def run(prog=None): │ 2025-03-25T15:47:48.481508926Z │ │ 2025-03-25T15:47:48.481510191Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/a │ 2025-03-25T15:47:48.481511384Z │ pp/wsgiapp.py:47 in load_wsgiapp │ 2025-03-25T15:47:48.481512696Z │ │ 2025-03-25T15:47:48.481513876Z │ 44 │ │ │ │ raise ConfigError("No appl │ 2025-03-25T15:47:48.481515216Z │ 45 │ │ 2025-03-25T15:47:48.481516533Z │ 46 │ def load_wsgiapp(self): │ 2025-03-25T15:47:48.481517935Z │ ❱ 47 │ │ return util.import_app(self.app_ur │ 2025-03-25T15:47:48.481519301Z │ 48 │ │ 2025-03-25T15:47:48.481520484Z │ 49 │ def load_pasteapp(self): │ 2025-03-25T15:47:48.481521821Z │ 50 │ │ from .pasterapp import get_wsgi_ap │ 2025-03-25T15:47:48.481523244Z │ │ 2025-03-25T15:47:48.481524373Z │ /lsiopy/lib/python3.11/site-packages/gunicorn/u │ 2025-03-25T15:47:48.481526459Z │ til.py:370 in import_app │ 2025-03-25T15:47:48.481527785Z │ │ 2025-03-25T15:47:48.481529002Z │ 367 │ │ module, obj = parts[0], parts[1] │ 2025-03-25T15:47:48.481530323Z │ 368 │ │ 2025-03-25T15:47:48.481531532Z │ 369 │ try: │ 2025-03-25T15:47:48.481532818Z │ ❱ 370 │ │ mod = importlib.import_module(mod │ 2025-03-25T15:47:48.481534114Z │ 371 │ except ImportError: │ 2025-03-25T15:47:48.481535421Z │ 372 │ │ if module.endswith(".py") and os. │ 2025-03-25T15:47:48.481536839Z │ 373 │ │ │ msg = "Failed to find applica │ 2025-03-25T15:47:48.481538170Z │ │ 2025-03-25T15:47:48.481539308Z │ /usr/lib/python3.11/importlib/__init__.py:126 │ 2025-03-25T15:47:48.481540620Z │ in import_module │ 2025-03-25T15:47:48.481541841Z │ │ 2025-03-25T15:47:48.481543051Z │ 123 │ │ │ if character != '.': │ 2025-03-25T15:47:48.481544406Z │ 124 │ │ │ │ break │ 2025-03-25T15:47:48.481546659Z │ 125 │ │ │ level += 1 │ 2025-03-25T15:47:48.481547918Z │ ❱ 126 │ return _bootstrap._gcd_import(name[le │ 2025-03-25T15:47:48.481549262Z │ 127 │ 2025-03-25T15:47:48.481550459Z │ 128 │ 2025-03-25T15:47:48.481551625Z │ 129 _RELOADING = {} │ 2025-03-25T15:47:48.481552804Z │ in _gcd_import:1204 │ 2025-03-25T15:47:48.481554062Z │ in _find_and_load:1176 │ 2025-03-25T15:47:48.481555264Z │ in _find_and_load_unlocked:1147 │ 2025-03-25T15:47:48.481556452Z │ in _load_unlocked:690 │ 2025-03-25T15:47:48.481557687Z │ in exec_module:940 │ 2025-03-25T15:47:48.481558910Z │ in _call_with_frames_removed:241 │ 2025-03-25T15:47:48.481560159Z │ │ 2025-03-25T15:47:48.481561405Z │ /app/immich/machine-learning/app/main.py:16 in │ 2025-03-25T15:47:48.481562745Z │ <module> │ 2025-03-25T15:47:48.481564028Z │ │ 2025-03-25T15:47:48.481565179Z │ 13 import orjson │ 2025-03-25T15:47:48.481566447Z │ 14 from fastapi import Depends, FastAPI, Fil │ 2025-03-25T15:47:48.481568894Z │ 15 from fastapi.responses import ORJSONRespo │ 2025-03-25T15:47:48.481571402Z │ ❱ 16 from onnxruntime.capi.onnxruntime_pybind1 │ 2025-03-25T15:47:48.481572975Z │ 17 from PIL.Image import Image │ 2025-03-25T15:47:48.481574365Z │ 18 from pydantic import ValidationError │ 2025-03-25T15:47:48.481575658Z │ 19 from starlette.formparsers import MultiPa │ 2025-03-25T15:47:48.481577102Z │ │ 2025-03-25T15:47:48.481578374Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:48.481579569Z │ e/__init__.py:57 in <module> │ 2025-03-25T15:47:48.481580888Z │ │ 2025-03-25T15:47:48.481582062Z │ 54 from onnxruntime.capi import onnxruntime_v │ 2025-03-25T15:47:48.481583511Z │ 55 │ 2025-03-25T15:47:48.481584661Z │ 56 if import_capi_exception: │ 2025-03-25T15:47:48.481585846Z │ ❱ 57 │ raise import_capi_exception │ 2025-03-25T15:47:48.481587224Z │ 58 │ 2025-03-25T15:47:48.481589854Z │ 59 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:48.481591262Z │ F401 │ 2025-03-25T15:47:48.481592464Z │ 60 from onnxruntime.capi.onnxruntime_inferenc │ 2025-03-25T15:47:48.481593785Z │ │ 2025-03-25T15:47:48.481594960Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:48.481596173Z │ e/__init__.py:23 in <module> │ 2025-03-25T15:47:48.481597499Z │ │ 2025-03-25T15:47:48.481598649Z │ 20 # meaningful messages to the user. │ 2025-03-25T15:47:48.481599881Z │ 21 # the saved exception is raised after devi │ 2025-03-25T15:47:48.481601088Z │ 22 try: │ 2025-03-25T15:47:48.481602313Z │ ❱ 23 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:48.481603766Z │ 24 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:48.481605202Z │ 25 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:48.481606696Z │ 26 │ from onnxruntime.capi._pybind_state im │ 2025-03-25T15:47:48.481608989Z │ │ 2025-03-25T15:47:48.481610175Z │ /lsiopy/lib/python3.11/site-packages/onnxruntim │ 2025-03-25T15:47:48.481611386Z │ e/capi/_pybind_state.py:32 in <module> │ 2025-03-25T15:47:48.481612690Z │ │ 2025-03-25T15:47:48.481613862Z │ 29 │ 2025-03-25T15:47:48.481615044Z │ 30 │ 2025-03-25T15:47:48.481616195Z │ 31 │ 2025-03-25T15:47:48.481617396Z │ ❱ 32 from .onnxruntime_pybind11_state import * │ 2025-03-25T15:47:48.481618916Z │ 33 │ 2025-03-25T15:47:48.481620082Z │ 34 │ 2025-03-25T15:47:48.481621248Z ╰─────────────────────────────────────────────────╯ 2025-03-25T15:47:48.481622525Z ImportError: 2025-03-25T15:47:48.481623661Z /lsiopy/lib/python3.11/site-packages/onnxruntime/ca 2025-03-25T15:47:48.481624788Z pi/onnxruntime_pybind11_state.cpython-311-x86_64-li 2025-03-25T15:47:48.481625951Z nux-gnu.so: cannot enable executable stack as 2025-03-25T15:47:48.481627204Z shared object requires: Invalid argument 2025-03-25T15:47:48.481794855Z [03/25/25 15:47:48] INFO Worker exiting (pid: 2882) 2025-03-25T15:47:48.524280684Z [03/25/25 15:47:48] ERROR Worker (pid:2882) exited with code 3 2025-03-25T15:47:48.524853760Z [03/25/25 15:47:48] ERROR Shutting down: Master 2025-03-25T15:47:48.525184119Z [03/25/25 15:47:48] ERROR Reason: Worker failed to boot.