mirrors/pict-rs
1
0
Fork 0
mirror of https://git.asonix.dog/asonix/pict-rs.git synced 2024-07-02 15:25:47 +00:00
Code Issues Packages Projects Releases Wiki Activity
680 commits 23 branches 310 tags 5.2 MiB
Commit graph

28 commits

Author SHA1 Message Date
asonix 23e67b9697 Enhance migration handling of missing identifiers 
Queue a cleanup task for hashes that don't have original file identifiers
Be more specific about what field is missing when a field is missing
 2023-07-05 09:52:19 -05:00
asonix 01d3610f46 Add basic progress indication for store migration 2023-06-29 11:39:47 -05:00
asonix 554d852e68 Create unique errors for Repo and Store, separate from UploadError 
Add .is_not_found() for Store errors, wire up Object and File storage to properly set NotFound
Allow skipping files that are not found during store migration
 2023-06-20 15:59:08 -05:00
asonix 281ac43dff Remove cache functionality 2023-02-25 11:34:48 -06:00
asonix 138499d47f Use transpose in a couple places 2023-02-05 20:50:59 -06:00
asonix f0f40db8c3 Add healthcheck for db 2023-01-29 11:36:09 -06:00
asonix 5e5dd27a05 Retry migrate_file, remove variant before relating new one 2023-01-04 18:58:05 -06:00
asonix 669b3fb86f Fix webp metadata stripping, more tracing cleanup 2022-10-01 22:47:52 -05:00
asonix 718f09c43a Clean tracing, simplify validation, rename InputFormat -> VideoFormat 2022-10-01 21:17:18 -05:00
asonix 29cab025c6 Improve 0.3 migration code, repo traces 2022-09-27 23:19:52 -05:00
asonix 21e3e63ac3 Instrument upload store methods 2022-09-25 18:46:50 -05:00
asonix dc73bdbad4 Make already-claimed a 400 2022-06-05 23:24:58 -05:00
Aode (Lion) b3cbda1337 Add internal endpoint for cleaning variants 2022-04-11 16:56:39 -05:00
Aode (Lion) 05e2cf5e08 Cache on Alias rather than Hash 
Make sled repo blocking tasks share parent span
 2022-04-06 12:14:12 -05:00
Aode (Lion) 865f4ee09c Caching works: 
- Insert new bucket for current access time before removing
    previous access time record.
- Add instrument to more methods for more precise tracing
 2022-04-05 21:47:35 -05:00
Aode (Lion) 6cdae7b318 Add 'cache' endpoint for ingesting ephemeral media 
By default, cached media should only stick around for 7 days, however
The timeout is reset every time media is accessed, so only obscure
cached media will be flushed from the cache. This '7 days' number is
configurable through the commandline run options as --media-cache-duration
and in the pict-rs.toml file as [media] cache_duration
 2022-04-05 20:29:30 -05:00
Aode (lion) 8734dfbdc7 Add backgrounding routes 
- Accept backgrounded uploads
- Allow backgrounded processing

Still TODO:
- Endpoint for waiting on/claiming an upload
 2022-04-02 20:56:29 -05:00
Aode (Lion) c4d014597e Better job recovery 2022-04-02 18:53:03 -05:00
Aode (Lion) 77a400c7ca Implement UploadRepo 2022-04-02 17:41:00 -05:00
Aode (Lion) 09f53b9ce6 Move away from UploadManager to direct repo & store actions 2022-04-02 16:44:03 -05:00
Aode (lion) c0d8e0e8e3 Support multiple queues for job processor 2022-04-01 11:51:46 -05:00
Aode (lion) 63d66050c8 Enable buffering iterator items for iterstream 2022-03-29 16:18:00 -05:00
Aode (lion) 5adb3fde89 Move some Stream implementations into 'stream' module 2022-03-29 15:59:17 -05:00
Aode (lion) 602d1ea935 Begin implementing queue, put cleanups in it 2022-03-29 12:51:16 -05:00
Aode (lion) 37e6b21b55 Fix Range, consolidate errors, test object storage 2022-03-26 20:45:12 -05:00
Aode (lion) 15b52ba6ec Get it compiling again 2022-03-26 16:49:23 -05:00
Aode (lion) 323016f994 Build out migration path 2022-03-25 18:47:50 -05:00
Aode (lion) d6567fbbbd Implement sled repo 2022-03-24 17:09:15 -05:00