Commit graph

37 commits

Author SHA1 Message Date
asonix
4976fcb2eb Remove unneeded code 2024-03-09 22:53:46 -06:00
asonix
aa4582a3f8 Remove unused store method 2024-03-09 15:38:39 -06:00
asonix
04dcc9a0c8 Include file extension in identifiers 2024-02-27 20:41:25 -06:00
asonix
7c6112e631 ffprobe: read from file, simplify input-file access 2024-02-25 13:05:47 -06:00
asonix
16bf18bda4 Remove some Unpin and 'static bounds 2024-02-22 18:05:04 -06:00
asonix
3a7d5b7bfb Re-use try_from_stream where possible 2024-02-22 16:10:34 -06:00
asonix
f6087d65be Use async fn in trait for Store 2024-01-15 15:51:20 -05:00
asonix
bfc2410552 Add trace-level logs to every loop (paranoid) 2023-12-28 11:58:38 -06:00
asonix
b452a577a7 Add object ID to not found error 2023-12-11 13:05:29 -06:00
asonix
d28c1ac628 Upgrade Concurrency: Update docs, configs, limit maxiumum details operations 2023-10-03 17:04:40 -05:00
asonix
a4b1ab7dfb Instrument postgres db calls 2023-09-04 21:51:27 -05:00
asonix
8921f57a21 Remove Identifier trait, Replace with Arc<str> 2023-09-02 18:38:02 -05:00
asonix
ba3a23ed43 Add error codes 2023-09-01 20:51:01 -05:00
asonix
8f50a15b25 Reduce reliance on futures-util 2023-08-23 11:59:42 -05:00
asonix
1ee77b19d8 Make Repo object safe. Create migration 2023-08-15 19:19:03 -05:00
asonix
35d0c065e9 Start work on 0.5 db format - initial queuerepo changes 2023-08-13 14:12:38 -05:00
asonix
4d78ce7689 Fix store delegation for public_url 2023-07-14 15:23:07 -05:00
asonix
786f583d98 Add public_url to Store for optional redirects to public object store urls
Add details generation to file migration to set the content-type for uploads
2023-07-14 14:53:37 -05:00
asonix
9e7376d411 Remove is_missing error, make Identifier and DeleteToken return Option on fetch 2023-07-07 13:17:26 -05:00
asonix
7274538b70 Try adding store healthcheck 2023-07-07 12:05:42 -05:00
asonix
23e67b9697 Enhance migration handling of missing identifiers
Queue a cleanup task for hashes that don't have original file identifiers
Be more specific about what field is missing when a field is missing
2023-07-05 09:52:19 -05:00
asonix
c8e84b8914 Greatly improve error information during migration 2023-07-02 21:07:15 -05:00
asonix
a1d48cbb42 Share client between object store and request extractor
Add config to limit connection pool size
2023-06-23 11:20:20 -05:00
asonix
554d852e68 Create unique errors for Repo and Store, separate from UploadError
Add .is_not_found() for Store errors, wire up Object and File storage to properly set NotFound
Allow skipping files that are not found during store migration
2023-06-20 15:59:08 -05:00
asonix
9db057fdc5 Add admin endpoint to fetch identifier from an alias 2022-09-25 20:59:57 -05:00
asonix
25209e29c0 Make it compile 2022-09-24 17:18:53 -05:00
asonix
ff1771e016 More migration work for rusty-s3 2022-09-24 14:18:49 -05:00
asonix
c5b107eb4c clippy 2022-09-11 10:04:37 -05:00
asonix
7f49af58fe Update actix-form-data, impl Store & Repo for Data<T> 2022-09-10 19:29:22 -05:00
Aode (lion)
6ed592c432 In Progress: process jobs
- Is this a good idea? it definitely will make interacting with pict-rs harder. Maybe it's best not to do this
2022-04-01 16:51:12 -05:00
Aode (lion)
37e6b21b55 Fix Range, consolidate errors, test object storage 2022-03-26 20:45:12 -05:00
Aode (lion)
15b52ba6ec Get it compiling again 2022-03-26 16:49:23 -05:00
Aode (lion)
323016f994 Build out migration path 2022-03-25 18:47:50 -05:00
Aode (lion)
0d153ca239 Make stores take filename into account when saving files 2021-11-16 09:45:16 -06:00
Aode (lion)
cf50da30ec Use rust-s3 fork with asyncwrite support 2021-10-31 12:35:11 -05:00
Aode (lion)
f9f4fc63d6 Optionally support s3-compatible storage (untested) 2021-10-27 23:06:03 -05:00
Aode (lion)
48557bc2ea Make pict-rs generic over file storage 2021-10-22 23:48:56 -05:00