Commit graph

507 commits

Author SHA1 Message Date
Aode (lion)
82b7caf60e bash example: Add more duplicate uploads 2022-04-03 12:55:16 -05:00
Aode (lion)
044d24c92d Add bash client example for testing backgrounded operations 2022-04-03 12:53:14 -05:00
Aode (lion)
409b7d4c54 Remove unused conversions 2022-04-03 12:51:21 -05:00
Aode (lion)
29f0774331 Add ability to claim uploads 2022-04-02 21:15:39 -05:00
Aode (lion)
8734dfbdc7 Add backgrounding routes
- Accept backgrounded uploads
- Allow backgrounded processing

Still TODO:
- Endpoint for waiting on/claiming an upload
2022-04-02 20:56:29 -05:00
Aode (Lion)
c4d014597e Better job recovery 2022-04-02 18:53:03 -05:00
Aode (Lion)
77a400c7ca Implement UploadRepo 2022-04-02 17:41:00 -05:00
Aode (Lion)
132e395e5c Multiple items:
- Reduce duplicate work in generate job
- Use hash instead of identifier for unique processing
- Move motion ident generation behind concurrent processor lock
2022-04-02 17:40:08 -05:00
Aode (Lion)
09f53b9ce6 Move away from UploadManager to direct repo & store actions 2022-04-02 16:44:03 -05:00
Aode (lion)
6ed592c432 In Progress: process jobs
- Is this a good idea? it definitely will make interacting with pict-rs harder. Maybe it's best not to do this
2022-04-01 16:51:12 -05:00
Aode (lion)
c0d8e0e8e3 Support multiple queues for job processor 2022-04-01 11:51:46 -05:00
Aode (lion)
09281d9ae8 Move stream timeout to all response bodies 2022-03-29 16:48:26 -05:00
Aode (lion)
63d66050c8 Enable buffering iterator items for iterstream 2022-03-29 16:18:00 -05:00
Aode (lion)
5adb3fde89 Move some Stream implementations into 'stream' module 2022-03-29 15:59:17 -05:00
Aode (lion)
0e490ff54a Remove custom BytesFreezer stream 2022-03-29 14:28:08 -05:00
Aode (lion)
25f4480809 Remove custom stream error mapping types 2022-03-29 14:17:20 -05:00
Aode (lion)
8226a3571d Enable multi-threaded job processing 2022-03-29 13:18:47 -05:00
Aode (lion)
602d1ea935 Begin implementing queue, put cleanups in it 2022-03-29 12:51:16 -05:00
Aode (lion)
e25a4781a8 Remove unneeded variable 2022-03-29 11:09:23 -05:00
Aode (lion)
99d042f36e Allow disabling gif/mp4 2022-03-29 11:04:56 -05:00
Aode (Lion)
dd9ef89709 Update tomls 2022-03-28 20:48:12 -05:00
Aode (Lion)
eb5e39c634 Use color-eyre 2022-03-28 20:47:46 -05:00
Aode (lion)
1291bf8beb Divorce reqwest from main application's spans 2022-03-28 18:42:22 -05:00
Aode (lion)
3f385c106d New minio creds 2022-03-28 16:45:34 -05:00
Aode (lion)
cfc29d940f New minio creds 2022-03-28 16:44:53 -05:00
Aode (lion)
1662f153ce Numerous changes:
- Improve error printing (display chain in addition to spantrace)
- Fix migration (read main identifier from identifier tree, not filename tree)
- Ensure uniqueness for processed images in ConcurrentProcessor (use source identifier in addition to thumbnail path, include extension in thumbnail path)
- Update default log levels (make pict-rs quieter)
- Add timeout for serving images from object storage (5 seconds)
2022-03-28 15:34:36 -05:00
Aode (lion)
a5014120ff v0.3.0-rc.9 2022-03-28 12:57:51 -05:00
Aode (lion)
2e851575d8 Support latest ffmpeg, imagemagick releases 2022-03-28 12:56:31 -05:00
Aode (Lion)
3792a8923a Finish redoing config probably 2022-03-27 23:27:07 -05:00
Aode (lion)
ca28f68ef5 Start redoing config again 2022-03-27 19:10:06 -05:00
Aode (lion)
d3d0817cb0 Remove object-storage drone flag 2022-03-26 20:49:15 -05:00
Aode (lion)
32045d2bef Fix content range serving 2022-03-26 20:46:34 -05:00
Aode (lion)
37e6b21b55 Fix Range, consolidate errors, test object storage 2022-03-26 20:45:12 -05:00
Aode (lion)
15b52ba6ec Get it compiling again 2022-03-26 16:49:23 -05:00
Aode (lion)
323016f994 Build out migration path 2022-03-25 18:47:50 -05:00
Aode (lion)
750ce4782e Rework configuration 2022-03-24 22:06:29 -05:00
Aode (lion)
d6567fbbbd Implement sled repo 2022-03-24 17:09:15 -05:00
Aode (lion)
a0c99d05eb Create initial trait representation for database 2022-03-24 13:16:41 -05:00
Aode (Lion)
356e57e53d Update copyright date in readme 2022-03-22 15:10:48 -05:00
Aode (Lion)
f75292c8fd Add new config options to the pict-rs.toml example 2022-03-22 15:06:13 -05:00
Aode (Lion)
e11b3fa736 v0.3.0-rc.7 2022-03-21 22:42:48 -05:00
Aode (Lion)
2ad536db17 Promote console from compile flag to runtime flag 2022-03-21 22:41:51 -05:00
Aode (Lion)
f13f870a92 Only use console config when console feature is enabled 2022-03-21 22:05:32 -05:00
Aode (Lion)
62615be371 Allow configuring console buffer capacity 2022-03-21 21:56:19 -05:00
Aode (Lion)
bd26c60cd5 Don't enable console by default 2022-03-21 21:49:54 -05:00
Aode (Lion)
d30415bb49 Don't debug PathStore 2022-03-21 21:43:38 -05:00
Aode (Lion)
9b89ff32fa Update readme for latest RC 2022-03-21 21:20:50 -05:00
Aode (Lion)
9a8dc0e44f Fix sled cache capacity help text 2022-03-21 21:18:51 -05:00
Aode (Lion)
a9b06b6f66 v0.3.0-rc.5 2022-03-21 21:16:45 -05:00
Aode (Lion)
da159c69cb Try setting a lower default cache capacity 2022-03-21 21:15:43 -05:00