Commit graph

453 commits

Author SHA1 Message Date
Aode (lion) 82b7caf60e bash example: Add more duplicate uploads 2022-04-03 12:55:16 -05:00
Aode (lion) 044d24c92d Add bash client example for testing backgrounded operations 2022-04-03 12:53:14 -05:00
Aode (lion) 409b7d4c54 Remove unused conversions 2022-04-03 12:51:21 -05:00
Aode (lion) 29f0774331 Add ability to claim uploads 2022-04-02 21:15:39 -05:00
Aode (lion) 8734dfbdc7 Add backgrounding routes
- Accept backgrounded uploads
- Allow backgrounded processing

Still TODO:
- Endpoint for waiting on/claiming an upload
2022-04-02 20:56:29 -05:00
Aode (Lion) c4d014597e Better job recovery 2022-04-02 18:53:03 -05:00
Aode (Lion) 77a400c7ca Implement UploadRepo 2022-04-02 17:41:00 -05:00
Aode (Lion) 132e395e5c Multiple items:
- Reduce duplicate work in generate job
- Use hash instead of identifier for unique processing
- Move motion ident generation behind concurrent processor lock
2022-04-02 17:40:08 -05:00
Aode (Lion) 09f53b9ce6 Move away from UploadManager to direct repo & store actions 2022-04-02 16:44:03 -05:00
Aode (lion) 6ed592c432 In Progress: process jobs
- Is this a good idea? it definitely will make interacting with pict-rs harder. Maybe it's best not to do this
2022-04-01 16:51:12 -05:00
Aode (lion) c0d8e0e8e3 Support multiple queues for job processor 2022-04-01 11:51:46 -05:00
Aode (lion) 09281d9ae8 Move stream timeout to all response bodies 2022-03-29 16:48:26 -05:00
Aode (lion) 63d66050c8 Enable buffering iterator items for iterstream 2022-03-29 16:18:00 -05:00
Aode (lion) 5adb3fde89 Move some Stream implementations into 'stream' module 2022-03-29 15:59:17 -05:00
Aode (lion) 0e490ff54a Remove custom BytesFreezer stream 2022-03-29 14:28:08 -05:00
Aode (lion) 25f4480809 Remove custom stream error mapping types 2022-03-29 14:17:20 -05:00
Aode (lion) 8226a3571d Enable multi-threaded job processing 2022-03-29 13:18:47 -05:00
Aode (lion) 602d1ea935 Begin implementing queue, put cleanups in it 2022-03-29 12:51:16 -05:00
Aode (lion) e25a4781a8 Remove unneeded variable 2022-03-29 11:09:23 -05:00
Aode (lion) 99d042f36e Allow disabling gif/mp4 2022-03-29 11:04:56 -05:00
Aode (Lion) dd9ef89709 Update tomls 2022-03-28 20:48:12 -05:00
Aode (Lion) eb5e39c634 Use color-eyre 2022-03-28 20:47:46 -05:00
Aode (lion) 1291bf8beb Divorce reqwest from main application's spans 2022-03-28 18:42:22 -05:00
Aode (lion) 3f385c106d New minio creds 2022-03-28 16:45:34 -05:00
Aode (lion) 1662f153ce Numerous changes:
- Improve error printing (display chain in addition to spantrace)
- Fix migration (read main identifier from identifier tree, not filename tree)
- Ensure uniqueness for processed images in ConcurrentProcessor (use source identifier in addition to thumbnail path, include extension in thumbnail path)
- Update default log levels (make pict-rs quieter)
- Add timeout for serving images from object storage (5 seconds)
2022-03-28 15:34:36 -05:00
Aode (Lion) 3792a8923a Finish redoing config probably 2022-03-27 23:27:07 -05:00
Aode (lion) ca28f68ef5 Start redoing config again 2022-03-27 19:10:06 -05:00
Aode (lion) d3d0817cb0 Remove object-storage drone flag 2022-03-26 20:49:15 -05:00
Aode (lion) 37e6b21b55 Fix Range, consolidate errors, test object storage 2022-03-26 20:45:12 -05:00
Aode (lion) 15b52ba6ec Get it compiling again 2022-03-26 16:49:23 -05:00
Aode (lion) 323016f994 Build out migration path 2022-03-25 18:47:50 -05:00
Aode (lion) 750ce4782e Rework configuration 2022-03-24 22:06:29 -05:00
Aode (lion) d6567fbbbd Implement sled repo 2022-03-24 17:09:15 -05:00
Aode (lion) a0c99d05eb Create initial trait representation for database 2022-03-24 13:16:41 -05:00
Aode (Lion) 356e57e53d Update copyright date in readme 2022-03-22 15:10:48 -05:00
Aode (Lion) f75292c8fd Add new config options to the pict-rs.toml example 2022-03-22 15:06:13 -05:00
Aode (Lion) e11b3fa736 v0.3.0-rc.7 2022-03-21 22:42:48 -05:00
Aode (Lion) 2ad536db17 Promote console from compile flag to runtime flag 2022-03-21 22:41:51 -05:00
Aode (Lion) f13f870a92 Only use console config when console feature is enabled 2022-03-21 22:05:32 -05:00
Aode (Lion) 62615be371 Allow configuring console buffer capacity 2022-03-21 21:56:19 -05:00
Aode (Lion) bd26c60cd5 Don't enable console by default 2022-03-21 21:49:54 -05:00
Aode (Lion) d30415bb49 Don't debug PathStore 2022-03-21 21:43:38 -05:00
Aode (Lion) 9b89ff32fa Update readme for latest RC 2022-03-21 21:20:50 -05:00
Aode (Lion) 9a8dc0e44f Fix sled cache capacity help text 2022-03-21 21:18:51 -05:00
Aode (Lion) a9b06b6f66 v0.3.0-rc.5 2022-03-21 21:16:45 -05:00
Aode (Lion) da159c69cb Try setting a lower default cache capacity 2022-03-21 21:15:43 -05:00
Aode (Lion) f8475a466e tokio-uring 0.3 2022-03-08 18:48:08 -06:00
Aode (Lion) 2d1e93c1ef Update deps 2022-03-08 12:26:52 -06:00
Aode (Lion) dacb352fa7 rc.4 2022-03-08 11:45:54 -06:00
Aode (Lion) f1717e54d2 Merge branch 'main' of git.asonix.dog:asonix/pict-rs into main 2022-03-08 11:45:26 -06:00