Commit graph

38 commits

Author SHA1 Message Date
asonix 3428c31f16 Use tokio channels again 2024-04-14 20:06:58 -05:00
asonix 6f95c72070 Add new feature for testing with errors, test & fix job retries 2024-03-10 22:02:27 -05:00
asonix 4976fcb2eb Remove unneeded code 2024-03-09 22:53:46 -06:00
asonix c1e651c01a Use BytesStream in more places 2024-02-22 16:03:04 -06:00
asonix c65b49339f Take at most 2048 variants and proxies during each cleanup job 2024-01-25 16:26:29 -06:00
asonix 9ceb26bb5c Clippy 2024-01-07 10:09:06 -06:00
asonix bcf73eb4e4 Improve cooperation from from_iterator to prevent task starvation 2024-01-05 19:50:10 -06:00
asonix bfc2410552 Add trace-level logs to every loop (paranoid) 2023-12-28 11:58:38 -06:00
asonix b94ba5fcfc Inline process background future, clean tracing a bit 2023-12-22 13:12:19 -06:00
asonix c795c1edfa Replace most of actix-rt with tokio, give names to tasks 2023-10-20 19:08:11 -05:00
asonix 745e990fa0 Remove direct dependency on actix-rt and actix-server 2023-09-24 15:45:10 -05:00
asonix cde4a72203 Add metrics to object storage body streams 2023-09-20 19:46:10 -05:00
asonix 4a5b9712aa Combine map_ok and map_err underlying impl 2023-09-10 23:51:07 -04:00
asonix 2b10c48619 Update io-uring to use streem for file bytes 2023-09-10 23:45:24 -04:00
asonix 1b97ac1c5a Start replacing manual stream implementations with streem 2023-09-10 18:55:13 -04:00
asonix e15a82c0c7 Add external validation check 2023-09-05 20:45:07 -05:00
asonix a43de122f9 postgres: add already-claimed case, general: tracing paranoia 2023-09-03 21:30:47 -05:00
asonix b28cc38c38 Simplify Streamer 2023-08-23 19:12:59 -05:00
asonix 95637fdfe5 Remove direct dep on futures-util 2023-08-23 19:10:10 -05:00
asonix 8f50a15b25 Reduce reliance on futures-util 2023-08-23 11:59:42 -05:00
asonix 1ee77b19d8 Make Repo object safe. Create migration 2023-08-15 19:19:03 -05:00
Aode (lion) e493e90dd4 Defensive tracing 2022-04-07 12:56:40 -05:00
Aode (lion) 63d66050c8 Enable buffering iterator items for iterstream 2022-03-29 16:18:00 -05:00
Aode (lion) 5adb3fde89 Move some Stream implementations into 'stream' module 2022-03-29 15:59:17 -05:00
Aode (Lion) e7c3e2c96c Rename stream module 2021-10-20 19:00:41 -05:00
Aode (Lion) e7b4e4d1cc Remove a few boxes 2021-10-20 18:58:32 -05:00
Aode (Lion) 09cb2a53b0 Rewrite to avoid direct AsyncX impls 2021-10-13 19:06:53 -05:00
Aode (lion) f390c62cbf Wrap BytesFreezer in span 2021-09-25 16:39:10 -05:00
Aode (lion) ba68bcbde3 Add better span information to commands, spawned tasks 2021-09-25 15:23:05 -05:00
Aode (Lion) 5d3e6f50b3 Instrument better with Tracing 2021-09-13 20:22:42 -05:00
Aode (lion) bf1a16d7d3 Abort process writer task if reader is dropped 2021-09-11 16:35:38 -05:00
Aode (Lion) 45606f4579 Add application-level dimension limiting, bail on failed processes 2021-09-09 14:16:12 -05:00
Aode (Lion) ac79a9d5cd Use futures-util instead of hand-implemented types 2021-09-05 20:00:31 -05:00
Aode (lion) e21fd29c09 Drop unneeded dependencies 2021-09-04 14:20:31 -05:00
Aode (lion) 08c3169d3f Fewer streams 2021-09-04 12:42:40 -05:00
Aode (lion) 1119ed740e WIP: Try to pass AsyncRead types around instead of Streams 2021-09-03 19:53:53 -05:00
Aode (lion) a6f2082b37 Spawn new task to avoid complexity/bugs 2021-08-31 10:17:08 -05:00
Aode (Lion) c1d4e3b87e Start work on piping bytes around from memory instead of going to disk and back 2021-08-30 21:19:47 -05:00