72 commits

Author	SHA1	Message	Date
asonix	84a882392a	Start threading upload configuration into ingest	2024-03-27 16:57:22 -05:00
asonix	6f95c72070	Add new feature for testing with errors, test & fix job retries	2024-03-10 22:02:27 -05:00
asonix	9fe586b9dd	Implement retries for jobs, start warning on long polls	2024-03-09 12:15:23 -06:00
asonix	71d81681d5	It compiles	2024-02-04 15:45:47 -06:00
asonix	c176e4c686	clippy	2024-02-03 18:30:52 -06:00
asonix	7eba45f37e	cargo fix & cargo fmt	2024-02-03 18:19:14 -06:00
asonix	50e31f96da	It compiles again	2024-02-03 18:18:13 -06:00
asonix	cf7c753e65	Pass a State value around rather than a bunch of arguments	2024-02-03 13:31:54 -06:00
asonix	5805eb0aed	Enable configuring imagemagick security policy from pictrs	2024-01-31 21:32:01 -06:00
asonix	e7357cbdaf	Count spawned tasks in cleanup, debug log queue length	2024-01-30 14:57:48 -06:00
asonix	c65b49339f	Take at most 2048 variants and proxies during each cleanup job	2024-01-25 16:26:29 -06:00
asonix	4145637a33	Add a few more metrics, increase repo disconnect sleep	2024-01-05 19:35:52 -06:00
asonix	bfc2410552	Add trace-level logs to every loop (paranoid)	2023-12-28 11:58:38 -06:00
asonix	dc90e00324	Update metrics to 0.22 (plus mechanical changes)	2023-12-26 18:06:38 -06:00
asonix	b94ba5fcfc	Inline process background future, clean tracing a bit	2023-12-22 13:12:19 -06:00
asonix	f1c5a56353	Port prune_missing from 0.4.x	2023-12-12 16:54:41 -06:00
asonix	210af5d7d9	Add danger_dummy_mode	2023-11-11 14:22:12 -06:00
asonix	c795c1edfa	Replace most of actix-rt with tokio, give names to tasks	2023-10-20 19:08:11 -05:00
asonix	7b5a3020fa	Don't rely on global state for tmp_dir	2023-10-07 11:32:36 -05:00
asonix	fff4afe105	Start working on per-server temporary directory	2023-10-06 19:42:24 -05:00
asonix	914e21c043	Implement constant-time equality for delete tokens, inline alias cleanup	2023-10-04 12:11:29 -05:00
asonix	6c921817e1	Enable thumbnailing animations, use dynamic dispatch for a number of async readers	2023-09-24 11:54:16 -05:00
asonix	b2674f06d0	More streme	2023-09-10 20:08:01 -04:00
asonix	1b97ac1c5a	Start replacing manual stream implementations with streem	2023-09-10 18:55:13 -04:00
asonix	858899b943	Add metrics & tracing to dropped uploads, turn pop into a single query	2023-09-07 19:20:41 -05:00
asonix	e15a82c0c7	Add external validation check	2023-09-05 20:45:07 -05:00
asonix	a4b1ab7dfb	Instrument postgres db calls	2023-09-04 21:51:27 -05:00
asonix	a43de122f9	postgres: add already-claimed case, general: tracing paranoia	2023-09-03 21:30:47 -05:00
asonix	8a892ba622	it might work	2023-09-03 18:21:46 -05:00
asonix	443d327edf	Implement a couple more repo traits	2023-09-03 12:47:06 -05:00
asonix	8921f57a21	Remove Identifier trait, Replace with Arc<str>	2023-09-02 18:38:02 -05:00
asonix	ba3a23ed43	Add error codes	2023-09-01 20:51:01 -05:00
asonix	fd74161c61	Rename some repo methods, generate UploadId in repo	2023-09-01 18:41:04 -05:00
asonix	95637fdfe5	Remove direct dep on futures-util	2023-08-23 19:10:10 -05:00
asonix	8f50a15b25	Reduce reliance on futures-util	2023-08-23 11:59:42 -05:00
asonix	ba27a1a223	Build out repo-repo migration	2023-08-16 16:09:40 -05:00
asonix	1ee77b19d8	Make Repo object safe. Create migration	2023-08-15 19:19:03 -05:00
asonix	09236d731d	Fix poll after completion, misused compare_and_swap	2023-08-14 21:17:57 -05:00
asonix	da876fd553	Make it compile	2023-08-14 14:25:19 -05:00
asonix	5f12be0c6a	Clippy	2023-07-26 22:53:41 -05:00
asonix	bd3975f455	Simplify some repo functions, remove 0.3 migration	2023-07-25 20:08:18 -05:00
asonix	aac1bb7bc4	Finish media proxy implementation	2023-07-23 15:45:52 -05:00
asonix	fe1f7c869f	Enable cleanup of variants ... Still TODO: doing a first pass to mark variants as accessed on launch	2023-07-22 19:41:50 -05:00
asonix	3ca994ee31	Replace global config with passed-around config ... This will enable spinning up pict-rs multiple times in the same process with different configurations	2023-07-22 12:31:01 -05:00
asonix	ac48003f45	Extract ProcessMap out of static	2023-07-22 11:16:19 -05:00
asonix	eeac900d7e	Add quality value to process method, move -coalesce earlier in pipelines	2023-07-18 16:18:01 -05:00
asonix	558605381d	Fix dangling unprocessed uploads ... Adds error boundary around backgrounded ingest	2023-07-17 22:32:08 -05:00
asonix	a751d92436	Port error changes to 0.5	2023-07-16 21:51:14 -05:00
asonix	4e58388b41	Clean alias before checking hash option	2023-07-13 19:58:31 -05:00
asonix	afeac8294a	Fix Alias cleanup ordering ... Update dev.toml	2023-07-13 19:57:09 -05:00