69 commits

Author	SHA1	Message	Date
asonix	ee88823d41	clippy	2023-08-16 12:43:12 -05:00
asonix	521cdd5b9d	Enforce format on new details	2023-08-16 12:36:18 -05:00
asonix	f3c6239979	Allow skipping details generation if already generated	2023-08-16 11:57:09 -05:00
asonix	4d909ba32a	Make migration concurrent	2023-08-16 11:47:36 -05:00
asonix	ac996ff832	Remove unused error	2023-08-15 21:25:04 -05:00
asonix	1de257bb07	Ensure access values are unique	2023-08-15 21:18:25 -05:00
asonix	bd3b668d81	Don't error on duplicate - happens on retried migration	2023-08-15 20:28:42 -05:00
asonix	9fe7410dd6	Add logging to migration	2023-08-15 19:33:19 -05:00
asonix	1ee77b19d8	Make Repo object safe. Create migration	2023-08-15 19:19:03 -05:00
asonix	09236d731d	Fix poll after completion, misused compare_and_swap	2023-08-14 21:17:57 -05:00
asonix	26ca3a7195	Remove associated Bytes type	2023-08-14 20:00:00 -05:00
asonix	da876fd553	Make it compile	2023-08-14 14:25:19 -05:00
asonix	3129f7844e	BROKEN: start work on hash discriminant	2023-08-13 22:06:42 -05:00
asonix	e4e93cddf9	Return JobId from push	2023-08-13 19:52:27 -05:00
asonix	5d4486fdf4	Finish queue implementation update for sled	2023-08-13 19:47:20 -05:00
asonix	35d0c065e9	Start work on 0.5 db format - initial queuerepo changes	2023-08-13 14:12:38 -05:00
asonix	5f12be0c6a	Clippy	2023-07-26 22:53:41 -05:00
asonix	2a59a6492a	Bring back hash_alias_key	2023-07-25 20:30:22 -05:00
asonix	bd3975f455	Simplify some repo functions, remove 0.3 migration	2023-07-25 20:08:18 -05:00
asonix	e59483c12c	Add ProxyRepo	2023-07-23 10:23:46 -05:00
asonix	77cdeab57e	Improve metrics, add job metrics	2023-07-22 21:11:28 -05:00
asonix	13d6e10886	Reduce log level on variants access	2023-07-22 20:20:58 -05:00
asonix	1f3298363f	Attempt to mark unmarked variants as accessed on launch	2023-07-22 19:55:50 -05:00
asonix	fe1f7c869f	Enable cleanup of variants ... Still TODO: doing a first pass to mark variants as accessed on launch	2023-07-22 19:41:50 -05:00
asonix	47e13ec04e	Mark variants as accessed on fetch	2023-07-22 18:50:04 -05:00
asonix	b786406ad0	Change IdentifierAccess to VariantAccess	2023-07-22 17:57:52 -05:00
asonix	fc14ac2038	Clippy	2023-07-18 21:59:27 -05:00
asonix	3d93300ba9	Add access repos for alias & identifier	2023-07-18 21:56:13 -05:00
asonix	2961aae6e3	Port migration changes from 0.4.1	2023-07-16 22:07:42 -05:00
asonix	7768d4e58e	Add database exports ... This should help admins running pict-rs on traditional filesystems to keep valid backups of pict-rs' sled repo	2023-07-08 17:36:01 -05:00
asonix	4680f9c3aa	Instrument repo and store build methods	2023-07-08 10:42:03 -05:00
asonix	9e7376d411	Remove is_missing error, make Identifier and DeleteToken return Option on fetch	2023-07-07 13:17:26 -05:00
asonix	e7e4876908	Explicitly handle cases of invalid aliases	2023-07-05 16:46:44 -05:00
asonix	23e67b9697	Enhance migration handling of missing identifiers ... Queue a cleanup task for hashes that don't have original file identifiers Be more specific about what field is missing when a field is missing	2023-07-05 09:52:19 -05:00
asonix	01d3610f46	Add basic progress indication for store migration	2023-06-29 11:39:47 -05:00
asonix	554d852e68	Create unique errors for Repo and Store, separate from UploadError ... Add .is_not_found() for Store errors, wire up Object and File storage to properly set NotFound Allow skipping files that are not found during store migration	2023-06-20 15:59:08 -05:00
asonix	281ac43dff	Remove cache functionality	2023-02-25 11:34:48 -06:00
asonix	123488f617	clippy	2023-02-12 23:18:27 -06:00
asonix	788b87eceb	Remove obsolute pre-0.3 migrate check	2023-02-12 23:13:47 -06:00
asonix	138499d47f	Use transpose in a couple places	2023-02-05 20:50:59 -06:00
asonix	0aa3f574a5	Clippy	2023-01-29 11:57:59 -06:00
asonix	f0f40db8c3	Add healthcheck for db	2023-01-29 11:36:09 -06:00
asonix	5e5dd27a05	Retry migrate_file, remove variant before relating new one	2023-01-04 18:58:05 -06:00
asonix	669b3fb86f	Fix webp metadata stripping, more tracing cleanup	2022-10-01 22:47:52 -05:00
asonix	718f09c43a	Clean tracing, simplify validation, rename InputFormat -> VideoFormat	2022-10-01 21:17:18 -05:00
asonix	29cab025c6	Improve 0.3 migration code, repo traces	2022-09-27 23:19:52 -05:00
asonix	21e3e63ac3	Instrument upload store methods	2022-09-25 18:46:50 -05:00
asonix	e0bc95f785	Remove unneeded reborrow	2022-08-15 15:00:12 -05:00
Aode (lion)	547934071a	Don't migrate from the old database if it doesn't exist	2022-08-14 11:49:20 -05:00
asonix	dc73bdbad4	Make already-claimed a 400	2022-06-05 23:24:58 -05:00