249 commits

Author	SHA1	Message	Date
Quentin	011ff87b5f	Push update	2020-12-15 13:23:22 +01:00
Quentin	3bc4d57a0f	First implementation of the CLI	2020-12-15 12:48:24 +01:00
Quentin	a3566e49da	Start to implement Website CLI	2020-12-14 21:50:40 +01:00
Quentin	d0eb6a457f	Migrate RPC to new schema	2020-12-14 21:46:49 +01:00
Quentin	96388acf23	Implement migration	2020-12-12 21:35:29 +01:00
Alex Auvolat	8956db2a81	Make less things public	2020-12-12 17:58:19 +01:00
Alex Auvolat	5c6c067b0c	More documentation on CRDTs (we should probably extract this to a ... standalone crate!)	2020-12-12 17:06:40 +01:00
Quentin	e1ce2b228a	WIP table migration	2020-12-12 17:00:31 +01:00
Alex Auvolat	0b3084ca5f	Merge branch 'master' into doc/model	2020-12-12 16:05:28 +01:00
Quentin	e8c12072ce	Merge branch 'master' into feature/website	2020-12-10 20:12:56 +01:00
Quentin	51d0c14e44	CLI structure	2020-12-10 18:13:32 +01:00
Alex Auvolat	022b386a50	Improved compatibility on list API call	2020-12-06 15:39:03 +01:00
Quentin	986e15459a	Merge branch 'master' into feature/website	2020-12-06 15:21:09 +01:00
Alex Auvolat	4a5bbbb810	Propose ETag fix	2020-12-05 19:23:46 +01:00
Alex Auvolat	76b489f3d3	Reformulate patch	2020-12-05 19:20:07 +01:00
Quentin	bd7e3d1bd1	Fix Content-Length	2020-12-05 18:57:22 +01:00
Alex Auvolat	9f46fb699a	Content-range fix	2020-12-05 16:37:59 +01:00
Quentin	15f409d404	Merge branch 'master' into feature/website	2020-11-29 17:19:55 +01:00
Alex Auvolat	d54f15b2c6	Small optimisation	2020-11-29 17:07:14 +01:00
Alex Auvolat	fed97f37e1	ETag patch	2020-11-29 16:38:01 +01:00
Alex Auvolat	601ae25ad2	Small refactorings	2020-11-29 16:21:28 +01:00
Quentin	cbd10c1b0a	Add some doc on LWW	2020-11-23 18:17:48 +01:00
Quentin	8722e27600	CRDT doc	2020-11-23 17:49:21 +01:00
Quentin	aa320aa04a	Merge branch 'master' into feature/website	2020-11-22 19:54:47 +01:00
Quentin	17dc610f8a	Also check hash for < 3KB files	2020-11-22 11:14:46 +01:00
Quentin	435d5f9205	Fix base64/hex checksum comparison	2020-11-22 11:04:33 +01:00
Quentin	fb18f5e17a	Fix wrong http status code	2020-11-21 18:14:02 +01:00
Quentin	28efe341cb	Merge branch 'master' into feature/website	2020-11-21 18:01:50 +01:00
Quentin	b7a377308b	Handle HEAD	2020-11-21 17:58:14 +01:00
Quentin	a88fd49f71	Use handle_get	2020-11-21 17:50:19 +01:00
Quentin	0f33231ee6	We are able to serve a file	2020-11-21 15:15:25 +01:00
Quentin	d4c7f4e374	Fix host to key	2020-11-21 12:01:02 +01:00
Quentin	2f6eca4ef3	Merge remote-tracking branch 'origin/master' into feature/website	2020-11-21 10:52:27 +01:00
Alex Auvolat	a8b3c8fd58	data hexdump in warning	2020-11-20 23:53:54 +01:00
Alex Auvolat	f9be964c3f	Warning when cannot decode entry (data format incompatibilities)	2020-11-20 23:53:54 +01:00
Alex Auvolat	4f7f1d1cb3	less type bounds	2020-11-20 23:53:54 +01:00
Alex Auvolat	68be5072e5	simplify	2020-11-20 23:53:54 +01:00
Alex Auvolat	173f0dbac9	oops	2020-11-20 23:53:54 +01:00
Alex Auvolat	f8a04852a2	Convert bucket table to better CRDT representation	2020-11-20 23:53:54 +01:00
Alex Auvolat	e02e9e035e	Begin improve model to use better CRDTs	2020-11-20 23:53:54 +01:00
Quentin	5b363626f4	Support punnycode	2020-11-20 21:23:32 +01:00
Alex Auvolat	2dc9a48022	Fix reconciliation logic	2020-11-20 20:12:32 +01:00
Alex Auvolat	e9fd265ce6	Slight refactoring to make things clearer with DeletedFilter	2020-11-20 20:11:04 +01:00
Quentin	04f455ff7f	Make it compile again	2020-11-19 14:56:00 +01:00
Quentin	fc427b0b66	Merge branch 'master' into feature/website	2020-11-19 14:39:30 +01:00
Quentin	6076d869b1	Build error	2020-11-11 21:17:34 +01:00
Quentin	2765291796	Build path correctly	2020-11-11 19:48:01 +01:00
Alex Auvolat	7d7b9e95a9	Simplify and_then(Some) as map() and remove move	2020-11-11 16:36:48 +01:00
Quentin	5a5592c176	Replace with option syntaxic sugar	2020-11-11 16:12:42 +01:00
Quentin	d445c4ef9c	WIP fetch object	2020-11-11 15:24:25 +01:00
Quentin	3cb3994cd2	Add documentation to host_to_bucket	2020-11-10 17:05:10 +01:00
Quentin	cacf8ddf2d	Panic when it is a logical error	2020-11-10 15:52:20 +01:00
Quentin	d1b2fcc1e7	Rewrite for clarity	2020-11-10 15:48:40 +01:00
Quentin	ab62c59acb	Fix indent again	2020-11-10 15:40:33 +01:00
Quentin	8797eed0ab	Fixes due to integration tests	2020-11-10 15:32:04 +01:00
Quentin	1e52ee9f5b	Rewrite authority to host while staying on stack	2020-11-10 15:26:48 +01:00
Quentin	27795a390c	Fix formatting	2020-11-10 09:59:52 +01:00
Quentin	4093833ae8	Extract bucket	2020-11-10 09:57:07 +01:00
Quentin	09137fd6b5	Log host	2020-11-08 16:06:52 +01:00
Quentin	c78df603d7	Add some documentation	2020-11-08 16:02:16 +01:00
Quentin	71721f5bcf	Merge branch 'master' into feature/website	2020-11-08 15:53:33 +01:00
Quentin	0791e7164e	Parse host header	2020-11-08 15:47:25 +01:00
Alex Auvolat	a50fa70d45	Refactor error management in API part	2020-11-08 15:05:28 +01:00
Alex Auvolat	6a8b972f3a	Modif parse_bucket_key to fail when bucket is ""	2020-11-08 13:39:44 +01:00
Quentin	e1415f5976	Add a second test	2020-11-07 15:34:53 +01:00
Quentin	9a50ce12a8	Fix formatting	2020-11-07 13:59:30 +01:00
Quentin	8f4ada1965	Add a test for parse_bucket_key	2020-11-07 13:53:32 +01:00
Quentin	0d3bc169ee	It compiles!	2020-11-03 12:37:16 +01:00
Quentin	b3caa3628d	Fix description of the crate	2020-11-02 15:57:23 +01:00
Quentin	cea871d944	Skeleton to the new web API	2020-11-02 15:48:39 +01:00
Quentin	104e2ce0a2	Add "web" configuration entry	2020-10-31 17:28:56 +01:00
Alex Auvolat	5faf069e33	trace test	2020-07-15 15:41:49 +02:00
Alex Auvolat	27a0d0d859	pretty	2020-07-15 15:37:35 +02:00
Alex Auvolat	1c70552f95	Validate content MD5 and SHA256 sums for PutObject and UploadPart	2020-07-15 15:31:13 +02:00
Alex Auvolat	6c7f9704ea	Implement correct ETag for objects created with PutObject	2020-07-13 16:51:30 +02:00
Alex Auvolat	9305e5e87f	More headers taken into account	2020-07-09 17:04:43 +02:00
Alex Auvolat	44dba0e53c	cargo fmt	2020-07-08 17:34:37 +02:00
Alex Auvolat	64a6eda0d2	Migrate S3 api to use new model	2020-07-08 17:33:24 +02:00
Alex Auvolat	84bbbfaa7b	Add multiple headers to object model	2020-07-08 17:33:14 +02:00
Alex Auvolat	a5fa2a136b	(WIP) New object table model, TODO: update API calls to use it	2020-07-08 16:46:47 +02:00
Alex Auvolat	86bf4dedac	Add support for model migrations	2020-07-08 16:10:53 +02:00
Alex Auvolat	86fb7bbba5	Apply cargo fmt; add trace output when request signature is bad	2020-07-08 13:33:02 +02:00
Alex Auvolat	f22ecb60a8	Update to Hyper 0.13.6 that accepts non-Sync streams in wrap_stream. ... Simplifies code and makes it possible to publish on crates.io	2020-07-07 17:15:53 +02:00
Alex Auvolat	3b0b11085e	Add versions to dependencies	2020-07-07 14:18:47 +02:00
Alex Auvolat	cc65cdc0fe	Add license, description and repository to .toml files	2020-07-07 14:14:58 +02:00
Alex Auvolat	bec26a1312	Rename garage_core to garage_model	2020-07-07 13:59:22 +02:00
Alex Auvolat	fbe8fe81f2	Add automatic peer discovery from Consul	2020-06-30 18:33:14 +02:00
Alex Auvolat	db6f1f35a8	Rename epidemic_factor to epidemic_fanout (that's what it is); complete conf example in readme	2020-06-30 15:03:34 +02:00
Alex Auvolat	fa13cf6996	Repair: do not mark deleted when upstream object is not found ... With the previous behaviour, repairing could see some data as absent and decide that the object or version was deleted, thus going on to delete the version and blocks. In the case where read_quorum + write_quorum <= replication_factor however, entries may not yet be returned by the get, thus data would have been deleted that should hot have been. The new behavior is more cautious and just skips the entry when the warning is emitted.	2020-05-04 13:30:42 +00:00
Alex Auvolat	b46a7788d1	Implement HTTP ranges in get	2020-05-04 13:09:23 +00:00
Alex Auvolat	16fbb32fd3	Rate limit requests a bit more seriously ... droping the slot later (after reading the request response) means that we aren't freeing our quota slot, so the maximum number of simultaneous requests now also counts the response reading phase TODO next: quotas per rpc destination node, or maybe per datacenter (?)	2020-05-01 19:18:54 +00:00
Alex Auvolat	d867bbcfb5	Implement DeleteObjects	2020-05-01 15:52:35 +00:00
Alex Auvolat	3324971701	Slightly improved S3 compatibility ... - ListBucket does not require any of the parameters (delimiter, prefix, max-keys, etc) - URLs are properly percent_decoded - PutObject and DeleteObject calls now answer correctly (empty body, version id in the x-amz-version-id: header)	2020-05-01 14:30:50 +00:00
Alex Auvolat	3686f100b7	Compatibility fixes	2020-04-28 10:35:04 +00:00
Alex Auvolat	0957d0fdfa	Work on API	2020-04-28 10:18:14 +00:00
Alex Auvolat	0877a5500c	Abort multipart upload	2020-04-26 20:46:33 +00:00
Alex Auvolat	81ecc4999e	Implement multipart uploads	2020-04-26 20:39:32 +00:00
Alex Auvolat	1999c0ae51	Update delete code	2020-04-26 19:11:19 +00:00
Alex Auvolat	0a283e4e70	Fix deletion propagation	2020-04-26 18:59:17 +00:00
Alex Auvolat	9cb870f950	Prepare for multipart uploads	2020-04-26 18:55:13 +00:00