Commit graph

158 commits

Author SHA1 Message Date
Alex Auvolat
e9fd265ce6 Slight refactoring to make things clearer with DeletedFilter 2020-11-20 20:11:04 +01:00
Alex
b9e6b007a3 Merge pull request 'Clearly state how to spawn as fast as possible a dev. garage cluster from 0 to interacting with it through s3cmd' (#15) from feature/on-boarding-2 into master
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/15
2020-11-19 16:53:17 +01:00
Quentin
2ea1816a4a fix indent 2 2020-11-19 15:36:28 +01:00
Quentin
df44d32e45 Fix indent 2020-11-19 15:36:04 +01:00
Quentin
8ad1df71e1 A quickstart to setup a dev. env. 2020-11-19 15:35:02 +01:00
Alex
044d798877 Merge pull request 'Propose a script to quickly spawn a cluster' (#14) from feature/cluster-example into master
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/14
2020-11-15 15:45:27 +01:00
Quentin
163c3b6c16 Propose a script to spawn a cluster quickly 2020-11-15 14:43:23 +01:00
Alex
b00e29f931 Merge pull request 'Option Type: replace pattern matching by the corresponding syntaxic sugar' (#13) from feature/syntaxic-sugar into master
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/13
2020-11-11 16:38:56 +01:00
Alex Auvolat
7d7b9e95a9 Simplify and_then(Some) as map() and remove move 2020-11-11 16:36:48 +01:00
Quentin
5a5592c176 Replace with option syntaxic sugar 2020-11-11 16:12:42 +01:00
Alex
045009da9b Merge pull request 'Refactor error management in API part' (#10) from error-refactoring into master
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/10
2020-11-08 18:04:52 +01:00
Alex Auvolat
54166d2a09 Update cargo.lock 2020-11-08 15:05:28 +01:00
Alex Auvolat
a50fa70d45 Refactor error management in API part 2020-11-08 15:05:28 +01:00
Alex
18aab38a6a Merge pull request 'Unit Tests' (#9) from feature/unit-tests into master
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/9
2020-11-08 13:40:57 +01:00
Alex Auvolat
6a8b972f3a Modif parse_bucket_key to fail when bucket is "" 2020-11-08 13:39:44 +01:00
Quentin
e1415f5976 Add a second test 2020-11-07 15:34:53 +01:00
Quentin
9a50ce12a8 Fix formatting 2020-11-07 13:59:30 +01:00
Quentin
8f4ada1965 Add a test for parse_bucket_key 2020-11-07 13:53:32 +01:00
Alex
c9c699d377 Merge pull request 'Make on-boarding easier' (#8) from feature/on-boarding into master
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/8
2020-11-06 18:29:30 +01:00
Quentin
7c3743ae23 Replace tabs with spaces 2020-11-06 17:57:55 +01:00
Quentin
6d9ea43e9a Add a development section in readme.md 2020-11-06 17:56:57 +01:00
Quentin
57c6e1c877 Fix README + create dev config file 2020-11-06 17:52:53 +01:00
Alex Auvolat
13f8e1d2f3 Add Garage logo 2020-11-06 17:25:23 +01:00
Alex Auvolat
5faf069e33 trace test 2020-07-15 15:41:49 +02:00
Alex Auvolat
27a0d0d859 pretty 2020-07-15 15:37:35 +02:00
Alex Auvolat
1c70552f95 Validate content MD5 and SHA256 sums for PutObject and UploadPart 2020-07-15 15:31:13 +02:00
Alex Auvolat
6c7f9704ea Implement correct ETag for objects created with PutObject 2020-07-13 16:51:30 +02:00
Alex Auvolat
9305e5e87f More headers taken into account 2020-07-09 17:04:43 +02:00
Alex Auvolat
44dba0e53c cargo fmt 2020-07-08 17:34:37 +02:00
Alex Auvolat
64a6eda0d2 Migrate S3 api to use new model 2020-07-08 17:33:24 +02:00
Alex Auvolat
84bbbfaa7b Add multiple headers to object model 2020-07-08 17:33:14 +02:00
Alex Auvolat
a5fa2a136b (WIP) New object table model, TODO: update API calls to use it 2020-07-08 16:46:47 +02:00
Alex Auvolat
86bf4dedac Add support for model migrations 2020-07-08 16:10:53 +02:00
Alex Auvolat
86fb7bbba5 Apply cargo fmt; add trace output when request signature is bad 2020-07-08 13:33:02 +02:00
Alex Auvolat
f22ecb60a8 Update to Hyper 0.13.6 that accepts non-Sync streams in wrap_stream.
Simplifies code and makes it possible to publish on crates.io
2020-07-07 17:15:53 +02:00
Alex Auvolat
3b0b11085e Add versions to dependencies 2020-07-07 14:18:47 +02:00
Alex Auvolat
cc65cdc0fe Add license, description and repository to .toml files 2020-07-07 14:14:58 +02:00
Alex Auvolat
bec26a1312 Rename garage_core to garage_model 2020-07-07 13:59:22 +02:00
Alex Auvolat
f0918b377e Talk about consul discovery in readme 2020-06-30 18:37:37 +02:00
Alex Auvolat
fbe8fe81f2 Add automatic peer discovery from Consul 2020-06-30 18:33:14 +02:00
Alex Auvolat
ade29cf63a Build Docker image 2020-06-30 17:18:42 +02:00
Alex Auvolat
db6f1f35a8 Rename epidemic_factor to epidemic_fanout (that's what it is); complete conf example in readme 2020-06-30 15:03:34 +02:00
Alex Auvolat
c56de7fdd1 Write some README 2020-06-30 14:59:55 +02:00
Alex Auvolat
fa13cf6996 Repair: do not mark deleted when upstream object is not found
With the previous behaviour, repairing could see some data as absent
and decide that the object or version was deleted,
thus going on to delete the version and blocks.
In the case where read_quorum + write_quorum <= replication_factor
however, entries may not yet be returned by the get, thus data would
have been deleted that should hot have been. The new behavior is more
cautious and just skips the entry when the warning is emitted.
2020-05-04 13:30:42 +00:00
Alex Auvolat
b46a7788d1 Implement HTTP ranges in get 2020-05-04 13:09:23 +00:00
Alex Auvolat
16fbb32fd3 Rate limit requests a bit more seriously
droping the slot later (after reading the request response)
means that we aren't freeing our quota slot,
so the maximum number of simultaneous requests now also counts the
response reading phase

TODO next: quotas per rpc destination node, or maybe per datacenter (?)
2020-05-01 19:18:54 +00:00
Alex Auvolat
d867bbcfb5 Implement DeleteObjects 2020-05-01 15:52:35 +00:00
Alex Auvolat
3324971701 Slightly improved S3 compatibility
- ListBucket does not require any of the parameters (delimiter,
    prefix, max-keys, etc)
- URLs are properly percent_decoded
- PutObject and DeleteObject calls now answer correctly
    (empty body, version id in the x-amz-version-id: header)
2020-05-01 14:30:50 +00:00
Alex Auvolat
3686f100b7 Compatibility fixes 2020-04-28 10:35:04 +00:00
Alex Auvolat
0957d0fdfa Work on API 2020-04-28 10:18:14 +00:00