nixos/nix
1
1
Fork 0
mirror of https://github.com/NixOS/nix.git synced 2025-11-08 11:36:03 +01:00
Code Activity

docs(rl-next/s3-curl-implementation): update with multipart uploads

Browse source
This commit is contained in:
Bernardo Meurer Costa 2025-10-25 05:05:10 +00:00
parent 965d6be7c1
commit 3448d4fa4c
No known key found for this signature in database
1 changed files with 19 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

24
doc/manual/rl-next/s3-curl-implementation.md
View file

@ -1,6 +1,6 @@
--- ---
synopsis: "Improved S3 binary cache support via HTTP" synopsis: "Improved S3 binary cache support via HTTP"
prs: [13823, 14026, 14120, 14131, 14135, 14144, 14170, 14190, 14198, 14206, 14209, 14222, 14223, 13752] prs: [13752, 13823, 14026, 14120, 14131, 14135, 14144, 14170, 14190, 14198, 14206, 14209, 14222, 14223, 14330, 14333, 14335, 14336, 14337, 14350, 14356, 14357, 14374, 14375, 14376, 14377, 14391, 14393, 14420, 14421]
issues: [13084, 12671, 11748, 12403] issues: [13084, 12671, 11748, 12403]
--- ---
@ -18,9 +18,23 @@ improvements:
The new implementation requires curl >= 7.75.0 and `aws-crt-cpp` for credential The new implementation requires curl >= 7.75.0 and `aws-crt-cpp` for credential
management. management.
All existing S3 URL formats and parameters remain supported, with the notable All existing S3 URL formats and parameters remain supported, however the store
exception of multi-part uploads, which are no longer supported. settings for configuring multipart uploads have changed:
- **`multipart-upload`** (default: `false`): Enable multipart uploads for large
files. When enabled, files exceeding the multipart threshold will be uploaded
in multiple parts.
- **`multipart-threshold`** (default: `100 MiB`): Minimum file size for using
multipart uploads. Files smaller than this will use regular PUT requests.
Only takes effect when `multipart-upload` is enabled.
- **`multipart-chunk-size`** (default: `5 MiB`): Size of each part in multipart
uploads. Must be at least 5 MiB (AWS S3 requirement). Larger chunk sizes
reduce the number of requests but use more memory.
- **`buffer-size`**: Has been replaced by `multipart-chunk-size` and is now an alias to it.
Note that this change also means Nix now supports S3 binary cache stores even Note that this change also means Nix now supports S3 binary cache stores even
if build without `aws-crt-cpp`, but only for public buckets which do not if built without `aws-crt-cpp`, but only for public buckets which do not
require auth. require authentication.