Skip to content

feat: Compress and extract slim binaries with zstd #2533

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 16 commits into from
Jun 21, 2022
Merged

feat: Compress and extract slim binaries with zstd #2533

Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
b262c38
feat: Add support for zstd compression of slim binaries
mafredri Jun 20, 2022
fb24c02
feat: Add support for extract and serve of zstd bins
mafredri Jun 20, 2022
6c7e1f7
chore: Remove unused function
mafredri Jun 20, 2022
b427108
Always read body in test
mafredri Jun 20, 2022
3c68823
chore: Log what we are doing
mafredri Jun 20, 2022
0c6e367
chore: Fix PR comments
mafredri Jun 20, 2022
de8c01f
chore: Fix PR comments
mafredri Jun 20, 2022
528c34c
chore: Fix PR comments
mafredri Jun 20, 2022
db959f3
Apply suggestions from code review
mafredri Jun 20, 2022
bd322c7
chore: Use pushd/popd vs subshell
mafredri Jun 20, 2022
5c070d5
chore: Switch use of (( to [[
mafredri Jun 20, 2022
c3e4613
fix: Use compress in github actions
mafredri Jun 20, 2022
d715944
chore: Update build_go_slim.sh usage
mafredri Jun 20, 2022
2db7961
fix: Use compression level 6 for Makefile builds
mafredri Jun 20, 2022
e65a528
fix: Explain compress option
mafredri Jun 20, 2022
650558e
fix: Add zstd --force to prevent prompts
mafredri Jun 21, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
chore: Fix PR comments
  • Loading branch information
@mafredri
mafredri committed Jun 20, 2022
commit 0c6e367b0924e7c43c22bffa51cb486cf46782aa
9 changes: 5 additions & 4 deletions site/site.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -461,14 +461,14 @@ func filterFiles(files []fs.DirEntry, names ...string) []fs.DirEntry {
return filtered
}

func extractBin(dest string, r io.Reader) (n int, err error) {
func extractBin(dest string, r io.Reader) (numExtraced int, err error) {
opts := []zstd.DOption{
// Concurrency doesn't help us when decoding the tar and
// can actually slow us down.
zstd.WithDecoderConcurrency(1),
// Ignoring checksums give us a slight performance
// increase, we assume no corruption due to embedding.
zstd.IgnoreChecksum(true),
// Ignoring checksums can give a slight performance
// boost but it's probalby not worth the reduced safety.
zstd.IgnoreChecksum(false),
// Allow the decoder to use more memory giving us a 2-3x
// performance boost.
zstd.WithDecoderLowmem(false),
Expand All @@ -480,6 +480,7 @@ func extractBin(dest string, r io.Reader) (n int, err error) {
defer zr.Close()

tr := tar.NewReader(zr)
n := 0
for {
h, err := tr.Next()
if err != nil {
Expand Down