F04 end-missingNo end-of-archive marker: the archive ends after a complete member.
Reject(draft) A strict parser must reject this archive.
F04-end-missing.tar |
test archive, 1,024 bytes
sha256 0201a877ec49d04139d7cb4c21e25c1ab17d01ac3fde8341c1902bcb80e791bc |
F04-end-missing.json | expected result |
F04-end-missing.txt | annotated blocks |
F04-end-missing.py | generator script |
POSIX requires two zero blocks at the end of an archive. Without them, an archive cannot be told apart from one cut short after a member.
Decision point: whether an archive without an end-of-archive marker is complete.
Seen in: SDL2_image 2.8.8, ruby 4.0.5 and fastcap 2.0-18Sep92.
Every block of 512 bytes, to scale, with its offset. Hover over a field for its bytes.
F04-end-missing: must reject
No end-of-archive marker: the archive ends after a complete member.
POSIX requires two zero blocks at the end of an archive. Without them, an archive cannot be told
apart from one cut short after a member.
Decision point: whether an archive without an end-of-archive marker is complete.
Seen in: SDL2_image 2.8.8, ruby 4.0.5 and fastcap 2.0-18Sep92.
See also: F08, an archive cut short inside the data of a member, which is rejected as well.
0x000000 header: regular file
name [ 0,100) "a" + 99 NUL
mode [100,108) "0000644" + NUL 644 (octal)
uid [108,116) "0000000" + NUL 0
gid [116,124) "0000000" + NUL 0
size [124,136) "00000000002" + NUL 2
mtime [136,148) "00000000000" + NUL 0
chksum [148,156) "007340\0 " 3808: the unsigned sum of the header, this field as spaces
typeflag [156,157) "0" regular file
linkname [157,257) 100 NUL
magic [257,263) "ustar" + NUL
version [263,265) "00"
uname [265,297) 32 NUL
gname [297,329) 32 NUL
devmajor [329,337) "0000000" + NUL 0
devminor [337,345) "0000000" + NUL 0
prefix [345,500) 155 NUL
pad [500,512) 12 NUL
0x000200 data
2 bytes, then 510 NUL to the end of the block
"a\n"
0x000400 end of file
As xxd writes it: xxd -r makes the archive of it.
00000000: 6100 0000 0000 0000 0000 0000 0000 0000 a............... 00000010: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000020: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000030: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000040: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000050: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000060: 0000 0000 3030 3030 3634 3400 3030 3030 ....0000644.0000 00000070: 3030 3000 3030 3030 3030 3000 3030 3030 000.0000000.0000 00000080: 3030 3030 3030 3200 3030 3030 3030 3030 0000002.00000000 00000090: 3030 3000 3030 3733 3430 0020 3000 0000 000.007340. 0... 000000a0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000000b0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000000c0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000000d0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000000e0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000000f0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000100: 0075 7374 6172 0030 3000 0000 0000 0000 .ustar.00....... 00000110: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000120: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000130: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000140: 0000 0000 0000 0000 0030 3030 3030 3030 .........0000000 00000150: 0030 3030 3030 3030 0000 0000 0000 0000 .0000000........ 00000160: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000170: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000180: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000190: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000001a0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000001b0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000001c0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000001d0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000001e0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000001f0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000200: 610a 0000 0000 0000 0000 0000 0000 0000 a............... 00000210: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000220: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000230: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000240: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000250: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000260: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000270: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000280: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000290: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000002a0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000002b0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000002c0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000002d0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000002e0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000002f0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000300: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000310: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000320: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000330: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000340: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000350: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000360: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000370: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000380: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 00000390: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000003a0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000003b0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000003c0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000003d0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000003e0: 0000 0000 0000 0000 0000 0000 0000 0000 ................ 000003f0: 0000 0000 0000 0000 0000 0000 0000 0000 ................
| implementation | version | outcome | what it makes of it |
|---|---|---|---|
| GNU tar | tar (GNU tar) 1.35 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| bsdtar | bsdtar 3.8.10 - libarchive 3.8.10 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| BusyBox tar | BusyBox v1.38.0, defconfig | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| 7-Zip | 7-Zip (z) 26.05 (x64) | ✅ as the verdict says | error: ERRORS: Unexpected end of archive |
| Python tarfile, filter=data, as in pip | CPython 3.15.2 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| Python tarfile, filter=tar | CPython 3.15.2 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| Python tarfile, filter=fully_trusted | CPython 3.15.2 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| node-tar | tar 7.5.22 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| node-tar, strict | tar 7.5.22 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| tar-fs | tar-fs 3.1.3, on tar-stream 3.2.2 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| Java Commons Compress | Commons Compress 1.28.0, Expander, on Java 27.0.1.0.2 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| .NET System.Formats.Tar | System.Formats.Tar of .NET 10.0.14, ExtractToDirectory | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| PHP PharData, as in Composer | PharData of PHP 8.5.12, as Composer's TarDownloader calls it | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| Go containerd archive.Apply | containerd v2.4.2, archive.Apply, of go1.27.3 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| Rust tar | tar 0.4.46, unpack | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| Rust astral-tokio-tar | astral-tokio-tar 0.7.0, unpack | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| Rust tar-codec, as in uv | tar-codec 0.0.15, with the policies of uv 0.13 | ✅ as the verdict says | error: at byte 1024: missing two-block end-of-archive marker |
| RubyGems | RubyGems 4.0.20 of Ruby 4.0.9, extract_tar_gz | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| R untar, internal | utils::untar of R 4.6.1, tar = "internal" | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| Perl Archive::Tar | Archive::Tar 3.12 of Perl v5.44.0 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| Haskell tar | tar 0.7.2.0, extract, of GHC 9.14 | ✅ as the verdict says | error: TruncatedArchive |
| Julia Tar.jl | Tar 1.10.0 of Julia 1.13.3 | ⚠️ accepts | tree A: a (2 B, 87428fc5) |
| live-bootstrap untar | mescc-tools-extra a151c245e512, as live-bootstrap pins it, built with cc | ✅ as the verdict says | error: Short read on suite/archives/F04-end-missing.tar: expected 512, got 0 The extraction of suite/archives/F04-end-missing.tar produced errors |
| live-bootstrap untar, --non-strict | mescc-tools-extra a151c245e512, as live-bootstrap pins it, built with cc | ✅ as the verdict says | error: non-strict mode enabled, preparing for chaos Short read on suite/archives/F04-end-missing.tar: expected 512, got 0 The extraction of suite/archives/F04-end-missing.tar produced errors |
Release tarballs of Spack, nixpkgs, Guix and live-bootstrap, and samples of PyPI, crates.io and RubyGems with end.missing. The default policy rejects all of them.
| ecosystem | tarballs | with it | share |
|---|---|---|---|
| Spack | 37,553 | 12 | 0.03% |
| nixpkgs | 18,990 | 4 | 0.02% |
| Guix | 10,168 | 6 | 0.06% |
| PyPI | 10,000 | 0 | none |
| crates.io | 5,000 | 0 | none |
| RubyGems | 5,000 | 0 | none |
| live-bootstrap | 171 | 0 | none |
| total (distinct) | 82,586 | 22 | 0.03% |
See the list of these 22 tarballs, with the sha256 of each and an example from it.
F08: an archive cut short inside the data of a member, which is rejected as well.