Skip to content

AArch64: Enhance struct access in Huffman decode 2X - #4413

Merged
Cyan4973 merged 1 commit into
meta:devfrom
arpadpanyik-arm:huf_decode2x
Jul 23, 2025
Merged

Cyan4973 merged 1 commit into
meta:devfrom
arpadpanyik-arm:huf_decode2x

Conversation

@arpadpanyik-arm

@arpadpanyik-arm arpadpanyik-arm commented Jun 20, 2025 •

Copy link
Copy Markdown
Contributor

In the multi-stream multi-symbol Huffman decoder GCC generates suboptimal code - emitting more loads for HUF_DEltX2 struct member accesses. Forcing it to use 32-bit loads and bit arithmetic to extract the necessary parts (UBFX) improves the overall decode speed.

Also avoid integer type conversions in the symbol decodes, which leads to better instruction selection in table lookup accesses.

On AArch64 the decoder no longer runs into register-pressure limits, so we can simplify the hot path and improve throughput.

Decompression uplifts on a Neoverse V2 system, using Zstd-1.5.8 compiled with -O3 -march=armv8.2-a+sve2:

                 Clang-20   Clang-*    GCC-13    GCC-14    GCC-15
 1#silesia.tar:   +0.820%   +1.365%   +2.480%   +1.348%   +0.987%
 2#silesia.tar:   +0.426%   +0.784%   +1.218%   +0.665%   +0.554%
 3#silesia.tar:   +0.112%   +0.389%   +0.508%   +0.188%   +0.261%

* Requires Clang-21 support from LLVM commit hash
  `a53003fe23cb6c871e72d70ff2d3a075a7490da2`
  (Clang-21 hasn’t been released as of this writing)

Mostly the fastest compression levels are affected.
This patch can also save some instructions in the hot path on x86 compiled by GCC.

@Cyan4973

Cyan4973 commented Jun 20, 2025 •

Copy link
Copy Markdown
Contributor

It does make sense.
I don't see how these intermediate cast operations to signed integer could help in any way.
They are just in the way. At best, I would expect the compiler to ignore them.
Better make it explicit.

I'll measure the claimed benefits on a few platforms and compilers.
Only level 1 should be enough for this purpose, it's the one that maximizes the share of Huffman decode 2X.

Comment thread lib/decompress/huf_decompress.c Outdated
op[(_stream)][(_symbol)] = (BYTE)(entry >> 8); \
} while (0)

#define HUF_4X1_RELOAD_STREAM(_stream) \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should rather be called 5x1 i.e. HUF_5X1_RELOAD_STREAM now.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Renamed it in bd38fc2, I also did it with HUF_4X2_RELOAD_STREAM.

@Cyan4973

Copy link
Copy Markdown
Contributor

I tested across a range of compilers, to mitigate instruction alignment impact with random impact on performance.
In order to stress the modified code path, I used level 1 and CPPFLAGS="-DZSTD_DISABLE_ASM -DHUF_FORCE_DECOMPRESS_X2" to remove assembly code path and force usage of the X2 code path (even if detrimental).

This gives the following results:

compile zstd with gcc-9                                                            │compile zstd with gcc-9
1522fc47a215f1f286f4c5142fbc76e0  zstd                                             │719d1d80d6adb0bd83a13c2c6b6e7b4c  zstd
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  946.5 MB/s, 1475.6 MB/s   │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  937.2 MB/s, 1472.1 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  714.1 MB/s, 1306.9 MB/s   │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  711.6 MB/s, 1304.7 MB/s
compile zstd with gcc-10                                                           │compile zstd with gcc-10
a505d43728491f7388bf8de92e220d16  zstd                                             │dbdcd94e1cb1419f7252babe6d8eb883  zstd
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  960.0 MB/s, 1452.6 MB/s   │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  965.1 MB/s, 1429.6 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  722.3 MB/s, 1301.7 MB/s   │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  726.8 MB/s, 1279.0 MB/s
compile zstd with gcc-11                                                           │compile zstd with gcc-11
50d7fd78802f7403a8fd54ec3797d3f2  zstd                                             │be490fc6f15f2ae352ec3ac7fd738516  zstd
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  949.1 MB/s, 1468.2 MB/s   │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  947.6 MB/s, 1457.4 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  720.7 MB/s, 1304.6 MB/s   │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  723.2 MB/s, 1297.8 MB/s
compile zstd with gcc-12                                                           │compile zstd with gcc-12
dd502e8d06ada11b36a3333a6edd1811  zstd                                             │4e4f863235fabc69ae0d6c8134467af2  zstd
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  958.7 MB/s, 1505.4 MB/s   │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  948.4 MB/s, 1499.8 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  732.8 MB/s, 1350.8 MB/s   │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  728.1 MB/s, 1347.0 MB/s
compile zstd with gcc-13                                                           │compile zstd with gcc-13
175263687972282366dd8ec576b90f2d  zstd                                             │4286493ffe1e393e3a3691972ad28df9  zstd
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  951.8 MB/s, 1491.3 MB/s   │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  955.7 MB/s, 1499.6 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  728.6 MB/s, 1335.0 MB/s   │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  723.4 MB/s, 1342.8 MB/s
compile zstd with gcc-14                                                           │compile zstd with gcc-14
d69d24053fa52b55121787fe6aba38fa  zstd                                             │35642c3cbb1c4eefc6e8d8e1e03d8afb  zstd
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  926.4 MB/s, 1566.5 MB/s   │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  924.3 MB/s, 1554.3 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  701.7 MB/s, 1419.3 MB/s   │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  695.4 MB/s, 1412.8 MB/s
compile zstd with clang-14                                                         │compile zstd with clang-14
8ec1084075224c7736f841339d6bf83b  zstd                                             │738b6f1fce202777c35551f0e5c99bcd  zstd
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  962.2 MB/s, 1590.5 MB/s   │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  963.6 MB/s, 1547.6 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  728.2 MB/s, 1428.6 MB/s   │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  727.7 MB/s, 1390.3 MB/s
compile zstd with clang-15                                                         │compile zstd with clang-15
c0046a1bdc6af5cb3d0477fd73cc94b5  zstd                                             │3ea379ea4d9c0c30d36e5549d945650e  zstd
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  970.0 MB/s, 1492.3 MB/s   │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  967.1 MB/s, 1517.4 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  719.5 MB/s, 1340.5 MB/s   │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  724.7 MB/s, 1366.5 MB/s
compile zstd with clang-16                                                         │compile zstd with clang-16
09c16133bd866773801c024b3153e774  zstd                                             │6faee23b31caeee733f8d524ef9a5cfb  zstd
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  939.2 MB/s, 1474.9 MB/s   │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  940.8 MB/s, 1480.8 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  706.6 MB/s, 1329.3 MB/s   │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  704.7 MB/s, 1336.1 MB/s
compile zstd with clang-17                                                         │compile zstd with clang-17
4b7fbd1e4f91003934d836a211156428  zstd                                             │8055ad69f59b52d104e5e0bd9735a10c  zstd
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  974.9 MB/s, 1474.3 MB/s   │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  972.7 MB/s, 1486.4 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  736.6 MB/s, 1319.8 MB/s   │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  733.1 MB/s, 1328.2 MB/s
compile zstd with clang-18                                                         │compile zstd with clang-18
1b3d22230c77517e9818a63779858e91  zstd                                             │e9de069911838423006d4e4129178da6  zstd
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  960.7 MB/s, 1522.9 MB/s   │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  967.5 MB/s, 1529.2 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  727.3 MB/s, 1360.7 MB/s   │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  730.2 MB/s, 1374.4 MB/s

In other words : it's wash. I cannot prove that the modifications are "better", even if they improve instruction count (which could be proven via assembly view).

I think that makes the second axis more important, which is that the modification is still welcome if it helps clarity.
And on that front, well, there are multiple changes bundled in this PR, it would be better to review them one by one, accepting the "good" ones easily, and spending more time when questions or minor modifications are warranted.

Or possibly, maybe I should start another PR and recreate this PR there, little by little, selectively deciding which parts gets in, and which part gets modified.

In the multi-stream multi-symbol Huffman decoder GCC generates
suboptimal code - emitting more loads for HUF_DEltX2 struct member
accesses. Forcing it to use 32-bit loads and bit arithmetic to extract
the necessary parts (UBFX) improves the overall decode speed.

Also avoid integer type conversions in the symbol decodes, which
leads to better instruction selection in table lookup accesses.

On AArch64 the decoder no longer runs into register-pressure limits,
so we can simplify the hot path and improve throughput

Decompression uplifts on a Neoverse V2 system, using Zstd-1.5.8
compiled with "-O3 -march=armv8.2-a+sve2":

                 Clang-20   Clang-*    GCC-13    GCC-14    GCC-15
 1#silesia.tar:   +0.820%   +1.365%   +2.480%   +1.348%   +0.987%
 2#silesia.tar:   +0.426%   +0.784%   +1.218%   +0.665%   +0.554%
 3#silesia.tar:   +0.112%   +0.389%   +0.508%   +0.188%   +0.261%

* Requires Clang-21 support from LLVM commit hash
  `a53003fe23cb6c871e72d70ff2d3a075a7490da2`
  (Clang-21 hasn’t been released as of this writing)
@arpadpanyik-arm

Copy link
Copy Markdown
Contributor Author

Thanks for the review and extensive testing! In bd38fc2 we added a bit more hint for GCC to let it generate simpler addressing instructions without index register widening. Clang's code generation is not affected.

Smaller out-of-order CPU can gain a bit more performance from this change because of the limited execution resources, on a Cortex-A720 we can see these overall uplifts:

File Level GCC-13 GCC-14 GCC-15 Clang-19 Clang-20 Clang-21
silesia.tar 1 +5.702% +4.554% +4.336% +0.209% +1.755% +2.793%
silesia.tar 2 +2.854% +2.245% +2.038% +0.080% +0.618% +1.416%
silesia.tar 3 +1.152% +0.892% +0.765% +0.012% +0.012% +0.495%

do { \
if ((_decode3) || (_stream) != 3) { \
U64 const index = bits[(_stream)] >> 53; \
size_t const entry = MEM_readLE32(&dtable[index]); \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reading again this PR,
it seems this is the only place where I would expect a potential performance difference.
The other changes only affect type casting, which should be harmless, and I generally prefer the new types.

I don't doubt this change is favorable for the platforms tested,
but it may also be non-neutral for other platforms, even possibly detrimental.
So I'll have to check it.

@Cyan4973

Cyan4973 commented Jul 22, 2025 •

Copy link
Copy Markdown
Contributor

I controlled this impact on decompression speed on a x64 cpu,
using a variety of compiler versions, to compensate random noise,
and while the impact is generally low, it's rather positive on the average.

dev                                                                               | this PR
compile zstd with gcc-9                                                           │compile zstd with gcc-9
fc660df9ed9b3c7c08697cdba081e15f  zstd                                            │9e1dcceb70af9902d9fc48012eb4e3ba  zstd
 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  823.0 MB/s  │ 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  839.8 MB/s
 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1185.5 MB/s  │ 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1200.0 MB/s
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  913.2 MB/s, 1508.3 MB/s  │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  924.7 MB/s, 1544.9 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  694.6 MB/s, 1310.2 MB/s  │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  702.7 MB/s, 1345.9 MB/s
 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  473.9 MB/s, 1299.1 MB/s  │ 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  481.6 MB/s, 1342.1 MB/s
 3#enwik8            : 100000000 ->  35445331 (x2.821),  363.6 MB/s, 1049.0 MB/s  │ 3#enwik8            : 100000000 ->  35445331 (x2.821),  376.5 MB/s, 1068.8 MB/s
 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  268.2 MB/s, 1279.6 MB/s  │ 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  270.8 MB/s, 1293.4 MB/s
 5#enwik8            : 100000000 ->  33744227 (x2.963),  201.3 MB/s, 1014.4 MB/s  │ 5#enwik8            : 100000000 ->  33744227 (x2.963),  219.9 MB/s, 1022.4 MB/s
compile zstd with gcc-10                                                          │compile zstd with gcc-10
658b653943c0d046d9d18605c741b4f2  zstd                                            │7ee09a12ac35a53a37bd614bb9d94eae  zstd
 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  931.9 MB/s  │ 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  957.9 MB/s
 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1143.6 MB/s  │ 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1199.0 MB/s
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  930.4 MB/s, 1463.4 MB/s  │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  940.7 MB/s, 1501.9 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  694.2 MB/s, 1290.2 MB/s  │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  721.8 MB/s, 1319.9 MB/s
 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  484.8 MB/s, 1283.0 MB/s  │ 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  484.3 MB/s, 1316.7 MB/s
 3#enwik8            : 100000000 ->  35445331 (x2.821),  369.2 MB/s, 1052.3 MB/s  │ 3#enwik8            : 100000000 ->  35445331 (x2.821),  379.5 MB/s, 1095.5 MB/s
 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  264.9 MB/s, 1258.6 MB/s  │ 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  273.8 MB/s, 1277.7 MB/s
 5#enwik8            : 100000000 ->  33744227 (x2.963),  213.3 MB/s, 1021.3 MB/s  │ 5#enwik8            : 100000000 ->  33744227 (x2.963),  220.3 MB/s, 1040.3 MB/s
compile zstd with gcc-11                                                          │compile zstd with gcc-11
46d1934904d7a8fe401be249634566e7  zstd                                            │8150f98ce60b2882e6bb41cf4b796ff3  zstd
 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  915.9 MB/s  │ 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  931.1 MB/s
 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1151.7 MB/s  │ 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1198.9 MB/s
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  918.8 MB/s, 1471.5 MB/s  │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  942.4 MB/s, 1511.5 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  697.4 MB/s, 1278.8 MB/s  │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  711.7 MB/s, 1317.7 MB/s
 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  481.6 MB/s, 1295.8 MB/s  │ 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  508.9 MB/s, 1313.7 MB/s
 3#enwik8            : 100000000 ->  35445331 (x2.821),  360.6 MB/s, 1061.7 MB/s  │ 3#enwik8            : 100000000 ->  35445331 (x2.821),  386.1 MB/s, 1079.5 MB/s
 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  259.5 MB/s, 1266.9 MB/s  │ 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  269.1 MB/s, 1302.5 MB/s
 5#enwik8            : 100000000 ->  33744227 (x2.963),  211.2 MB/s, 1026.3 MB/s  │ 5#enwik8            : 100000000 ->  33744227 (x2.963),  217.4 MB/s, 1057.1 MB/s
compile zstd with gcc-12                                                          │compile zstd with gcc-12
956b4e137c9d41be442b16f798fcf479  zstd                                            │75f62b7d56d27da04520ba36861bf041  zstd
 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  886.9 MB/s  │ 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  919.0 MB/s
 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1162.0 MB/s  │ 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1203.7 MB/s
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  923.3 MB/s, 1518.7 MB/s  │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  941.0 MB/s, 1555.9 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  711.8 MB/s, 1341.2 MB/s  │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  726.4 MB/s, 1372.3 MB/s
 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  477.9 MB/s, 1318.5 MB/s  │ 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  479.2 MB/s, 1337.9 MB/s
 3#enwik8            : 100000000 ->  35445331 (x2.821),  365.6 MB/s, 1075.1 MB/s  │ 3#enwik8            : 100000000 ->  35445331 (x2.821),  361.7 MB/s, 1102.5 MB/s
 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  264.8 MB/s, 1289.0 MB/s  │ 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  270.3 MB/s, 1304.7 MB/s
 5#enwik8            : 100000000 ->  33744227 (x2.963),  212.6 MB/s, 1033.9 MB/s  │ 5#enwik8            : 100000000 ->  33744227 (x2.963),  218.5 MB/s, 1043.1 MB/s
compile zstd with gcc-13                                                          │compile zstd with gcc-13
2861adf22b2d0f935b26459da4c0a59e  zstd                                            │f602d8b3b5c8d777ff36e18be341e582  zstd
 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  896.8 MB/s  │ 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  926.7 MB/s
 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1180.9 MB/s  │ 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1204.3 MB/s
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  921.0 MB/s, 1521.6 MB/s  │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  934.3 MB/s, 1561.8 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  697.5 MB/s, 1341.3 MB/s  │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  724.0 MB/s, 1374.7 MB/s
 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  478.2 MB/s, 1324.4 MB/s  │ 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  499.1 MB/s, 1339.9 MB/s
 3#enwik8            : 100000000 ->  35445331 (x2.821),  367.4 MB/s, 1069.1 MB/s  │ 3#enwik8            : 100000000 ->  35445331 (x2.821),  376.4 MB/s, 1092.5 MB/s
 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  268.5 MB/s, 1294.1 MB/s  │ 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  274.3 MB/s, 1300.5 MB/s
 5#enwik8            : 100000000 ->  33744227 (x2.963),  215.2 MB/s, 1036.8 MB/s  │ 5#enwik8            : 100000000 ->  33744227 (x2.963),  219.6 MB/s, 1060.0 MB/s
compile zstd with gcc-14                                                          │compile zstd with gcc-14
a719cb80e0a36c4384b9e87e8d298fbb  zstd                                            │b6286d84a8d113251ae93b953ce69c18  zstd
 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  926.6 MB/s  │ 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  949.1 MB/s
 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1208.8 MB/s  │ 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1223.3 MB/s
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  904.6 MB/s, 1576.7 MB/s  │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  918.7 MB/s, 1613.0 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  682.7 MB/s, 1403.6 MB/s  │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  692.0 MB/s, 1433.8 MB/s
 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  498.7 MB/s, 1362.4 MB/s  │ 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  488.4 MB/s, 1393.0 MB/s
 3#enwik8            : 100000000 ->  35445331 (x2.821),  377.3 MB/s, 1115.1 MB/s  │ 3#enwik8            : 100000000 ->  35445331 (x2.821),  382.7 MB/s, 1154.3 MB/s
 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  270.7 MB/s, 1335.0 MB/s  │ 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  278.7 MB/s, 1368.3 MB/s
 5#enwik8            : 100000000 ->  33744227 (x2.963),  217.8 MB/s, 1083.6 MB/s  │ 5#enwik8            : 100000000 ->  33744227 (x2.963),  225.0 MB/s, 1110.6 MB/s
compile zstd with clang-14                                                        │compile zstd with clang-14
ff93508bbcea8b056822a1a2f6dc7229  zstd                                            │0cf74701f0695b901d9509e555daf1c6  zstd
 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  962.9 MB/s  │ 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  989.6 MB/s
 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1200.9 MB/s  │ 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1220.3 MB/s
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  943.0 MB/s, 1560.1 MB/s  │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  937.3 MB/s, 1595.1 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  719.3 MB/s, 1378.7 MB/s  │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  717.0 MB/s, 1413.7 MB/s
 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  474.3 MB/s, 1353.2 MB/s  │ 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  481.4 MB/s, 1365.7 MB/s
 3#enwik8            : 100000000 ->  35445331 (x2.821),  361.7 MB/s, 1120.5 MB/s  │ 3#enwik8            : 100000000 ->  35445331 (x2.821),  372.3 MB/s, 1121.5 MB/s
 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  274.6 MB/s, 1311.4 MB/s  │ 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  277.9 MB/s, 1353.1 MB/s
 5#enwik8            : 100000000 ->  33744227 (x2.963),  219.5 MB/s, 1058.1 MB/s  │ 5#enwik8            : 100000000 ->  33744227 (x2.963),  225.2 MB/s, 1083.1 MB/s
compile zstd with clang-15                                                        │compile zstd with clang-15
3ccb658aa9d6ced338cdea7ebdf8ec1c  zstd                                            │cdae8ecfd77a1d73444de6374c0f07a5  zstd
 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  946.5 MB/s  │ 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  968.8 MB/s
 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1171.3 MB/s  │ 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1199.2 MB/s
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  925.0 MB/s, 1510.2 MB/s  │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  938.0 MB/s, 1551.4 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  704.2 MB/s, 1338.3 MB/s  │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  713.1 MB/s, 1368.7 MB/s
 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  472.5 MB/s, 1319.3 MB/s  │ 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  479.3 MB/s, 1342.1 MB/s
 3#enwik8            : 100000000 ->  35445331 (x2.821),  358.3 MB/s, 1097.5 MB/s  │ 3#enwik8            : 100000000 ->  35445331 (x2.821),  368.1 MB/s, 1108.7 MB/s
 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  280.2 MB/s, 1295.0 MB/s  │ 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  282.1 MB/s, 1321.9 MB/s
 5#enwik8            : 100000000 ->  33744227 (x2.963),  223.6 MB/s, 1033.4 MB/s  │ 5#enwik8            : 100000000 ->  33744227 (x2.963),  229.2 MB/s, 1074.1 MB/s
compile zstd with clang-16                                                        │compile zstd with clang-16
ba22abc4158e20d48d6b840ad4a9a688  zstd                                            │6d6fdc0c169ef0ddfa7c143552cb4183  zstd
 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  856.8 MB/s  │ 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  880.2 MB/s
 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1143.4 MB/s  │ 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1182.0 MB/s
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  937.2 MB/s, 1468.3 MB/s  │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  926.3 MB/s, 1502.7 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  704.3 MB/s, 1308.5 MB/s  │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  694.5 MB/s, 1334.5 MB/s
 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  493.9 MB/s, 1276.8 MB/s  │ 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  476.7 MB/s, 1312.7 MB/s
 3#enwik8            : 100000000 ->  35445331 (x2.821),  371.4 MB/s, 1066.2 MB/s  │ 3#enwik8            : 100000000 ->  35445331 (x2.821),  364.2 MB/s, 1095.4 MB/s
 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  283.2 MB/s, 1245.6 MB/s  │ 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  285.7 MB/s, 1275.7 MB/s
 5#enwik8            : 100000000 ->  33744227 (x2.963),  225.4 MB/s, 1025.1 MB/s  │ 5#enwik8            : 100000000 ->  33744227 (x2.963),  227.5 MB/s, 1039.6 MB/s
compile zstd with clang-17                                                        │compile zstd with clang-17
e6d49c64049a4e147e78b284f5736b48  zstd                                            │1217e1929c781c0d485b2b4f300fc7a4  zstd
 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  916.9 MB/s  │ 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  936.4 MB/s
 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1171.3 MB/s  │ 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1190.6 MB/s
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  942.1 MB/s, 1477.7 MB/s  │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  954.4 MB/s, 1510.9 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  712.0 MB/s, 1298.0 MB/s  │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  732.0 MB/s, 1329.2 MB/s
 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  488.9 MB/s, 1278.6 MB/s  │ 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  480.8 MB/s, 1320.8 MB/s
 3#enwik8            : 100000000 ->  35445331 (x2.821),  366.7 MB/s, 1062.2 MB/s  │ 3#enwik8            : 100000000 ->  35445331 (x2.821),  368.0 MB/s, 1081.7 MB/s
 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  288.9 MB/s, 1256.5 MB/s  │ 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  291.8 MB/s, 1283.8 MB/s
 5#enwik8            : 100000000 ->  33744227 (x2.963),  229.6 MB/s, 1014.4 MB/s  │ 5#enwik8            : 100000000 ->  33744227 (x2.963),  233.7 MB/s, 1039.2 MB/s
compile zstd with clang-18                                                        │compile zstd with clang-18
c76d3a256061e4350b50746d1f96e3b6  zstd                                            │97cf6e79ed0ea1f62cbc98e1de32ea87  zstd
 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  988.7 MB/s  │ 0#enwik9.L22.zst    :1000000000 -> 215031773 (x4.650),   0.00 MB/s,  991.0 MB/s
 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1196.0 MB/s  │ 0#lesia.tar.L19.zst : 211957760 ->  52990423 (x4.000),   0.00 MB/s, 1212.6 MB/s
 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  964.4 MB/s, 1527.2 MB/s  │ 1#silesia.tar       : 211957760 ->  73292801 (x2.892),  950.9 MB/s, 1560.5 MB/s
 1#enwik8            : 100000000 ->  40675943 (x2.458),  727.8 MB/s, 1342.5 MB/s  │ 1#enwik8            : 100000000 ->  40675943 (x2.458),  718.3 MB/s, 1384.6 MB/s
 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  462.1 MB/s, 1335.7 MB/s  │ 3#silesia.tar       : 211957760 ->  66217754 (x3.201),  473.6 MB/s, 1352.4 MB/s
 3#enwik8            : 100000000 ->  35445331 (x2.821),  355.4 MB/s, 1111.2 MB/s  │ 3#enwik8            : 100000000 ->  35445331 (x2.821),  366.3 MB/s, 1114.5 MB/s
 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  273.3 MB/s, 1300.0 MB/s  │ 5#silesia.tar       : 211957760 ->  62847219 (x3.373),  278.8 MB/s, 1338.7 MB/s
 5#enwik8            : 100000000 ->  33744227 (x2.963),  216.3 MB/s, 1061.3 MB/s  │ 5#enwik8            : 100000000 ->  33744227 (x2.963),  222.5 MB/s, 1088.3 MB/s

I believe it's a good enough outcome to validate this PR,
ensuring that the impact would not come at the expense of other architectures.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants