{"action":"created","issue":{"url":"https://api.github.com/repos/lz4/lz4/issues/385","repository_url":"https://api.github.com/repos/lz4/lz4","labels_url":"https://api.github.com/repos/lz4/lz4/issues/385/labels{/name}","comments_url":"https://api.github.com/repos/lz4/lz4/issues/385/comments","events_url":"https://api.github.com/repos/lz4/lz4/issues/385/events","html_url":"https://github.com/lz4/lz4/issues/385","id":251505915,"number":385,"title":"datagen: Unrecognized header","user":{"login":"itoffshore","id":1141947,"avatar_url":"https://avatars2.githubusercontent.com/u/1141947?v=4","gravatar_id":"","url":"https://api.github.com/users/itoffshore","html_url":"https://github.com/itoffshore","followers_url":"https://api.github.com/users/itoffshore/followers","following_url":"https://api.github.com/users/itoffshore/following{/other_user}","gists_url":"https://api.github.com/users/itoffshore/gists{/gist_id}","starred_url":"https://api.github.com/users/itoffshore/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/itoffshore/subscriptions","organizations_url":"https://api.github.com/users/itoffshore/orgs","repos_url":"https://api.github.com/users/itoffshore/repos","events_url":"https://api.github.com/users/itoffshore/events{/privacy}","received_events_url":"https://api.github.com/users/itoffshore/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2017-08-20T18:30:08Z","updated_at":"2017-08-21T01:29:15Z","closed_at":"2017-08-21T01:29:15Z","body":"In [Alpine Linux](http://alpinelinux.org/) now we run the included unit tests for all packages. The test log shows all tests passing successfully but I see the following errors (possibly related to Alpine using Musl C not Glibc):\r\n\r\n```\r\nError 44 : Unrecognized header : file cannot be decoded \r\n! ./datagen | ../programs/lz4 -tf\r\n\r\nError 44 : Unrecognized header : file cannot be decoded \r\n\\n ---- pass-through mode ----\r\n! ./datagen | ../programs/lz4 -d  > /dev/null\r\n\r\nError 44 : Unrecognized header : file cannot be decoded \r\n./datagen | ../programs/lz4 -df > /dev/null\r\n```\r\n\r\n& also in the decompression function tests `tmp` is not found (I think this may be due to different options between `coreutils` & the builtin `busybox` tools):\r\n```\r\nDecompression functions : \r\nRead : 3068 MB   ==> 0.39%   \r\nCompressed 3221225472 bytes into 12676935 bytes ==> 0.39%                      \r\nCompleted in 19.69 sec \r\nstdin                : decoded 3221225472 bytes                                \r\n  899    1-LZ4_decompress_fast           :     18092 ->   109.9 MB/s\r\n  963    3-LZ4_decompress_fast_usingDict :     18092 ->   119.5 MB/s\r\n 6323    4-LZ4_decompress_safe           :     18092 ->   111.9 MB/s\r\n 6621    6-LZ4_decompress_safe_usingDict :     18092 ->   118.4 MB/s\r\n 6923    7-LZ4_decompress_safe_partial   :     18092 ->   112.8 MB/s\r\n 1175    8-LZ4_decompress_safe_forceExtD :     18092 ->   119.2 MB/s\r\n 1206   ls: tmp: No such file or directory\r\nmake[1]: *** [Makefile:185: test-lz4-contentSize] Error 1\r\n```\r\n\r\nThis is the test log in full:\r\n\r\n```\r\n./fasttest\r\n./frametest -T3mn\r\nStarting lz4frame tester (64-bits, 1.8.0)\r\nSeed = 5207\r\ngcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_  -c -o bench.o bench.c\r\nBasic tests completed \r\n    0   gcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_  -c -o datagen.o datagen.c\r\ngcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_ -Wl,--as-needed ../lib/lz4frame.o ../lib/xxhash.o ../lib/lz4hc.o ../lib/lz4.o bench.o lz4cli.o lz4io.o datagen.o -o lz4\r\nln -s lz4 unlz4\r\nmake[2]: Leaving directory '/home/stuart/aports/main/lz4/src/lz4-1.8.0/programs'\r\n./fullbench --no-prompt -i1 COPYING\r\ngcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_  -c -o bench.o bench.c\r\n*** LZ4 speed analyzer v1.8.0 64-bits, by Yann Collet ***\r\n- 1 iterations -\r\n COPYING :                                                                     \r\nCompression functions : \r\ngcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_  -c -o datagen.o datagen.c\r\n   15   gcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_ -Wl,--as-needed ../lib/lz4frame.o ../lib/xxhash.o ../lib/lz4hc.o ../lib/lz4.o bench.o lz4cli.o lz4io.o datagen.o -o lz4\r\n   56   gcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_ -Wl,--as-needed ../lib/lz4frame.o ../lib/xxhash.o ../lib/lz4hc.o ../lib/lz4.o bench.o lz4cli.o lz4io.o datagen.o -o lz4\r\nln -s lz4 lz4cat\r\nmake[2]: Leaving directory '/home/stuart/aports/main/lz4/src/lz4-1.8.0/programs'\r\ngcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_  -c -o lz4io.o lz4io.c\r\nln -s lz4 lz4c\r\nmake[2]: Leaving directory '/home/stuart/aports/main/lz4/src/lz4-1.8.0/programs'\r\n\\n ---- test lz4c version ----\r\n./datagen -g256MB | ../programs/lz4c -l -v    | ../programs/lz4c   -t\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\n! Generating compressed LZ4 using Legacy format (deprecated) ! \r\n   73   ./fuzzer -T3mn\r\nStarting LZ4 fuzzer (64-bits, v1.8.0)\r\nSeed = 9151\r\nOverflow tests : 64 bits mode : no overflow \r\n  106   All unit tests completed successfully compressionLevel=9 \r\nOverflow tests : 64 bits mode : no overflow \r\n  184   All unit tests completed successfully compressionLevel=11 \r\n    0   gcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_ -Wl,--as-needed ../lib/lz4frame.o ../lib/xxhash.o ../lib/lz4hc.o ../lib/lz4.o bench.o lz4cli.o lz4io.o datagen.o -o lz4\r\nmake[2]: Leaving directory '/home/stuart/aports/main/lz4/src/lz4-1.8.0/programs'\r\n\\n ---- test opt-parser ----\r\n./datagen -g16KB      | ../programs/lz4 -12      | ../programs/lz4 -t\r\n\\n ---- test lz4 basic compression/decompression ----\r\n./datagen -g0     | ../programs/lz4 -v     | ../programs/lz4 -t\r\n\r\nstdin                : decoded 16384 bytes                                     \r\n./datagen -P10        | ../programs/lz4 -12B4    | ../programs/lz4 -t\r\n\r\nusing blocks of size 64 KB \r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\n                                                                               \r\nCompressed 0 bytes into 15 bytes ==> 1500.00%\r\nstdin                : decoded 0 bytes                                         \r\n./datagen -g16KB  | ../programs/lz4 -9     | ../programs/lz4 -t\r\nstdin                : decoded 65536 bytes                                     \r\n./datagen -g256K      | ../programs/lz4 -12B4D   | ../programs/lz4 -t\r\nusing blocks of size 64 KB \r\n\r\nstdin                : decoded 16384 bytes                                     \r\n./datagen -g20KB > tmpSrc\r\n\r\n../programs/lz4 < tmpSrc   | ../programs/lz4 -d > tmpRes\r\ndiff -q tmpSrc tmpRes\r\n../programs/lz4 --no-frame-crc < tmpSrc | ../programs/lz4 -d > tmpRes\r\ndiff -q tmpSrc tmpRes\r\n./datagen         | ../programs/lz4        | ../programs/lz4 -t\r\n\r\nstdin                : decoded 65536 bytes                                     \r\n./datagen -g6M -P99 | ../programs/lz4 -9BD | ../programs/lz4 -t\r\n\r\nstdin                : decoded 262144 bytes                                    \r\n./datagen -g512K -P25 | ../programs/lz4 -12BD    | ../programs/lz4 -t\r\n    8   \r\n\r\nstdin                : decoded 524288 bytes                                    \r\n./datagen -g1M        | ../programs/lz4 -12B5    | ../programs/lz4 -t\r\nusing blocks of size 256 KB \r\nstdin                : decoded 6291456 bytes                                   \r\n./datagen -g17M   | ../programs/lz4 -9v    | ../programs/lz4 -qt\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\n    9   \r\nstdin                : decoded 1048576 bytes                                   \r\n./datagen -g2M -P99   | ../programs/lz4 -11B4D   | ../programs/lz4 -t\r\n  327   using blocks of size 64 KB \r\n  383   \r\nstdin                : decoded 2097152 bytes                                   \r\n./datagen -g4M        | ../programs/lz4 -11vq    | ../programs/lz4 -qt\r\n\r\n  393    1-LZ4_compress_default         :    18092 ->    10582 (58.49%),  196.6 MB/s\r\n  412   \r\n./datagen -g8M        | ../programs/lz4 -11B4    | ../programs/lz4 -t\r\n   42   using blocks of size 64 KB \r\nCompressed 17825792 bytes into 8086251 bytes ==> 45.36%                        \r\n./datagen -g33M   | ../programs/lz4 --no-frame-crc | ../programs/lz4 -t\r\n   45   \r\nstdin                : decoded 34603008 bytes                                  \r\n./datagen -g256MB | ../programs/lz4 -vqB4D | ../programs/lz4 -t\r\n  526   using blocks of size 64 KB \r\n   61   \r\nCompressed 268435456 bytes into 156514661 bytes ==> 58.31%                     \r\nstdin                : decoded 268435456 bytes                                 \r\n\\n ---- test multiple files ----\r\n../programs/lz4 -f -m tmp*\r\n  549   ls -ls tmp*\r\n    64 -rw-r--r--    1 stuart   stuart       65536 Aug 20 16:04 tmp1\r\n    36 -rw-r--r--    1 stuart   stuart       33368 Aug 20 16:04 tmp1.lz4\r\n   100 -rw-r--r--    1 stuart   stuart      102400 Aug 20 16:04 tmp2\r\n    56 -rw-r--r--    1 stuart   stuart       56193 Aug 20 16:04 tmp2.lz4\r\n  1024 -rw-r--r--    1 stuart   stuart     1048576 Aug 20 16:04 tmp3\r\n   596 -rw-r--r--    1 stuart   stuart      606770 Aug 20 16:04 tmp3.lz4\r\n    20 -rw-r--r--    1 stuart   stuart       20480 Aug 20 16:04 tmpRes\r\n    16 -rw-r--r--    1 stuart   stuart       12461 Aug 20 16:04 tmpRes.lz4\r\n    20 -rw-r--r--    1 stuart   stuart       20480 Aug 20 16:04 tmpSrc\r\n    16 -rw-r--r--    1 stuart   stuart       12461 Aug 20 16:04 tmpSrc.lz4\r\n../programs/lz4 -df -m *.lz4\r\nls -ls tmp*\r\n    64 -rw-r--r--    1 stuart   stuart       65536 Aug 20 16:04 tmp1\r\n    36 -rw-r--r--    1 stuart   stuart       33368 Aug 20 16:04 tmp1.lz4\r\n   100 -rw-r--r--    1 stuart   stuart      102400 Aug 20 16:04 tmp2\r\n    56 -rw-r--r--    1 stuart   stuart       56193 Aug 20 16:04 tmp2.lz4\r\n  1024 -rw-r--r--    1 stuart   stuart     1048576 Aug 20 16:04 tmp3\r\n   596 -rw-r--r--    1 stuart   stuart      606770 Aug 20 16:04 tmp3.lz4\r\n    20 -rw-r--r--    1 stuart   stuart       20480 Aug 20 16:04 tmpRes\r\n    16 -rw-r--r--    1 stuart   stuart       12461 Aug 20 16:04 tmpRes.lz4\r\n    20 -rw-r--r--    1 stuart   stuart       20480 Aug 20 16:04 tmpSrc\r\n    16 -rw-r--r--    1 stuart   stuart       12461 Aug 20 16:04 tmpSrc.lz4\r\n../programs/lz4 -f -m tmp1 notHere tmp2; echo $?\r\nnotHere: No such file or directory \r\n1\r\n\\n ---- test sparse file support ----\r\n./datagen -g5M  -P100 > tmpSrc\r\n   62   \r\n../programs/lz4 -B4D tmpSrc | ../programs/lz4 -dv --sparse > tmpB4\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\nusing blocks of size 64 KB \r\nstdin                : decoded 5242880 bytes                                   \r\ndiff -s tmpSrc tmpB4\r\nFiles tmpSrc and tmpB4 are identical\r\n../programs/lz4 -B5D tmpSrc | ../programs/lz4 -dv --sparse > tmpB5\r\nusing blocks of size 256 KB \r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\n\r\nstdin                : decoded 8388608 bytes                                   \r\n./datagen -g16M -P90  | ../programs/lz4 -11B5    | ../programs/lz4 -t\r\nusing blocks of size 256 KB \r\nstdin                : decoded 5242880 bytes                                   \r\ndiff -s tmpSrc tmpB5\r\nFiles tmpSrc and tmpB5 are identical\r\n../programs/lz4 -B6D tmpSrc | ../programs/lz4 -dv --sparse > tmpB6\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\nusing blocks of size 1024 KB \r\nstdin                : decoded 5242880 bytes                                   \r\ndiff -s tmpSrc tmpB6\r\n   70   Files tmpSrc and tmpB6 are identical\r\n../programs/lz4 -B7D tmpSrc | ../programs/lz4 -dv --sparse > tmpB7\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\nusing blocks of size 4096 KB \r\nstdin                : decoded 5242880 bytes                                   \r\ndiff -s tmpSrc tmpB7\r\nFiles tmpSrc and tmpB7 are identical\r\n../programs/lz4 tmpSrc | ../programs/lz4 -dv --no-sparse > tmpNoSparse\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\nstdin                : decoded 5242880 bytes                                   \r\ndiff -s tmpSrc tmpNoSparse\r\nFiles tmpSrc and tmpNoSparse are identical\r\nls -ls tmp*\r\n  5120 -rw-r--r--    1 stuart   stuart     5242880 Aug 20 16:04 tmpB4\r\n  5120 -rw-r--r--    1 stuart   stuart     5242880 Aug 20 16:04 tmpB5\r\n  5120 -rw-r--r--    1 stuart   stuart     5242880 Aug 20 16:04 tmpB6\r\n  5120 -rw-r--r--    1 stuart   stuart     5242880 Aug 20 16:04 tmpB7\r\n  5120 -rw-r--r--    1 stuart   stuart     5242880 Aug 20 16:04 tmpNoSparse\r\n  5120 -rw-r--r--    1 stuart   stuart     5242880 Aug 20 16:04 tmpSrc\r\n./datagen -s1 -g1200007 -P100 | ../programs/lz4 | ../programs/lz4 -dv --sparse > tmpOdd   # Odd size file (to generate non-full last block)\r\n  738   *** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\n\r\nstdin                : decoded 1200007 bytes                                   \r\n./datagen -s1 -g1200007 -P100 | diff -s - tmpOdd\r\n\r\nFiles - and tmpOdd are identical\r\nls -ls tmpOdd\r\n  1172 -rw-r--r--    1 stuart   stuart     1200007 Aug 20 16:04 tmpOdd\r\n\\n Compatibility with Console :\r\necho \"Hello World 1 !\" | ../programs/lz4 | ../programs/lz4 -d -c\r\nHello World 1 !\r\necho \"Hello World 2 !\" | ../programs/lz4 | ../programs/lz4 -d | cat\r\nHello World 2 !\r\necho \"Hello World 3 !\" | ../programs/lz4 --no-frame-crc | ../programs/lz4 -d -c\r\nHello World 3 !\r\n\\n Compatibility with Append :\r\n./datagen -P100 -g1M > tmp1M\r\n\r\ncat tmp1M tmp1M > tmp2M\r\n../programs/lz4 -B5 -v tmp1M tmpC\r\nusing blocks of size 256 KB \r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\nCompressed 1048576 bytes into 4192 bytes ==> 0.40%                             \r\n../programs/lz4 -d -v tmpC tmpR\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\ntmpC                 : decoded 1048576 bytes                                   \r\n../programs/lz4 -d -v tmpC >> tmpR\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\ntmpC                 : decoded 1048576 bytes                                   \r\nls -ls tmp*\r\n  1024 -rw-r--r--    1 stuart   stuart     1048576 Aug 20 16:04 tmp1M\r\n  2048 -rw-r--r--    1 stuart   stuart     2097152 Aug 20 16:04 tmp2M\r\n     8 -rw-r--r--    1 stuart   stuart        4192 Aug 20 16:04 tmpC\r\n  1032 -rw-r--r--    1 stuart   stuart     2097152 Aug 20 16:04 tmpR\r\ndiff tmp2M tmpR\r\n\\n ---- test frame concatenation ----\r\ncat nonempty.test empty.test nonempty.test > orig.test\r\ncat nonempty.lz4.test empty.lz4.test nonempty.lz4.test > concat.lz4.test\r\n../programs/lz4 -d concat.lz4.test > result.test\r\nsdiff orig.test result.test\r\nhi\t\t\t\t\t\t\t\thi\r\nhi\t\t\t\t\t\t\t\thi\r\nframe concatenation test completed\r\n\\n ---- bench mode ----\r\n../programs/lz4 -bi1\r\n  778    2-LZ4_compress_default(small d :    18092 ->    10582 (58.49%),  188.6 MB/s\r\n  877   \r\nstdin                : decoded 16777216 bytes                                  \r\n./datagen -g32M -P10  | ../programs/lz4 -11B5D   | ../programs/lz4 -t\r\nusing blocks of size 256 KB \r\n  127    3-LZ4_compress_fast(0)         :    18092 ->    10582 (58.49%),  194.7 MB/s\r\n 1#77    =-Synthetic 50%     :  10000000 ->   5859357 (1.707), 169.8 MB/s , 366.3 MB/s\r\n\\n ---- test mode ----\r\n! ./datagen | ../programs/lz4 -t\r\n\r\nError 44 : Unrecognized header : file cannot be decoded \r\n! ./datagen | ../programs/lz4 -tf\r\n\r\nError 44 : Unrecognized header : file cannot be decoded \r\n\\n ---- pass-through mode ----\r\n! ./datagen | ../programs/lz4 -d  > /dev/null\r\n\r\nError 44 : Unrecognized header : file cannot be decoded \r\n./datagen | ../programs/lz4 -df > /dev/null\r\n\r\n../programs/lz4 -dcf tmp1\r\nHello World !\r\n../programs/lz4 -dcfm tmp1 tmp2\r\nHello World !\r\nfrom underground...\r\n\\n ---- test cli ----\r\n! ../programs/lz4     file-does-not-exist\r\nCompressed filename will be : file-does-not-exist.lz4 \r\nfile-does-not-exist: No such file or directory \r\n! ../programs/lz4 -f  file-does-not-exist\r\nCompressed filename will be : file-does-not-exist.lz4 \r\nfile-does-not-exist: No such file or directory \r\n! ../programs/lz4 -fm file1-dne file2-dne\r\nfile1-dne: No such file or directory \r\nfile2-dne: No such file or directory \r\n! ../programs/lz4 -fm file1-dne file2-dne\r\nfile1-dne: No such file or directory \r\nfile2-dne: No such file or directory \r\n\\n ---- test original size support ----\r\n./datagen -g15M > tmp\r\n 1227   \r\n../programs/lz4 -v tmp | ../programs/lz4 -t\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\nCompressed 15728640 bytes into 9227754 bytes ==> 58.67%                        \r\nstdin                : decoded 15728640 bytes                                  \r\n../programs/lz4 -v --content-size tmp | ../programs/lz4 -d > tmp2\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\nCompressed 15728640 bytes into 9227762 bytes ==> 58.67%                        \r\ndiff -s tmp tmp2\r\n  150   Files tmp and tmp2 are identical\r\n# test large size [2-4] GB\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\n_POSIX_C_SOURCE defined: 200112L\r\n_POSIX_VERSION defined: 200809L\r\nPLATFORM_POSIX_VERSION defined: 200809L\r\nUsing stdin for input\r\nUsing stdout for output\r\nSparse File Support is automatically disabled on stdout ; try --sparse \r\nRead : 76 MB   ==> 0.39%   \r\nstdin                : decoded 33554432 bytes                                  \r\n\\n ---- test huge files compression/decompression ----\r\n./datagen -g6GB   | ../programs/lz4 -vB5D  | ../programs/lz4 -qt\r\nusing blocks of size 256 KB \r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\nRead : 88 MB   ==> 0.39%    4-LZ4_compress_fast(1)         :    18092 ->    10582 (58.49%),  187.6 MB/s\r\nRead : 120 MB   ==> 0.39%   \r\nstdin                : decoded 268435456 bytes                                 \r\nRead : 124 MB   ==> 0.39%   ../programs/lz4 --rm -f tmp tmp.lz4\r\nCompressed 12 bytes into 31 bytes ==> 258.33%                                  \r\ntest ! -f tmp                      # must fail (--rm)\r\nRead : 128 MB   ==> 0.39%   test   -f tmp.lz4\r\n../programs/lz4cat tmp.lz4           # must display hello world\r\nRead : 132 MB   ==> 0.39%   hello world\r\ntest   -f tmp.lz4\r\n../programs/unlz4 --rm tmp.lz4 tmp\r\ntmp.lz4              : decoded 12 bytes                                        \r\ntest   -f tmp\r\ntest ! -f tmp.lz4                  # must fail (--rm)\r\nRead : 140 MB   ==> 0.39%   test ! -f tmp.lz4.lz4              # must fail (unlz4)\r\n../programs/lz4cat tmp               # pass-through mode\r\nhello world\r\ntest   -f tmp\r\nRead : 144 MB   ==> 0.39%   test ! -f tmp.lz4                  # must fail (lz4cat)\r\nRead : 148 MB   ==> 0.39%   ../programs/lz4 tmp tmp.lz4                 # creates tmp.lz4\r\nCompressed 12 bytes into 31 bytes ==> 258.33%                                  \r\n../programs/lz4cat < tmp.lz4 > tmp3  # checks lz4cat works with stdin (#285)\r\ndiff -q tmp tmp3\r\n../programs/lz4cat < tmp > tmp2      # checks lz4cat works with stdin (#285)\r\ndiff -q tmp tmp2\r\ncp tmp ./-d\r\n../programs/lz4 --rm -- -d -d.lz4           # compresses ./d into ./-d.lz4\r\nCompressed 12 bytes into 31 bytes ==> 258.33%                                  \r\ntest   -f ./-d.lz4\r\ntest ! -f ./-d\r\nmv ./-d.lz4 ./-z\r\n../programs/lz4 -d --rm -- -z tmp4          # uncompresses ./-z into tmp4\r\n-z                   : decoded 12 bytes                                        \r\ntest ! -f ./-z\r\ndiff -q tmp tmp4\r\n../programs/lz4 -f tmp\r\nCompressed filename will be : tmp.lz4 \r\nCompressed 12 bytes into 31 bytes ==> 258.33%                                  \r\ncat tmp >> tmp.lz4\r\n../programs/lz4 -f tmp.lz4         # uncompress valid frame followed by invalid data\r\nDecoding file tmp \r\nStream followed by undecodable data at position 35 \r\ntmp.lz4              : decoded 12 bytes                                        \r\n../programs/lz4 -BX tmp -c -q | ../programs/lz4 -tv  # test block checksum\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\nstdin                : decoded 12 bytes                                        \r\nRead : 328 MB   ==> 0.39%    5-LZ4_compress_fast(2)         :    18092 ->    10951 (60.53%),  193.2 MB/s\r\n  339    6-LZ4_compress_fast(17)        :    18092 ->    15583 (86.13%),  261.6 MB/s\r\nRead : 812 MB   ==> 0.39%    7-LZ4_compress_fast_extState(0 :    18092 ->    10582 (58.49%),  180.8 MB/s\r\nRead : 1116 MB   ==> 0.39%    8-LZ4_compress_fast_continue(0 :    18092 ->    10647 (58.85%),  163.5 MB/s\r\nRead : 1420 MB   ==> 0.39%   10-LZ4_compress_HC              :    18092 ->     9050 (50.02%),   26.1 MB/s\r\nRead : 1680 MB   ==> 0.39%   12-LZ4_compress_HC_extStateHC   :    18092 ->     9050 (50.02%),   36.3 MB/s\r\nRead : 1976 MB   ==> 0.39%   14-LZ4_compress_HC_continue     :    18092 ->     9050 (50.02%),   36.4 MB/s\r\nRead : 2248 MB   ==> 0.39%   20-LZ4_compress_forceDict       :    18092 ->    10647 (58.85%),  164.8 MB/s\r\nRead : 2484 MB   ==> 0.39%   30-LZ4F_compressFrame           :    18092 ->    10597 (58.57%),  181.1 MB/s\r\nRead : 2704 MB   ==> 0.39%   40-LZ4_saveDict                 :    18092 ->    18092 (100.0%),20048.8 MB/s\r\n 5144   41-LZ4_saveDictHC               :    18092 ->    18092 (100.0%),19736.6 MB/s\r\nDecompression functions : \r\nRead : 3068 MB   ==> 0.39%   \r\nCompressed 3221225472 bytes into 12676935 bytes ==> 0.39%                      \r\nCompleted in 19.69 sec \r\nstdin                : decoded 3221225472 bytes                                \r\n  899    1-LZ4_decompress_fast           :     18092 ->   109.9 MB/s\r\n  963    3-LZ4_decompress_fast_usingDict :     18092 ->   119.5 MB/s\r\n 6323    4-LZ4_decompress_safe           :     18092 ->   111.9 MB/s\r\n 6621    6-LZ4_decompress_safe_usingDict :     18092 ->   118.4 MB/s\r\n 6923    7-LZ4_decompress_safe_partial   :     18092 ->   112.8 MB/s\r\n 1175    8-LZ4_decompress_safe_forceExtD :     18092 ->   119.2 MB/s\r\n 1206   ls: tmp: No such file or directory\r\nmake[1]: *** [Makefile:185: test-lz4-contentSize] Error 1\r\nmake[1]: *** Waiting for unfinished jobs....\r\n 1256    9-LZ4F_decompress               :     18092 ->   114.3 MB/s\r\n20081   \r\nCompressed 6442450944 bytes into 3750754317 bytes ==> 58.22%                   \r\n./datagen -g6GB   | ../programs/lz4 -v5BD  | ../programs/lz4 -qt\r\n*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\nAll tests completed   \r\n   4801 /   4801   - all tests completed successfully \r\ncompression ratio: 55.071%\r\nHC compression ratio: 51.888%\r\nratio with dict: 35.480%\r\n\r\nCompressed 6442450944 bytes into 2896075899 bytes ==> 44.95%                   \r\nmake[1]: Leaving directory '/home/stuart/aports/main/lz4/src/lz4-1.8.0/tests'\r\nmake: *** [Makefile:127: test] Error 2\r\n```\r\n__________________________________________________\r\n& this is the shorter test log from installing `coreutils` into the build environment:\r\n__________________________________________________\r\n\r\n```\r\n\\n ---- test opt-parser ----\r\n./datagen -g16KB      | ../programs/lz4 -12      | ../programs/lz4 -t\r\n\r\nstdin                : decoded 16384 bytes                                     \r\n./datagen -P10        | ../programs/lz4 -12B4    | ../programs/lz4 -t\r\nusing blocks of size 64 KB \r\n\r\nstdin                : decoded 65536 bytes                                     \r\n./datagen -g256K      | ../programs/lz4 -12B4D   | ../programs/lz4 -t\r\nusing blocks of size 64 KB \r\n\r\ngcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_  -c -o bench.o bench.c\r\n\\n ---- test multiple files ----\r\n../programs/lz4 -f -m tmp*\r\nstdin                : decoded 262144 bytes                                    \r\n./datagen -g512K -P25 | ../programs/lz4 -12BD    | ../programs/lz4 -t\r\n\\n ---- test sparse file support ----\r\n./datagen -g5M  -P100 > tmpSrc\r\n\r\nls -ls tmp*\r\n\r\n../programs/lz4 -B4D tmpSrc | ../programs/lz4 -dv --sparse > tmpB4\r\n  64 -rw-r--r-- 1 stuart stuart   65536 Aug 20 17:57 tmp1*** LZ4 command line interface 64-bits v1.8.0, by Yann Collet ***\r\n\r\nusing blocks of size 64 KB \r\n  36 -rw-r--r-- 1 stuart stuart   33368 Aug 20 17:57 tmp1.lz4\r\n 100 -rw-r--r-- 1 stuart stuart  102400 Aug 20 17:57 tmp2\r\n  56 -rw-r--r-- 1 stuart stuart   56193 Aug 20 17:57 tmp2.lz4\r\n1024 -rw-r--r-- 1 stuart stuart 1048576 Aug 20 17:57 tmp3\r\n 596 -rw-r--r-- 1 stuart stuart  606770 Aug 20 17:57 tmp3.lz4\r\n5120 -rw-r--r-- 1 stuart stuart 5242880 Aug 20 17:57 tmpSrc\r\n../programs/lz4 -df -m *.lz4\r\nls -ls tmp*\r\n  64 -rw-r--r-- 1 stuart stuart   65536 Aug 20 17:57 tmp1\r\n  36 -rw-r--r-- 1 stuart stuart   33368 Aug 20 17:57 tmp1.lz4\r\n 100 -rw-r--r-- 1 stuart stuart  102400 Aug 20 17:57 tmp2\r\n  56 -rw-r--r-- 1 stuart stuart   56193 Aug 20 17:57 tmp2.lz4\r\n1024 -rw-r--r-- 1 stuart stuart 1048576 Aug 20 17:57 tmp3\r\n 596 -rw-r--r-- 1 stuart stuart  606770 Aug 20 17:57 tmp3.lz4\r\n 704 -rw-r--r-- 1 stuart stuart  720896 Aug 20 17:57 tmpB4\r\n5120 -rw-r--r-- 1 stuart stuart 5242880 Aug 20 17:57 tmpSrc\r\n../programs/lz4 -f -m tmp1 notHere tmp2; echo $?\r\nnotHere: No such file or directory \r\n1\r\n\\n ---- test frame concatenation ----\r\ncat nonempty.test empty.test nonempty.test > orig.test\r\ncat nonempty.lz4.test empty.lz4.test nonempty.lz4.test > concat.lz4.test\r\n../programs/lz4 -d concat.lz4.test > result.test\r\nsdiff orig.test result.test\r\nhi\t\t\t\t\t\t\t\thi\r\nhi\t\t\t\t\t\t\t\thi\r\nframe concatenation test completed\r\n\\n ---- bench mode ----\r\n../programs/lz4 -bi1\r\ngcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_ -Wl,--as-needed ../lib/lz4frame.o ../lib/xxhash.o ../lib/lz4hc.o ../lib/lz4.o bench.o lz4cli.o lz4io.o datagen.o -o lz4\r\nstdin                : decoded 5242880 bytes                                   \r\ndiff -s tmpSrc tmpB4\r\ndiff: tmpSrc: No such file or directory\r\ndiff: tmpB4: No such file or directory\r\nmake[1]: *** [Makefile:149: test-lz4-sparse] Error 2\r\nmake[1]: *** Waiting for unfinished jobs....\r\ngcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_  -c -o lz4cli.o lz4cli.c\r\nln -s lz4 lz4cat\r\nmake[2]: Leaving directory '/home/stuart/aports/main/lz4/src/lz4-1.8.0/programs'\r\nstdin                : decoded 524288 bytes                                    \r\n./datagen -g1M        | ../programs/lz4 -12B5    | ../programs/lz4 -t\r\nusing blocks of size 256 KB \r\ngcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_ -Wl,--as-needed ../lib/lz4frame.o ../lib/xxhash.o ../lib/lz4hc.o ../lib/lz4.o bench.o lz4cli.o lz4io.o datagen.o -o lz4\r\nln -s lz4 lz4c\r\nmake[2]: Leaving directory '/home/stuart/aports/main/lz4/src/lz4-1.8.0/programs'\r\n\r\nstdin                : decoded 1048576 bytes                                   \r\n./datagen -g2M -P99   | ../programs/lz4 -11B4D   | ../programs/lz4 -t\r\nusing blocks of size 64 KB \r\n\r\nstdin                : decoded 2097152 bytes                                   \r\n./datagen -g4M        | ../programs/lz4 -11vq    | ../programs/lz4 -qt\r\n\r\n./datagen -g8M        | ../programs/lz4 -11B4    | ../programs/lz4 -t\r\nusing blocks of size 64 KB \r\ngcc -Os -fomit-frame-pointer -g -Wall -Wextra -Wundef -Wcast-qual -Wcast-align -Wshadow -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wpointer-arith -Wstrict-aliasing=1  -I../lib -I../programs -DXXH_NAMESPACE=LZ4_ -I../lib -DXXH_NAMESPACE=LZ4_ -Wl,--as-needed ../lib/lz4frame.o ../lib/xxhash.o ../lib/lz4hc.o ../lib/lz4.o bench.o lz4cli.o lz4io.o datagen.o -o lz4\r\nln -s lz4 unlz4\r\nmake[2]: Leaving directory '/home/stuart/aports/main/lz4/src/lz4-1.8.0/programs'\r\n /-Synthetic 50%     :  10000000 ->   5859357 (1.707), 300.0 MB/s\r\nstdin                : decoded 8388608 bytes                                   \r\n./datagen -g16M -P90  | ../programs/lz4 -11B5    | ../programs/lz4 -t\r\nusing blocks of size 256 KB \r\n\r\nstdin                : decoded 16777216 bytes                                  \r\n./datagen -g32M -P10  | ../programs/lz4 -11B5D   | ../programs/lz4 -t\r\nusing blocks of size 256 KB \r\n \\-Synthetic 50%     :  10000000 ->   5859357 (1.707), 316.8 MB/s , 405.0 MB/s\r\nstdin                : decoded 33554432 bytes                                  \r\n 1#Synthetic 50%     :  10000000 ->   5859357 (1.707), 316.8 MB/s , 432.8 MB/s\r\n\\n ---- test mode ----\r\n! ./datagen | ../programs/lz4 -t\r\n\r\nError 44 : Unrecognized header : file cannot be decoded \r\n! ./datagen | ../programs/lz4 -tf\r\n\r\nError 44 : Unrecognized header : file cannot be decoded \r\n\\n ---- pass-through mode ----\r\n! ./datagen | ../programs/lz4 -d  > /dev/null\r\n\r\nError 44 : Unrecognized header : file cannot be decoded \r\n./datagen | ../programs/lz4 -df > /dev/null\r\n\r\n../programs/lz4 -dcf tmp1\r\nHello World !\r\n../programs/lz4 -dcfm tmp1 tmp2\r\nHello World !\r\nfrom underground...\r\n\\n ---- test cli ----\r\n! ../programs/lz4     file-does-not-exist\r\nCompressed filename will be : file-does-not-exist.lz4 \r\nfile-does-not-exist: No such file or directory \r\n! ../programs/lz4 -f  file-does-not-exist\r\nCompressed filename will be : file-does-not-exist.lz4 \r\nfile-does-not-exist: No such file or directory \r\n! ../programs/lz4 -fm file1-dne file2-dne\r\nfile1-dne: No such file or directory \r\nfile2-dne: No such file or directory \r\n! ../programs/lz4 -fm file1-dne file2-dne\r\nfile1-dne: No such file or directory \r\nfile2-dne: No such file or directory \r\nmake[1]: Leaving directory '/home/stuart/aports/main/lz4/src/lz4-1.8.0/tests'\r\nmake: *** [Makefile:127: test] Error 2\r\n\r\n```\r\nThe easiest way to duplicate this is to setup an [Alpine LXC container](https://wiki.alpinelinux.org/wiki/LXC#Alpine_Template) & `apk add alpine-sdk`\r\n\r\nYou will also need to `apk add diffutils` as the tests seem to use some options not in the `busybox` `diff` builtin command.\r\n\r\nIf I can help to resolve these problems please let me know."},"comment":{"url":"https://api.github.com/repos/lz4/lz4/issues/comments/323626417","html_url":"https://github.com/lz4/lz4/issues/385#issuecomment-323626417","issue_url":"https://api.github.com/repos/lz4/lz4/issues/385","id":323626417,"user":{"login":"itoffshore","id":1141947,"avatar_url":"https://avatars2.githubusercontent.com/u/1141947?v=4","gravatar_id":"","url":"https://api.github.com/users/itoffshore","html_url":"https://github.com/itoffshore","followers_url":"https://api.github.com/users/itoffshore/followers","following_url":"https://api.github.com/users/itoffshore/following{/other_user}","gists_url":"https://api.github.com/users/itoffshore/gists{/gist_id}","starred_url":"https://api.github.com/users/itoffshore/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/itoffshore/subscriptions","organizations_url":"https://api.github.com/users/itoffshore/orgs","repos_url":"https://api.github.com/users/itoffshore/repos","events_url":"https://api.github.com/users/itoffshore/events{/privacy}","received_events_url":"https://api.github.com/users/itoffshore/received_events","type":"User","site_admin":false},"created_at":"2017-08-21T01:29:15Z","updated_at":"2017-08-21T01:29:15Z","body":"ok - this issue can be closed then"}}
{"actor":{"display_login":"itoffshore"}}