[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results
Chad Rosier
mcrosier at apple.com
Wed Apr 4 17:43:43 PDT 2012
On Apr 4, 2012, at 5:29 PM, Eric Christopher wrote:
> I don't know who owns this bot but it is both useless and verbose.
+1
Chad
> -eric
>
> On Apr 4, 2012, at 3:40 PM, llvm-testresults at cs.uiuc.edu wrote:
>
>> llvmsuitebot1__clang_DEV__x86_64 test results
>>
>> Run Order Start Time Duration
>> Current 154054 2012-04-04 21:56:50 0:43:27
>> Previous 154047 2012-04-04 21:03:00 0:43:22
>> Baseline 153780 2012-03-30 22:20:19 0:14:25
>> Tests Summary
>>
>> Status Group # # (B)
>> Performance Regressions 51 30
>> Performance Improvements 4 50
>> Existing Failures 8 8
>> Unchanged Tests 825 800
>> Total Tests 888 888
>>
>> Run-Over-Run Changes Detail
>>
>> Performance Regressions - Compile Time Δ Previous Current σ Δ (B) σ (B)
>> MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra 200.00% 0.0100 0.0300 0.0047 -25.00% 0.0047
>> SingleSource/Benchmarks/Stanford/FloatMM 200.00% 0.0100 0.0300 0.0047 -25.00% 0.0047
>> SingleSource/UnitTests/2003-07-09-SignedArgs 200.00% 0.0100 0.0300 0.0000 0.00% 0.0000
>> SingleSource/UnitTests/SignlessTypes/shr 200.00% 0.0100 0.0300 0.0000 0.00% 0.0000
>> MultiSource/Benchmarks/Olden/perimeter/perimeter 100.00% 0.0300 0.0600 0.0047 20.00% 0.0047
>> SingleSource/Benchmarks/Shootout/sieve 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>> SingleSource/Regression/C++/EH/ConditionalExpr 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>> SingleSource/Regression/C/2003-05-21-UnionTest 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>> SingleSource/Regression/C/2003-05-22-VarSizeArray 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>> SingleSource/Regression/C/2003-05-23-TransparentUnion 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>> SingleSource/Regression/C/DuffsDevice 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>> SingleSource/Regression/C/PR640 100.00% 0.0100 0.0200 0.0000 -33.33% 0.0000
>> SingleSource/UnitTests/2002-12-13-MishaTest 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>> SingleSource/UnitTests/ms_struct_pack_layout 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>> SingleSource/UnitTests/stmtexpr 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>> MultiSource/Benchmarks/Olden/mst/mst 60.00% 0.0500 0.0800 0.0047 33.33% 0.0047
>> SingleSource/UnitTests/Vector/SSE/sse_isamax 50.00% 0.0400 0.0600 0.0047 -25.00% 0.0047
>> MultiSource/Benchmarks/Olden/power/power 42.86% 0.0700 0.1000 0.0000 25.00% 0.0000
>> MultiSource/Benchmarks/Olden/em3d/em3d 40.00% 0.1000 0.1400 0.0000 7.69% 0.0000
>> SingleSource/Benchmarks/McGill/exptree 40.00% 0.0500 0.0700 0.0000 16.67% 0.0000
>> MultiSource/Benchmarks/MiBench/network-patricia/network-patricia 33.33% 0.0600 0.0800 0.0047 33.33% 0.0047
>> MultiSource/Benchmarks/Olden/tsp/tsp 28.57% 0.0700 0.0900 0.0000 0.00% 0.0000
>> SingleSource/UnitTests/Vector/SSE/sse_stepfft 28.57% 0.0700 0.0900 0.0000 0.00% 0.0000
>> MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount 18.75% 0.1600 0.1900 0.0047 5.56% 0.0047
>> SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 16.67% 0.1200 0.1400 0.0047 7.69% 0.0047
>> MultiSource/Benchmarks/Prolangs-C/archie-client/archie 15.38% 0.3900 0.4500 0.0125 0.00% 0.0125
>> SingleSource/Benchmarks/Shootout-C++/hello 13.33% 0.1500 0.1700 0.0047 6.25% 0.0047
>> SingleSource/Benchmarks/Shootout-C++/except 12.50% 0.1600 0.1800 0.0000 -5.26% 0.0000
>> MultiSource/Benchmarks/Fhourstones/fhourstones 11.11% 0.0900 0.1000 0.0000 25.00% 0.0000
>> SingleSource/Benchmarks/Shootout-C++/moments 10.71% 0.2800 0.3100 0.0047 3.33% 0.0047
>> SingleSource/Benchmarks/CoyoteBench/fftbench 10.34% 0.2900 0.3200 0.0082 6.67% 0.0082
>> SingleSource/Benchmarks/Shootout-C++/wordfreq 8.70% 0.2300 0.2500 0.0047 -3.85% 0.0047
>> MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url 6.67% 0.1500 0.1600 0.0000 -11.11% 0.0000
>> SingleSource/Benchmarks/Misc-C++/bigfib 6.52% 0.4600 0.4900 0.0047 -2.00% 0.0047
>> SingleSource/Benchmarks/Shootout-C++/wc 5.56% 0.1800 0.1900 0.0000 -9.52% 0.0000
>> MultiSource/Applications/obsequi/Obsequi 5.00% 0.8000 0.8400 0.0125 -3.45% 0.0125
>> MultiSource/Applications/hbd/hbd 4.76% 1.0500 1.1000 0.0047 1.85% 0.0047
>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell 4.24% 1.1800 1.2300 0.0000 -3.15% 0.0000
>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep 4.08% 0.9800 1.0200 0.0082 7.37% 0.0082
>> MultiSource/Applications/lua/lua 1.64% 3.0500 3.1000 0.0141 0.32% 0.0141
>> Performance Regressions - Execution Time Δ Previous Current σ Δ (B) σ (B)
>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail 40.00% 0.0500 0.0700 0.0047 0.00% 0.0047
>> MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra 33.33% 0.0300 0.0400 0.0000 0.00% 0.0000
>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael 33.33% 0.0300 0.0400 0.0000 33.33% 0.0000
>> MultiSource/Benchmarks/FreeBench/analyzer/analyzer 16.67% 0.0600 0.0700 0.0000 0.00% 0.0000
>> MultiSource/Benchmarks/McCat/18-imp/imp 16.67% 0.0600 0.0700 0.0000 16.67% 0.0000
>> MultiSource/Benchmarks/FreeBench/distray/distray 7.69% 0.1300 0.1400 0.0000 0.00% 0.0000
>> MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 7.69% 0.1300 0.1400 0.0000 0.00% 0.0000
>> SingleSource/Benchmarks/Shootout-C++/nestedloop 6.67% 0.1500 0.1600 0.0000 0.00% 0.0000
>> MultiSource/Applications/spiff/spiff 3.49% 1.7200 1.7800 0.0170 -4.30% 0.0170
>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow 3.13% 0.3200 0.3300 0.0000 0.00% 0.0000
>> SingleSource/Benchmarks/Shootout/hash 3.06% 3.2700 3.3700 0.0082 -0.59% 0.0082
>> Performance Improvements - Compile Time Δ Previous Current σ Δ (B) σ (B)
>> MultiSource/Benchmarks/FreeBench/analyzer/analyzer -22.22% 0.1800 0.1400 0.0094 -12.50% 0.0094
>> SingleSource/Benchmarks/Shootout-C++/fibo -16.67% 0.1800 0.1500 0.0094 -11.76% 0.0094
>> MultiSource/Benchmarks/FreeBench/pifft/pifft -4.17% 0.7200 0.6900 0.0082 -2.82% 0.0082
>> Performance Improvements - Execution Time Δ Previous Current σ Δ (B) σ (B)
>> MultiSource/Benchmarks/Olden/health/health -17.24% 0.2900 0.2400 0.0141 -17.24% 0.0141
>> Existing Failures - Execution Time
>> MultiSource/Applications/Burg/burg
>> MultiSource/Applications/ClamAV/clamscan
>> MultiSource/Applications/lemon/lemon
>> MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
>> MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
>> MultiSource/Benchmarks/Olden/voronoi/voronoi
>> MultiSource/Benchmarks/Ptrdist/anagram/anagram
>> SingleSource/Benchmarks/BenchmarkGame/puzzle
>>
>> Run-Over-Baseline Changes Detail
>>
>> Performance Regressions - Compile Time Δ(B) Baseline Current σ(B) Δ σ
>> MultiSource/Benchmarks/Prolangs-C/allroots/allroots 100.00% 0.0300 0.0600 0.0047 20.00% 0.0047
>> SingleSource/Benchmarks/Shootout/hash 100.00% 0.0200 0.0400 0.0047 33.33% 0.0047
>> SingleSource/Regression/C/2003-05-22-VarSizeArray 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>> SingleSource/Regression/C/DuffsDevice 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>> SingleSource/UnitTests/2002-12-13-MishaTest 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>> SingleSource/UnitTests/2003-05-14-AtExit 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>> SingleSource/UnitTests/ms_struct-bitfield-init 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>> SingleSource/UnitTests/ms_struct_pack_layout 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler 52.94% 0.1700 0.2600 0.0170 8.33% 0.0170
>> MultiSource/Benchmarks/MiBench/network-patricia/network-patricia 33.33% 0.0600 0.0800 0.0047 33.33% 0.0047
>> MultiSource/Benchmarks/Olden/mst/mst 33.33% 0.0600 0.0800 0.0047 60.00% 0.0047
>> MultiSource/Benchmarks/Fhourstones/fhourstones 25.00% 0.0800 0.1000 0.0000 11.11% 0.0000
>> MultiSource/Benchmarks/Olden/power/power 25.00% 0.0800 0.1000 0.0000 42.86% 0.0000
>> SingleSource/Benchmarks/McGill/exptree 16.67% 0.0600 0.0700 0.0000 40.00% 0.0000
>> SingleSource/Regression/C++/ofstream_ctor 12.50% 0.1600 0.1800 0.0047 0.00% 0.0047
>> MultiSource/Applications/spiff/spiff 12.28% 0.5700 0.6400 0.0216 3.23% 0.0216
>> MultiSource/Applications/lambda-0_1_3/lambda 10.64% 0.4700 0.5200 0.0170 0.00% 0.0170
>> MultiSource/Benchmarks/Olden/em3d/em3d 7.69% 0.1300 0.1400 0.0000 40.00% 0.0000
>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep 7.37% 0.9500 1.0200 0.0082 4.08% 0.0082
>> MultiSource/Applications/hexxagon/hexxagon 6.41% 0.7800 0.8300 0.0094 -2.35% 0.0094
>> MultiSource/Applications/hbd/hbd 1.85% 1.0800 1.1000 0.0047 4.76% 0.0047
>> MultiSource/Applications/ClamAV/clamscan 1.10% 11.7700 11.9000 0.0419 0.59% 0.0419
>> Performance Regressions - Execution Time Δ(B) Baseline Current σ(B) Δ σ
>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael 33.33% 0.0300 0.0400 0.0000 33.33% 0.0000
>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 29.17% 0.7200 0.9300 0.0047 0.00% 0.0047
>> SingleSource/Benchmarks/Adobe-C++/loop_unroll 19.42% 1.3900 1.6600 0.0094 -0.60% 0.0094
>> MultiSource/Benchmarks/McCat/18-imp/imp 16.67% 0.0600 0.0700 0.0000 16.67% 0.0000
>> MultiSource/Benchmarks/MiBench/network-patricia/network-patricia 11.11% 0.0900 0.1000 0.0000 0.00% 0.0000
>> SingleSource/UnitTests/Vector/SSE/sse_stepfft 7.50% 0.4000 0.4300 0.0000 0.00% 0.0000
>> MultiSource/Benchmarks/BitBench/drop3/drop3 3.23% 0.3100 0.3200 0.0000 0.00% 0.0000
>> MultiSource/Applications/lambda-0_1_3/lambda 1.48% 4.0500 4.1100 0.0082 -0.24% 0.0082
>> Performance Improvements - Compile Time Δ(B) Baseline Current σ(B) Δ σ
>> SingleSource/Regression/C++/BuiltinTypeInfo -100.00% 0.0200 0.0000 0.0047 -100.00% 0.0047
>> SingleSource/Regression/C++/pointer_member -100.00% 0.0200 0.0000 0.0047 -100.00% 0.0047
>> SingleSource/UnitTests/2002-05-19-DivTest -100.00% 0.0200 0.0000 0.0047 0.00% 0.0047
>> SingleSource/Benchmarks/Misc/mandel -60.00% 0.0500 0.0200 0.0082 -33.33% 0.0082
>> MultiSource/Benchmarks/Prolangs-C++/NP/np -50.00% 0.0200 0.0100 0.0000 0.00% 0.0000
>> SingleSource/Benchmarks/BenchmarkGame/Large/fasta -50.00% 0.0400 0.0200 0.0047 -33.33% 0.0047
>> SingleSource/Benchmarks/BenchmarkGame/spectral-norm -50.00% 0.0600 0.0300 0.0082 -25.00% 0.0082
>> SingleSource/Benchmarks/Shootout/heapsort -50.00% 0.0400 0.0200 0.0047 -33.33% 0.0047
>> MultiSource/Benchmarks/FreeBench/mason/mason -42.86% 0.0700 0.0400 0.0082 0.00% 0.0082
>> MultiSource/Benchmarks/FreeBench/distray/distray -37.50% 0.0800 0.0500 0.0082 -28.57% 0.0082
>> MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 -25.00% 0.0400 0.0300 0.0000 50.00% 0.0000
>> SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls -25.00% 0.0400 0.0300 0.0000 0.00% 0.0000
>> SingleSource/UnitTests/Vector/SSE/sse_isamax -25.00% 0.0800 0.0600 0.0047 50.00% 0.0047
>> SingleSource/Benchmarks/CoyoteBench/lpbench -20.00% 0.1000 0.0800 0.0047 14.29% 0.0047
>> SingleSource/Benchmarks/Shootout-C++/lists -17.39% 0.2300 0.1900 0.0094 -9.52% 0.0094
>> SingleSource/Benchmarks/McGill/chomp -15.38% 0.1300 0.1100 0.0047 -8.33% 0.0047
>> SingleSource/Benchmarks/Misc/ReedSolomon -12.50% 0.1600 0.1400 0.0047 -6.67% 0.0047
>> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk -12.20% 0.4100 0.3600 0.0170 -10.00% 0.0170
>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac -12.07% 0.5800 0.5100 0.0141 -1.92% 0.0141
>> MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url -11.11% 0.1800 0.1600 0.0000 6.67% 0.0000
>> SingleSource/Benchmarks/Shootout-C++/matrix -9.52% 0.2100 0.1900 0.0047 0.00% 0.0047
>> SingleSource/Benchmarks/Shootout-C++/wc -9.52% 0.2100 0.1900 0.0000 5.56% 0.0000
>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael -9.09% 0.5500 0.5000 0.0125 4.17% 0.0125
>> MultiSource/Benchmarks/McCat/05-eks/eks -7.50% 0.4000 0.3700 0.0047 0.00% 0.0047
>> MultiSource/Benchmarks/Prolangs-C/bison/mybison -6.73% 1.0400 0.9700 0.0216 0.00% 0.0216
>> MultiSource/Applications/SIBsim4/SIBsim4 -6.67% 1.0500 0.9800 0.0189 -2.97% 0.0189
>> SingleSource/Benchmarks/Adobe-C++/loop_unroll -5.28% 2.6500 2.5100 0.0125 -0.40% 0.0125
>> SingleSource/Benchmarks/Shootout-C++/except -5.26% 0.1900 0.1800 0.0000 12.50% 0.0000
>> MultiSource/Applications/oggenc/oggenc -5.24% 4.0100 3.8000 0.0205 -1.04% 0.0205
>> MultiSource/Benchmarks/MallocBench/gs/gs -3.41% 3.2300 3.1200 0.0340 0.65% 0.0340
>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell -3.15% 1.2700 1.2300 0.0000 4.24% 0.0000
>> SingleSource/Benchmarks/Misc-C++/stepanov_container -2.94% 0.6800 0.6600 0.0047 1.54% 0.0047
>> Performance Improvements - Execution Time Δ(B) Baseline Current σ(B) Δ σ
>> MultiSource/Applications/JM/ldecod/ldecod -57.14% 0.0700 0.0300 0.0094 -25.00% 0.0094
>> MultiSource/Benchmarks/Prolangs-C++/ocean/ocean -57.14% 0.0700 0.0300 0.0125 -25.00% 0.0125
>> SingleSource/Benchmarks/Misc-C++/bigfib -17.65% 0.3400 0.2800 0.0163 -3.45% 0.0163
>> MultiSource/Benchmarks/Olden/health/health -17.24% 0.2900 0.2400 0.0141 -17.24% 0.0141
>> MultiSource/Benchmarks/Olden/treeadd/treeadd -14.29% 0.2100 0.1800 0.0000 0.00% 0.0000
>> SingleSource/Benchmarks/Misc-C++/Large/ray -6.52% 3.2200 3.0100 0.0047 -0.33% 0.0047
>> SingleSource/Benchmarks/Shootout-C++/methcall -6.00% 5.0000 4.7000 0.0497 0.00% 0.0497
>> MultiSource/Benchmarks/Prolangs-C++/life/life -4.39% 1.1400 1.0900 0.0082 0.00% 0.0082
>> MultiSource/Applications/spiff/spiff -4.30% 1.8600 1.7800 0.0170 3.49% 0.0170
>> SingleSource/Benchmarks/Shootout-C++/objinst -3.82% 4.9700 4.7800 0.0000 0.21% 0.0000
>> MultiSource/Applications/obsequi/Obsequi -2.94% 1.7000 1.6500 0.0189 0.00% 0.0189
>> SingleSource/Benchmarks/Misc-C++-EH/spirit -2.67% 4.1200 4.0100 0.0236 0.00% 0.0236
>> MultiSource/Applications/SIBsim4/SIBsim4 -2.14% 3.7300 3.6500 0.0141 0.83% 0.0141
>> SingleSource/Benchmarks/Adobe-C++/functionobjects -1.98% 3.5400 3.4700 0.0125 -0.29% 0.0125
>> SingleSource/Benchmarks/McGill/chomp -1.85% 1.6200 1.5900 0.0082 0.63% 0.0082
>> SingleSource/Benchmarks/Misc/salsa20 -1.78% 7.8800 7.7400 0.0047 0.00% 0.0047
>> SingleSource/Benchmarks/Misc/pi -1.67% 0.6000 0.5900 0.0000 0.00% 0.0000
>> SingleSource/Benchmarks/BenchmarkGame/recursive -1.09% 0.9200 0.9100 0.0000 0.00% 0.0000
>> Existing Failures - Execution Time
>> MultiSource/Applications/Burg/burg
>> MultiSource/Applications/ClamAV/clamscan
>> MultiSource/Applications/lemon/lemon
>> MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
>> MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
>> MultiSource/Benchmarks/Olden/voronoi/voronoi
>> MultiSource/Benchmarks/Ptrdist/anagram/anagram
>> SingleSource/Benchmarks/BenchmarkGame/puzzle
>> Report Time: 0.86s
>> _______________________________________________
>> llvm-testresults mailing list
>> llvm-testresults at cs.uiuc.edu
>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>
>
> _______________________________________________
> llvm-testresults mailing list
> llvm-testresults at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
More information about the llvm-testresults
mailing list