[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results
Daniel Dunbar
daniel at zuster.org
Thu Apr 5 11:49:53 PDT 2012
Some new LNT features would probably be nice:
1. By default, it probably doesn't make sense for all submitted runs
to generate an email to this list:
Filed:
http://llvm.org/PR12466
2. It would be good for LNT to include more information on who owns
the machine. It might even be good to require machines to be defined
before we start accepting submissions.
Filed:
http://llvm.org/PR12467
- Daniel
On Wed, Apr 4, 2012 at 5:43 PM, Chad Rosier <mcrosier at apple.com> wrote:
> On Apr 4, 2012, at 5:29 PM, Eric Christopher wrote:
>
>> I don't know who owns this bot but it is both useless and verbose.
>
> +1
>
> Chad
>
>
>> -eric
>>
>> On Apr 4, 2012, at 3:40 PM, llvm-testresults at cs.uiuc.edu wrote:
>>
>>> llvmsuitebot1__clang_DEV__x86_64 test results
>>>
>>> Run Order Start Time Duration
>>> Current 154054 2012-04-04 21:56:50 0:43:27
>>> Previous 154047 2012-04-04 21:03:00 0:43:22
>>> Baseline 153780 2012-03-30 22:20:19 0:14:25
>>> Tests Summary
>>>
>>> Status Group # # (B)
>>> Performance Regressions 51 30
>>> Performance Improvements 4 50
>>> Existing Failures 8 8
>>> Unchanged Tests 825 800
>>> Total Tests 888 888
>>>
>>> Run-Over-Run Changes Detail
>>>
>>> Performance Regressions - Compile Time Δ Previous Current σ Δ (B) σ (B)
>>> MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra 200.00% 0.0100 0.0300 0.0047 -25.00% 0.0047
>>> SingleSource/Benchmarks/Stanford/FloatMM 200.00% 0.0100 0.0300 0.0047 -25.00% 0.0047
>>> SingleSource/UnitTests/2003-07-09-SignedArgs 200.00% 0.0100 0.0300 0.0000 0.00% 0.0000
>>> SingleSource/UnitTests/SignlessTypes/shr 200.00% 0.0100 0.0300 0.0000 0.00% 0.0000
>>> MultiSource/Benchmarks/Olden/perimeter/perimeter 100.00% 0.0300 0.0600 0.0047 20.00% 0.0047
>>> SingleSource/Benchmarks/Shootout/sieve 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>>> SingleSource/Regression/C++/EH/ConditionalExpr 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>>> SingleSource/Regression/C/2003-05-21-UnionTest 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>>> SingleSource/Regression/C/2003-05-22-VarSizeArray 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>>> SingleSource/Regression/C/2003-05-23-TransparentUnion 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>>> SingleSource/Regression/C/DuffsDevice 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>>> SingleSource/Regression/C/PR640 100.00% 0.0100 0.0200 0.0000 -33.33% 0.0000
>>> SingleSource/UnitTests/2002-12-13-MishaTest 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>>> SingleSource/UnitTests/ms_struct_pack_layout 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>>> SingleSource/UnitTests/stmtexpr 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>>> MultiSource/Benchmarks/Olden/mst/mst 60.00% 0.0500 0.0800 0.0047 33.33% 0.0047
>>> SingleSource/UnitTests/Vector/SSE/sse_isamax 50.00% 0.0400 0.0600 0.0047 -25.00% 0.0047
>>> MultiSource/Benchmarks/Olden/power/power 42.86% 0.0700 0.1000 0.0000 25.00% 0.0000
>>> MultiSource/Benchmarks/Olden/em3d/em3d 40.00% 0.1000 0.1400 0.0000 7.69% 0.0000
>>> SingleSource/Benchmarks/McGill/exptree 40.00% 0.0500 0.0700 0.0000 16.67% 0.0000
>>> MultiSource/Benchmarks/MiBench/network-patricia/network-patricia 33.33% 0.0600 0.0800 0.0047 33.33% 0.0047
>>> MultiSource/Benchmarks/Olden/tsp/tsp 28.57% 0.0700 0.0900 0.0000 0.00% 0.0000
>>> SingleSource/UnitTests/Vector/SSE/sse_stepfft 28.57% 0.0700 0.0900 0.0000 0.00% 0.0000
>>> MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount 18.75% 0.1600 0.1900 0.0047 5.56% 0.0047
>>> SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 16.67% 0.1200 0.1400 0.0047 7.69% 0.0047
>>> MultiSource/Benchmarks/Prolangs-C/archie-client/archie 15.38% 0.3900 0.4500 0.0125 0.00% 0.0125
>>> SingleSource/Benchmarks/Shootout-C++/hello 13.33% 0.1500 0.1700 0.0047 6.25% 0.0047
>>> SingleSource/Benchmarks/Shootout-C++/except 12.50% 0.1600 0.1800 0.0000 -5.26% 0.0000
>>> MultiSource/Benchmarks/Fhourstones/fhourstones 11.11% 0.0900 0.1000 0.0000 25.00% 0.0000
>>> SingleSource/Benchmarks/Shootout-C++/moments 10.71% 0.2800 0.3100 0.0047 3.33% 0.0047
>>> SingleSource/Benchmarks/CoyoteBench/fftbench 10.34% 0.2900 0.3200 0.0082 6.67% 0.0082
>>> SingleSource/Benchmarks/Shootout-C++/wordfreq 8.70% 0.2300 0.2500 0.0047 -3.85% 0.0047
>>> MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url 6.67% 0.1500 0.1600 0.0000 -11.11% 0.0000
>>> SingleSource/Benchmarks/Misc-C++/bigfib 6.52% 0.4600 0.4900 0.0047 -2.00% 0.0047
>>> SingleSource/Benchmarks/Shootout-C++/wc 5.56% 0.1800 0.1900 0.0000 -9.52% 0.0000
>>> MultiSource/Applications/obsequi/Obsequi 5.00% 0.8000 0.8400 0.0125 -3.45% 0.0125
>>> MultiSource/Applications/hbd/hbd 4.76% 1.0500 1.1000 0.0047 1.85% 0.0047
>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell 4.24% 1.1800 1.2300 0.0000 -3.15% 0.0000
>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep 4.08% 0.9800 1.0200 0.0082 7.37% 0.0082
>>> MultiSource/Applications/lua/lua 1.64% 3.0500 3.1000 0.0141 0.32% 0.0141
>>> Performance Regressions - Execution Time Δ Previous Current σ Δ (B) σ (B)
>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail 40.00% 0.0500 0.0700 0.0047 0.00% 0.0047
>>> MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra 33.33% 0.0300 0.0400 0.0000 0.00% 0.0000
>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael 33.33% 0.0300 0.0400 0.0000 33.33% 0.0000
>>> MultiSource/Benchmarks/FreeBench/analyzer/analyzer 16.67% 0.0600 0.0700 0.0000 0.00% 0.0000
>>> MultiSource/Benchmarks/McCat/18-imp/imp 16.67% 0.0600 0.0700 0.0000 16.67% 0.0000
>>> MultiSource/Benchmarks/FreeBench/distray/distray 7.69% 0.1300 0.1400 0.0000 0.00% 0.0000
>>> MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 7.69% 0.1300 0.1400 0.0000 0.00% 0.0000
>>> SingleSource/Benchmarks/Shootout-C++/nestedloop 6.67% 0.1500 0.1600 0.0000 0.00% 0.0000
>>> MultiSource/Applications/spiff/spiff 3.49% 1.7200 1.7800 0.0170 -4.30% 0.0170
>>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow 3.13% 0.3200 0.3300 0.0000 0.00% 0.0000
>>> SingleSource/Benchmarks/Shootout/hash 3.06% 3.2700 3.3700 0.0082 -0.59% 0.0082
>>> Performance Improvements - Compile Time Δ Previous Current σ Δ (B) σ (B)
>>> MultiSource/Benchmarks/FreeBench/analyzer/analyzer -22.22% 0.1800 0.1400 0.0094 -12.50% 0.0094
>>> SingleSource/Benchmarks/Shootout-C++/fibo -16.67% 0.1800 0.1500 0.0094 -11.76% 0.0094
>>> MultiSource/Benchmarks/FreeBench/pifft/pifft -4.17% 0.7200 0.6900 0.0082 -2.82% 0.0082
>>> Performance Improvements - Execution Time Δ Previous Current σ Δ (B) σ (B)
>>> MultiSource/Benchmarks/Olden/health/health -17.24% 0.2900 0.2400 0.0141 -17.24% 0.0141
>>> Existing Failures - Execution Time
>>> MultiSource/Applications/Burg/burg
>>> MultiSource/Applications/ClamAV/clamscan
>>> MultiSource/Applications/lemon/lemon
>>> MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
>>> MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
>>> MultiSource/Benchmarks/Olden/voronoi/voronoi
>>> MultiSource/Benchmarks/Ptrdist/anagram/anagram
>>> SingleSource/Benchmarks/BenchmarkGame/puzzle
>>>
>>> Run-Over-Baseline Changes Detail
>>>
>>> Performance Regressions - Compile Time Δ(B) Baseline Current σ(B) Δ σ
>>> MultiSource/Benchmarks/Prolangs-C/allroots/allroots 100.00% 0.0300 0.0600 0.0047 20.00% 0.0047
>>> SingleSource/Benchmarks/Shootout/hash 100.00% 0.0200 0.0400 0.0047 33.33% 0.0047
>>> SingleSource/Regression/C/2003-05-22-VarSizeArray 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>>> SingleSource/Regression/C/DuffsDevice 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>>> SingleSource/UnitTests/2002-12-13-MishaTest 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>>> SingleSource/UnitTests/2003-05-14-AtExit 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>>> SingleSource/UnitTests/ms_struct-bitfield-init 100.00% 0.0100 0.0200 0.0000 0.00% 0.0000
>>> SingleSource/UnitTests/ms_struct_pack_layout 100.00% 0.0100 0.0200 0.0000 100.00% 0.0000
>>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler 52.94% 0.1700 0.2600 0.0170 8.33% 0.0170
>>> MultiSource/Benchmarks/MiBench/network-patricia/network-patricia 33.33% 0.0600 0.0800 0.0047 33.33% 0.0047
>>> MultiSource/Benchmarks/Olden/mst/mst 33.33% 0.0600 0.0800 0.0047 60.00% 0.0047
>>> MultiSource/Benchmarks/Fhourstones/fhourstones 25.00% 0.0800 0.1000 0.0000 11.11% 0.0000
>>> MultiSource/Benchmarks/Olden/power/power 25.00% 0.0800 0.1000 0.0000 42.86% 0.0000
>>> SingleSource/Benchmarks/McGill/exptree 16.67% 0.0600 0.0700 0.0000 40.00% 0.0000
>>> SingleSource/Regression/C++/ofstream_ctor 12.50% 0.1600 0.1800 0.0047 0.00% 0.0047
>>> MultiSource/Applications/spiff/spiff 12.28% 0.5700 0.6400 0.0216 3.23% 0.0216
>>> MultiSource/Applications/lambda-0_1_3/lambda 10.64% 0.4700 0.5200 0.0170 0.00% 0.0170
>>> MultiSource/Benchmarks/Olden/em3d/em3d 7.69% 0.1300 0.1400 0.0000 40.00% 0.0000
>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep 7.37% 0.9500 1.0200 0.0082 4.08% 0.0082
>>> MultiSource/Applications/hexxagon/hexxagon 6.41% 0.7800 0.8300 0.0094 -2.35% 0.0094
>>> MultiSource/Applications/hbd/hbd 1.85% 1.0800 1.1000 0.0047 4.76% 0.0047
>>> MultiSource/Applications/ClamAV/clamscan 1.10% 11.7700 11.9000 0.0419 0.59% 0.0419
>>> Performance Regressions - Execution Time Δ(B) Baseline Current σ(B) Δ σ
>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael 33.33% 0.0300 0.0400 0.0000 33.33% 0.0000
>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 29.17% 0.7200 0.9300 0.0047 0.00% 0.0047
>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll 19.42% 1.3900 1.6600 0.0094 -0.60% 0.0094
>>> MultiSource/Benchmarks/McCat/18-imp/imp 16.67% 0.0600 0.0700 0.0000 16.67% 0.0000
>>> MultiSource/Benchmarks/MiBench/network-patricia/network-patricia 11.11% 0.0900 0.1000 0.0000 0.00% 0.0000
>>> SingleSource/UnitTests/Vector/SSE/sse_stepfft 7.50% 0.4000 0.4300 0.0000 0.00% 0.0000
>>> MultiSource/Benchmarks/BitBench/drop3/drop3 3.23% 0.3100 0.3200 0.0000 0.00% 0.0000
>>> MultiSource/Applications/lambda-0_1_3/lambda 1.48% 4.0500 4.1100 0.0082 -0.24% 0.0082
>>> Performance Improvements - Compile Time Δ(B) Baseline Current σ(B) Δ σ
>>> SingleSource/Regression/C++/BuiltinTypeInfo -100.00% 0.0200 0.0000 0.0047 -100.00% 0.0047
>>> SingleSource/Regression/C++/pointer_member -100.00% 0.0200 0.0000 0.0047 -100.00% 0.0047
>>> SingleSource/UnitTests/2002-05-19-DivTest -100.00% 0.0200 0.0000 0.0047 0.00% 0.0047
>>> SingleSource/Benchmarks/Misc/mandel -60.00% 0.0500 0.0200 0.0082 -33.33% 0.0082
>>> MultiSource/Benchmarks/Prolangs-C++/NP/np -50.00% 0.0200 0.0100 0.0000 0.00% 0.0000
>>> SingleSource/Benchmarks/BenchmarkGame/Large/fasta -50.00% 0.0400 0.0200 0.0047 -33.33% 0.0047
>>> SingleSource/Benchmarks/BenchmarkGame/spectral-norm -50.00% 0.0600 0.0300 0.0082 -25.00% 0.0082
>>> SingleSource/Benchmarks/Shootout/heapsort -50.00% 0.0400 0.0200 0.0047 -33.33% 0.0047
>>> MultiSource/Benchmarks/FreeBench/mason/mason -42.86% 0.0700 0.0400 0.0082 0.00% 0.0082
>>> MultiSource/Benchmarks/FreeBench/distray/distray -37.50% 0.0800 0.0500 0.0082 -28.57% 0.0082
>>> MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 -25.00% 0.0400 0.0300 0.0000 50.00% 0.0000
>>> SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls -25.00% 0.0400 0.0300 0.0000 0.00% 0.0000
>>> SingleSource/UnitTests/Vector/SSE/sse_isamax -25.00% 0.0800 0.0600 0.0047 50.00% 0.0047
>>> SingleSource/Benchmarks/CoyoteBench/lpbench -20.00% 0.1000 0.0800 0.0047 14.29% 0.0047
>>> SingleSource/Benchmarks/Shootout-C++/lists -17.39% 0.2300 0.1900 0.0094 -9.52% 0.0094
>>> SingleSource/Benchmarks/McGill/chomp -15.38% 0.1300 0.1100 0.0047 -8.33% 0.0047
>>> SingleSource/Benchmarks/Misc/ReedSolomon -12.50% 0.1600 0.1400 0.0047 -6.67% 0.0047
>>> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk -12.20% 0.4100 0.3600 0.0170 -10.00% 0.0170
>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac -12.07% 0.5800 0.5100 0.0141 -1.92% 0.0141
>>> MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url -11.11% 0.1800 0.1600 0.0000 6.67% 0.0000
>>> SingleSource/Benchmarks/Shootout-C++/matrix -9.52% 0.2100 0.1900 0.0047 0.00% 0.0047
>>> SingleSource/Benchmarks/Shootout-C++/wc -9.52% 0.2100 0.1900 0.0000 5.56% 0.0000
>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael -9.09% 0.5500 0.5000 0.0125 4.17% 0.0125
>>> MultiSource/Benchmarks/McCat/05-eks/eks -7.50% 0.4000 0.3700 0.0047 0.00% 0.0047
>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison -6.73% 1.0400 0.9700 0.0216 0.00% 0.0216
>>> MultiSource/Applications/SIBsim4/SIBsim4 -6.67% 1.0500 0.9800 0.0189 -2.97% 0.0189
>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll -5.28% 2.6500 2.5100 0.0125 -0.40% 0.0125
>>> SingleSource/Benchmarks/Shootout-C++/except -5.26% 0.1900 0.1800 0.0000 12.50% 0.0000
>>> MultiSource/Applications/oggenc/oggenc -5.24% 4.0100 3.8000 0.0205 -1.04% 0.0205
>>> MultiSource/Benchmarks/MallocBench/gs/gs -3.41% 3.2300 3.1200 0.0340 0.65% 0.0340
>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell -3.15% 1.2700 1.2300 0.0000 4.24% 0.0000
>>> SingleSource/Benchmarks/Misc-C++/stepanov_container -2.94% 0.6800 0.6600 0.0047 1.54% 0.0047
>>> Performance Improvements - Execution Time Δ(B) Baseline Current σ(B) Δ σ
>>> MultiSource/Applications/JM/ldecod/ldecod -57.14% 0.0700 0.0300 0.0094 -25.00% 0.0094
>>> MultiSource/Benchmarks/Prolangs-C++/ocean/ocean -57.14% 0.0700 0.0300 0.0125 -25.00% 0.0125
>>> SingleSource/Benchmarks/Misc-C++/bigfib -17.65% 0.3400 0.2800 0.0163 -3.45% 0.0163
>>> MultiSource/Benchmarks/Olden/health/health -17.24% 0.2900 0.2400 0.0141 -17.24% 0.0141
>>> MultiSource/Benchmarks/Olden/treeadd/treeadd -14.29% 0.2100 0.1800 0.0000 0.00% 0.0000
>>> SingleSource/Benchmarks/Misc-C++/Large/ray -6.52% 3.2200 3.0100 0.0047 -0.33% 0.0047
>>> SingleSource/Benchmarks/Shootout-C++/methcall -6.00% 5.0000 4.7000 0.0497 0.00% 0.0497
>>> MultiSource/Benchmarks/Prolangs-C++/life/life -4.39% 1.1400 1.0900 0.0082 0.00% 0.0082
>>> MultiSource/Applications/spiff/spiff -4.30% 1.8600 1.7800 0.0170 3.49% 0.0170
>>> SingleSource/Benchmarks/Shootout-C++/objinst -3.82% 4.9700 4.7800 0.0000 0.21% 0.0000
>>> MultiSource/Applications/obsequi/Obsequi -2.94% 1.7000 1.6500 0.0189 0.00% 0.0189
>>> SingleSource/Benchmarks/Misc-C++-EH/spirit -2.67% 4.1200 4.0100 0.0236 0.00% 0.0236
>>> MultiSource/Applications/SIBsim4/SIBsim4 -2.14% 3.7300 3.6500 0.0141 0.83% 0.0141
>>> SingleSource/Benchmarks/Adobe-C++/functionobjects -1.98% 3.5400 3.4700 0.0125 -0.29% 0.0125
>>> SingleSource/Benchmarks/McGill/chomp -1.85% 1.6200 1.5900 0.0082 0.63% 0.0082
>>> SingleSource/Benchmarks/Misc/salsa20 -1.78% 7.8800 7.7400 0.0047 0.00% 0.0047
>>> SingleSource/Benchmarks/Misc/pi -1.67% 0.6000 0.5900 0.0000 0.00% 0.0000
>>> SingleSource/Benchmarks/BenchmarkGame/recursive -1.09% 0.9200 0.9100 0.0000 0.00% 0.0000
>>> Existing Failures - Execution Time
>>> MultiSource/Applications/Burg/burg
>>> MultiSource/Applications/ClamAV/clamscan
>>> MultiSource/Applications/lemon/lemon
>>> MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
>>> MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
>>> MultiSource/Benchmarks/Olden/voronoi/voronoi
>>> MultiSource/Benchmarks/Ptrdist/anagram/anagram
>>> SingleSource/Benchmarks/BenchmarkGame/puzzle
>>> Report Time: 0.86s
>>> _______________________________________________
>>> llvm-testresults mailing list
>>> llvm-testresults at cs.uiuc.edu
>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>>
>>
>> _______________________________________________
>> llvm-testresults mailing list
>> llvm-testresults at cs.uiuc.edu
>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>
>
> _______________________________________________
> llvm-testresults mailing list
> llvm-testresults at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
More information about the llvm-testresults
mailing list