[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Wed Apr 4 15:40:15 PDT 2012
http://llvm.org/perf/db_default/v4/nts/98?compare_to=96&baseline=4
Nickname: llvmsuitebot1__clang_DEV__x86_64:2
Comparing:
Run: 98, Order: 154054, Start Time: 2012-04-04 21:56:50, End Time: 2012-04-04 22:40:17
To: 96, Order: 154047, Start Time: 2012-04-04 21:03:00, End Time: 2012-04-04 21:46:22
Baseline: 4, Order: 153780, Start Time: 2012-03-30 22:20:19, End Time: 2012-03-30 22:34:44
===============
Tests Summary
===============
Performance Regressions: 51 (30 on baseline)
Performance Improvements: 4 (50 on baseline)
Existing Failures: 8 (8 on baseline)
Unchanged Tests: 825 (800 on baseline)
Total Tests: 888
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 200.00% (0.0100 => 0.0300, std. dev.: 0.0047)
SingleSource/Benchmarks/Stanford/FloatMM: 200.00% (0.0100 => 0.0300, std. dev.: 0.0047)
SingleSource/UnitTests/2003-07-09-SignedArgs: 200.00% (0.0100 => 0.0300, std. dev.: 0.0000)
SingleSource/UnitTests/SignlessTypes/shr: 200.00% (0.0100 => 0.0300, std. dev.: 0.0000)
MultiSource/Benchmarks/Olden/perimeter/perimeter: 100.00% (0.0300 => 0.0600, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout/sieve: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/2003-05-23-TransparentUnion: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/DuffsDevice: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/PR640: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/ms_struct_pack_layout: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/stmtexpr: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
MultiSource/Benchmarks/Olden/mst/mst: 60.00% (0.0500 => 0.0800, std. dev.: 0.0047)
SingleSource/UnitTests/Vector/SSE/sse_isamax: 50.00% (0.0400 => 0.0600, std. dev.: 0.0047)
MultiSource/Benchmarks/Olden/power/power: 42.86% (0.0700 => 0.1000, std. dev.: 0.0000)
MultiSource/Benchmarks/Olden/em3d/em3d: 40.00% (0.1000 => 0.1400, std. dev.: 0.0000)
SingleSource/Benchmarks/McGill/exptree: 40.00% (0.0500 => 0.0700, std. dev.: 0.0000)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 33.33% (0.0600 => 0.0800, std. dev.: 0.0047)
MultiSource/Benchmarks/Olden/tsp/tsp: 28.57% (0.0700 => 0.0900, std. dev.: 0.0000)
SingleSource/UnitTests/Vector/SSE/sse_stepfft: 28.57% (0.0700 => 0.0900, std. dev.: 0.0000)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.75% (0.1600 => 0.1900, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 16.67% (0.1200 => 0.1400, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 15.38% (0.3900 => 0.4500, std. dev.: 0.0125)
SingleSource/Benchmarks/Shootout-C++/hello: 13.33% (0.1500 => 0.1700, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/except: 12.50% (0.1600 => 0.1800, std. dev.: 0.0000)
MultiSource/Benchmarks/Fhourstones/fhourstones: 11.11% (0.0900 => 0.1000, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/moments: 10.71% (0.2800 => 0.3100, std. dev.: 0.0047)
SingleSource/Benchmarks/CoyoteBench/fftbench: 10.34% (0.2900 => 0.3200, std. dev.: 0.0082)
SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.70% (0.2300 => 0.2500, std. dev.: 0.0047)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.67% (0.1500 => 0.1600, std. dev.: 0.0000)
SingleSource/Benchmarks/Misc-C++/bigfib: 6.52% (0.4600 => 0.4900, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/wc: 5.56% (0.1800 => 0.1900, std. dev.: 0.0000)
MultiSource/Applications/obsequi/Obsequi: 5.00% (0.8000 => 0.8400, std. dev.: 0.0125)
MultiSource/Applications/hbd/hbd: 4.76% (1.0500 => 1.1000, std. dev.: 0.0047)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.24% (1.1800 => 1.2300, std. dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.08% (0.9800 => 1.0200, std. dev.: 0.0082)
MultiSource/Applications/lua/lua: 1.64% (3.0500 => 3.1000, std. dev.: 0.0141)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 40.00% (0.0500 => 0.0700, std. dev.: 0.0047)
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.67% (0.0600 => 0.0700, std. dev.: 0.0000)
MultiSource/Benchmarks/McCat/18-imp/imp: 16.67% (0.0600 => 0.0700, std. dev.: 0.0000)
MultiSource/Benchmarks/FreeBench/distray/distray: 7.69% (0.1300 => 0.1400, std. dev.: 0.0000)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.69% (0.1300 => 0.1400, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.67% (0.1500 => 0.1600, std. dev.: 0.0000)
MultiSource/Applications/spiff/spiff: 3.49% (1.7200 => 1.7800, std. dev.: 0.0170)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.13% (0.3200 => 0.3300, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout/hash: 3.06% (3.2700 => 3.3700, std. dev.: 0.0082)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -22.22% (0.1800 => 0.1400, std. dev.: 0.0094)
SingleSource/Benchmarks/Shootout-C++/fibo: -16.67% (0.1800 => 0.1500, std. dev.: 0.0094)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.17% (0.7200 => 0.6900, std. dev.: 0.0082)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Olden/health/health: -17.24% (0.2900 => 0.2400, std. dev.: 0.0141)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 100.00% (0.0300 => 0.0600, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout/hash: 100.00% (0.0200 => 0.0400, std. dev.: 0.0047)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/DuffsDevice: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/ms_struct_pack_layout: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 52.94% (0.1700 => 0.2600, std. dev.: 0.0170)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 33.33% (0.0600 => 0.0800, std. dev.: 0.0047)
MultiSource/Benchmarks/Olden/mst/mst: 33.33% (0.0600 => 0.0800, std. dev.: 0.0047)
MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0800 => 0.1000, std. dev.: 0.0000)
MultiSource/Benchmarks/Olden/power/power: 25.00% (0.0800 => 0.1000, std. dev.: 0.0000)
SingleSource/Benchmarks/McGill/exptree: 16.67% (0.0600 => 0.0700, std. dev.: 0.0000)
SingleSource/Regression/C++/ofstream_ctor: 12.50% (0.1600 => 0.1800, std. dev.: 0.0047)
MultiSource/Applications/spiff/spiff: 12.28% (0.5700 => 0.6400, std. dev.: 0.0216)
MultiSource/Applications/lambda-0_1_3/lambda: 10.64% (0.4700 => 0.5200, std. dev.: 0.0170)
MultiSource/Benchmarks/Olden/em3d/em3d: 7.69% (0.1300 => 0.1400, std. dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.37% (0.9500 => 1.0200, std. dev.: 0.0082)
MultiSource/Applications/hexxagon/hexxagon: 6.41% (0.7800 => 0.8300, std. dev.: 0.0094)
MultiSource/Applications/hbd/hbd: 1.85% (1.0800 => 1.1000, std. dev.: 0.0047)
MultiSource/Applications/ClamAV/clamscan: 1.10% (11.7700 => 11.9000, std. dev.: 0.0419)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 29.17% (0.7200 => 0.9300, std. dev.: 0.0047)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.42% (1.3900 => 1.6600, std. dev.: 0.0094)
MultiSource/Benchmarks/McCat/18-imp/imp: 16.67% (0.0600 => 0.0700, std. dev.: 0.0000)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 11.11% (0.0900 => 0.1000, std. dev.: 0.0000)
SingleSource/UnitTests/Vector/SSE/sse_stepfft: 7.50% (0.4000 => 0.4300, std. dev.: 0.0000)
MultiSource/Benchmarks/BitBench/drop3/drop3: 3.23% (0.3100 => 0.3200, std. dev.: 0.0000)
MultiSource/Applications/lambda-0_1_3/lambda: 1.48% (4.0500 => 4.1100, std. dev.: 0.0082)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C++/BuiltinTypeInfo: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/Regression/C++/pointer_member: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/UnitTests/2002-05-19-DivTest: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc/mandel: -60.00% (0.0500 => 0.0200, std. dev.: 0.0082)
MultiSource/Benchmarks/Prolangs-C++/NP/np: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -50.00% (0.0400 => 0.0200, std. dev.: 0.0047)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -50.00% (0.0600 => 0.0300, std. dev.: 0.0082)
SingleSource/Benchmarks/Shootout/heapsort: -50.00% (0.0400 => 0.0200, std. dev.: 0.0047)
MultiSource/Benchmarks/FreeBench/mason/mason: -42.86% (0.0700 => 0.0400, std. dev.: 0.0082)
MultiSource/Benchmarks/FreeBench/distray/distray: -37.50% (0.0800 => 0.0500, std. dev.: 0.0082)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -25.00% (0.0400 => 0.0300, std. dev.: 0.0000)
SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: -25.00% (0.0400 => 0.0300, std. dev.: 0.0000)
SingleSource/UnitTests/Vector/SSE/sse_isamax: -25.00% (0.0800 => 0.0600, std. dev.: 0.0047)
SingleSource/Benchmarks/CoyoteBench/lpbench: -20.00% (0.1000 => 0.0800, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/lists: -17.39% (0.2300 => 0.1900, std. dev.: 0.0094)
SingleSource/Benchmarks/McGill/chomp: -15.38% (0.1300 => 0.1100, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc/ReedSolomon: -12.50% (0.1600 => 0.1400, std. dev.: 0.0047)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.20% (0.4100 => 0.3600, std. dev.: 0.0170)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -12.07% (0.5800 => 0.5100, std. dev.: 0.0141)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -11.11% (0.1800 => 0.1600, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/matrix: -9.52% (0.2100 => 0.1900, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/wc: -9.52% (0.2100 => 0.1900, std. dev.: 0.0000)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.09% (0.5500 => 0.5000, std. dev.: 0.0125)
MultiSource/Benchmarks/McCat/05-eks/eks: -7.50% (0.4000 => 0.3700, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.73% (1.0400 => 0.9700, std. dev.: 0.0216)
MultiSource/Applications/SIBsim4/SIBsim4: -6.67% (1.0500 => 0.9800, std. dev.: 0.0189)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.28% (2.6500 => 2.5100, std. dev.: 0.0125)
SingleSource/Benchmarks/Shootout-C++/except: -5.26% (0.1900 => 0.1800, std. dev.: 0.0000)
MultiSource/Applications/oggenc/oggenc: -5.24% (4.0100 => 3.8000, std. dev.: 0.0205)
MultiSource/Benchmarks/MallocBench/gs/gs: -3.41% (3.2300 => 3.1200, std. dev.: 0.0340)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -3.15% (1.2700 => 1.2300, std. dev.: 0.0000)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.94% (0.6800 => 0.6600, std. dev.: 0.0047)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Applications/JM/ldecod/ldecod: -57.14% (0.0700 => 0.0300, std. dev.: 0.0094)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -57.14% (0.0700 => 0.0300, std. dev.: 0.0125)
SingleSource/Benchmarks/Misc-C++/bigfib: -17.65% (0.3400 => 0.2800, std. dev.: 0.0163)
MultiSource/Benchmarks/Olden/health/health: -17.24% (0.2900 => 0.2400, std. dev.: 0.0141)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -14.29% (0.2100 => 0.1800, std. dev.: 0.0000)
SingleSource/Benchmarks/Misc-C++/Large/ray: -6.52% (3.2200 => 3.0100, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/methcall: -6.00% (5.0000 => 4.7000, std. dev.: 0.0497)
MultiSource/Benchmarks/Prolangs-C++/life/life: -4.39% (1.1400 => 1.0900, std. dev.: 0.0082)
MultiSource/Applications/spiff/spiff: -4.30% (1.8600 => 1.7800, std. dev.: 0.0170)
SingleSource/Benchmarks/Shootout-C++/objinst: -3.82% (4.9700 => 4.7800, std. dev.: 0.0000)
MultiSource/Applications/obsequi/Obsequi: -2.94% (1.7000 => 1.6500, std. dev.: 0.0189)
SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.67% (4.1200 => 4.0100, std. dev.: 0.0236)
MultiSource/Applications/SIBsim4/SIBsim4: -2.14% (3.7300 => 3.6500, std. dev.: 0.0141)
SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.98% (3.5400 => 3.4700, std. dev.: 0.0125)
SingleSource/Benchmarks/McGill/chomp: -1.85% (1.6200 => 1.5900, std. dev.: 0.0082)
SingleSource/Benchmarks/Misc/salsa20: -1.78% (7.8800 => 7.7400, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc/pi: -1.67% (0.6000 => 0.5900, std. dev.: 0.0000)
SingleSource/Benchmarks/BenchmarkGame/recursive: -1.09% (0.9200 => 0.9100, std. dev.: 0.0000)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
Report Time: 0.86s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120404/0c3aa787/attachment.html>
More information about the llvm-testresults
mailing list