[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Fri Apr 6 02:12:12 PDT 2012
http://llvm.org/perf/db_default/v4/nts/147?compare_to=145&baseline=4
Nickname: llvmsuitebot1__clang_DEV__x86_64:2
Comparing:
Run: 147, Order: 154166, Start Time: 2012-04-06 08:28:53, End Time: 2012-04-06 09:12:16
To: 145, Order: 154165, Start Time: 2012-04-06 07:34:57, End Time: 2012-04-06 08:18:26
Baseline: 4, Order: 153780, Start Time: 2012-03-30 22:20:19, End Time: 2012-03-30 22:34:44
===============
Tests Summary
===============
Performance Regressions: 46 (28 on baseline)
Performance Improvements: 18 (62 on baseline)
Existing Failures: 8 (8 on baseline)
Unchanged Tests: 816 (790 on baseline)
Total Tests: 888
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/UnitTests/Vector/build2: 200.00% (0.0100 => 0.0300, std. dev.: 0.0000)
SingleSource/UnitTests/Vector/multiplies: 200.00% (0.0100 => 0.0300, std. dev.: 0.0000)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 150.00% (0.0200 => 0.0500, std. dev.: 0.0000)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: 100.00% (0.0200 => 0.0400, std. dev.: 0.0000)
SingleSource/Benchmarks/Misc/flops-1: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Benchmarks/Misc/pi: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/2004-03-15-IndirectGoto: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/DuffsDevice: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/Vector/SSE/sse_shift: 100.00% (0.0200 => 0.0400, std. dev.: 0.0000)
SingleSource/UnitTests/ms_struct_pack_layout: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 75.00% (0.0400 => 0.0700, std. dev.: 0.0047)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 66.67% (0.0300 => 0.0500, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
SingleSource/Benchmarks/Dhrystone/fldry: 25.00% (0.0400 => 0.0500, std. dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.00% (0.2000 => 0.2400, std. dev.: 0.0000)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.75% (0.1600 => 0.1900, std. dev.: 0.0082)
SingleSource/Benchmarks/McGill/chomp: 18.18% (0.1100 => 0.1300, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.04% (0.2300 => 0.2600, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/strcat: 12.50% (0.1600 => 0.1800, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/reversefile: 11.54% (0.2600 => 0.2900, std. dev.: 0.0047)
SingleSource/Benchmarks/CoyoteBench/fftbench: 10.34% (0.2900 => 0.3200, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/moments: 7.14% (0.2800 => 0.3000, std. dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.74% (0.8900 => 0.9500, std. dev.: 0.0141)
MultiSource/Applications/lemon/lemon: 5.13% (0.7800 => 0.8200, std. dev.: 0.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.39% (1.1400 => 1.1900, std. dev.: 0.0082)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (3.4400 => 3.5800, std. dev.: 0.0163)
MultiSource/Applications/SIBsim4/SIBsim4: 4.00% (1.0000 => 1.0400, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.06% (0.9800 => 1.0100, std. dev.: 0.0047)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.03% (5.4300 => 5.5400, std. dev.: 0.0340)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.38% (3.6200 => 3.6700, std. dev.: 0.0094)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (1.6200 => 1.6400, std. dev.: 0.0047)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
MultiSource/Benchmarks/Olden/health/health: 8.33% (0.2400 => 0.2600, std. dev.: 0.0000)
SingleSource/Benchmarks/CoyoteBench/fftbench: 5.48% (0.7300 => 0.7700, std. dev.: 0.0047)
MultiSource/Applications/obsequi/Obsequi: 3.75% (1.6000 => 1.6600, std. dev.: 0.0047)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.38% (0.4200 => 0.4300, std. dev.: 0.0000)
MultiSource/Applications/sqlite3/sqlite3: 2.25% (3.5600 => 3.6400, std. dev.: 0.0125)
MultiSource/Benchmarks/Olden/tsp/tsp: 1.74% (1.1500 => 1.1700, std. dev.: 0.0047)
MultiSource/Applications/sgefa/sgefa: 1.49% (0.6700 => 0.6800, std. dev.: 0.0000)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.25% (0.8000 => 0.8100, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/ary3: 1.12% (1.7800 => 1.8000, std. dev.: 0.0047)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/2008-04-20-LoopBug2: -100.00% (0.0100 => 0.0000, std. dev.: 0.0000)
SingleSource/UnitTests/2010-05-24-BitfieldTest: -100.00% (0.0100 => 0.0000, std. dev.: 0.0000)
SingleSource/UnitTests/2003-05-14-AtExit: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
SingleSource/Benchmarks/Misc/mandel: -40.00% (0.0500 => 0.0300, std. dev.: 0.0000)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.00% (0.0800 => 0.0600, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/ackermann: -16.67% (0.1800 => 0.1500, std. dev.: 0.0094)
SingleSource/Benchmarks/Shootout-C++/sieve: -12.50% (0.2400 => 0.2100, std. dev.: 0.0082)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.00% (0.5000 => 0.4500, std. dev.: 0.0125)
MultiSource/Applications/spiff/spiff: -9.38% (0.6400 => 0.5800, std. dev.: 0.0141)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.30% (0.4300 => 0.3900, std. dev.: 0.0141)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.26% (0.4700 => 0.4500, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C++/city/city: -3.88% (1.2900 => 1.2400, std. dev.: 0.0163)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.10% (3.3300 => 3.2600, std. dev.: 0.0205)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.96% (7.1400 => 7.0000, std. dev.: 0.0205)
MultiSource/Applications/JM/lencod/lencod: -1.84% (11.9400 => 11.7200, std. dev.: 0.0829)
MultiSource/Applications/ClamAV/clamscan: -1.75% (11.9800 => 11.7700, std. dev.: 0.0735)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Shootout-C++/hash: -6.38% (0.4700 => 0.4400, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout/hash: -2.08% (3.3700 => 3.3000, std. dev.: 0.0189)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/DuffsDevice: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/matrixTranspose: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/ms_struct_pack_layout: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Benchmarks/Dhrystone/fldry: 66.67% (0.0300 => 0.0500, std. dev.: 0.0000)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 35.71% (0.1400 => 0.1900, std. dev.: 0.0082)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 35.29% (0.1700 => 0.2300, std. dev.: 0.0125)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
SingleSource/UnitTests/Vector/SSE/sse_shift: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.00% (0.0400 => 0.0500, std. dev.: 0.0000)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.29% (0.1400 => 0.1600, std. dev.: 0.0047)
MultiSource/Applications/lambda-0_1_3/lambda: 10.64% (0.4700 => 0.5200, std. dev.: 0.0141)
SingleSource/Benchmarks/Shootout-C++/ary: 10.00% (0.2000 => 0.2200, std. dev.: 0.0047)
SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.3000 => 0.3200, std. dev.: 0.0047)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.68% (3.4200 => 3.5800, std. dev.: 0.0163)
MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (6.8200 => 6.9000, std. dev.: 0.0309)
MultiSource/Applications/kimwitu++/kc: 1.11% (12.6200 => 12.7600, std. dev.: 0.0205)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.10% (3.6300 => 3.6700, std. dev.: 0.0094)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.56% (0.7200 => 0.9400, std. dev.: 0.0047)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.14% (1.3900 => 1.6700, std. dev.: 0.0047)
MultiSource/Benchmarks/McCat/18-imp/imp: 16.67% (0.0600 => 0.0700, std. dev.: 0.0000)
SingleSource/UnitTests/Vector/SSE/sse_stepfft: 5.00% (0.4000 => 0.4200, std. dev.: 0.0047)
MultiSource/Applications/sqlite3/sqlite3: 3.12% (3.5300 => 3.6400, std. dev.: 0.0125)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.53% (0.7900 => 0.8100, std. dev.: 0.0000)
MultiSource/Applications/siod/siod: 1.03% (2.9200 => 2.9500, std. dev.: 0.0082)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Prolangs-C++/NP/np: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/Regression/C/2003-06-16-VolatileError: -100.00% (0.0100 => 0.0000, std. dev.: 0.0000)
SingleSource/UnitTests/2003-07-10-SignConversions: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/UnitTests/2010-05-24-BitfieldTest: -100.00% (0.0100 => 0.0000, std. dev.: 0.0000)
SingleSource/UnitTests/SignlessTypes/div: -100.00% (0.0300 => 0.0000, std. dev.: 0.0082)
SingleSource/Benchmarks/Misc/dt: -75.00% (0.0400 => 0.0100, std. dev.: 0.0082)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -50.00% (0.0400 => 0.0200, std. dev.: 0.0047)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -50.00% (0.1000 => 0.0500, std. dev.: 0.0163)
SingleSource/Regression/C++/global_ctor: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
SingleSource/UnitTests/2003-05-02-DependentPHI: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
MultiSource/Benchmarks/BitBench/uuencode/uuencode: -40.00% (0.0500 => 0.0300, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc/mandel: -40.00% (0.0500 => 0.0300, std. dev.: 0.0000)
SingleSource/UnitTests/Vector/SSE/sse_isamax: -37.50% (0.0800 => 0.0500, std. dev.: 0.0082)
SingleSource/Benchmarks/BenchmarkGame/n-body: -33.33% (0.0600 => 0.0400, std. dev.: 0.0047)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -33.33% (0.0600 => 0.0400, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc/fbench: -33.33% (0.0600 => 0.0400, std. dev.: 0.0047)
MultiSource/Benchmarks/FreeBench/mason/mason: -28.57% (0.0700 => 0.0500, std. dev.: 0.0047)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -28.57% (0.0700 => 0.0500, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -25.00% (0.0400 => 0.0300, std. dev.: 0.0000)
SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: -25.00% (0.0400 => 0.0300, std. dev.: 0.0000)
MultiSource/Benchmarks/McCat/05-eks/eks: -17.50% (0.4000 => 0.3300, std. dev.: 0.0205)
SingleSource/Benchmarks/Shootout-C++/ary3: -13.64% (0.2200 => 0.1900, std. dev.: 0.0082)
SingleSource/Benchmarks/Shootout-C++/sieve: -12.50% (0.2400 => 0.2100, std. dev.: 0.0082)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -11.36% (0.4400 => 0.3900, std. dev.: 0.0141)
SingleSource/UnitTests/SignlessTypes/rem: -10.00% (0.1000 => 0.0900, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/matrix: -9.52% (0.2100 => 0.1900, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -8.16% (0.4900 => 0.4500, std. dev.: 0.0047)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.27% (0.5500 => 0.5100, std. dev.: 0.0125)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.30% (1.2700 => 1.1900, std. dev.: 0.0082)
SingleSource/Benchmarks/Misc/ReedSolomon: -6.25% (0.1600 => 0.1500, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/hash: -6.06% (0.3300 => 0.3100, std. dev.: 0.0000)
MultiSource/Applications/oggenc/oggenc: -5.74% (4.0100 => 3.7800, std. dev.: 0.0170)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.28% (2.6500 => 2.5100, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C/football/football: -4.55% (0.6600 => 0.6300, std. dev.: 0.0082)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.85% (0.5200 => 0.5000, std. dev.: 0.0047)
MultiSource/Applications/obsequi/Obsequi: -3.45% (0.8700 => 0.8400, std. dev.: 0.0094)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.88% (1.0400 => 1.0100, std. dev.: 0.0047)
MultiSource/Applications/lemon/lemon: -2.38% (0.8400 => 0.8200, std. dev.: 0.0000)
MultiSource/Applications/JM/lencod/lencod: -1.92% (11.9500 => 11.7200, std. dev.: 0.0829)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.47% (0.6800 => 0.6700, std. dev.: 0.0000)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Applications/JM/ldecod/ldecod: -42.86% (0.0700 => 0.0400, std. dev.: 0.0047)
MultiSource/Benchmarks/Olden/mst/mst: -37.50% (0.0800 => 0.0500, std. dev.: 0.0094)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -28.57% (0.0700 => 0.0500, std. dev.: 0.0047)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -23.81% (0.2100 => 0.1600, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc-C++/bigfib: -20.59% (0.3400 => 0.2700, std. dev.: 0.0249)
MultiSource/Benchmarks/Olden/health/health: -10.34% (0.2900 => 0.2600, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/methcall: -8.80% (5.0000 => 4.5600, std. dev.: 0.0602)
SingleSource/Benchmarks/Misc-C++/Large/ray: -6.52% (3.2200 => 3.0100, std. dev.: 0.0125)
SingleSource/Benchmarks/Shootout-C++/hash: -6.38% (0.4700 => 0.4400, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/sieve: -4.82% (1.6600 => 1.5800, std. dev.: 0.0141)
MultiSource/Benchmarks/Prolangs-C++/life/life: -4.39% (1.1400 => 1.0900, std. dev.: 0.0170)
MultiSource/Benchmarks/Ptrdist/bc/bc: -4.00% (0.5000 => 0.4800, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout/hash: -2.65% (3.3900 => 3.3000, std. dev.: 0.0189)
MultiSource/Applications/SIBsim4/SIBsim4: -2.41% (3.7300 => 3.6400, std. dev.: 0.0082)
MultiSource/Applications/obsequi/Obsequi: -2.35% (1.7000 => 1.6600, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.18% (4.1200 => 4.0300, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc/salsa20: -1.90% (7.8800 => 7.7300, std. dev.: 0.0082)
SingleSource/Benchmarks/Misc/pi: -1.67% (0.6000 => 0.5900, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/fibo: -1.49% (2.6900 => 2.6500, std. dev.: 0.0125)
SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.41% (3.5400 => 3.4900, std. dev.: 0.0000)
MultiSource/Benchmarks/Bullet/bullet: -1.25% (4.8000 => 4.7400, std. dev.: 0.0141)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.08% (4.6200 => 4.5700, std. dev.: 0.0082)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
Report Time: 1.00s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120406/78883d16/attachment.html>
More information about the llvm-testresults
mailing list