[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Apr 4 18:22:13 PDT 2012 

http://llvm.org/perf/db_default/v4/nts/103?compare_to=101&baseline=4
Nickname: llvmsuitebot1__clang_DEV__x86_64:2
Comparing:
     Run: 103, Order:  154069, Start Time: 2012-04-05 00:38:42, End Time: 2012-04-05 01:22:15
      To: 101, Order:  154063, Start Time: 2012-04-04 23:44:42, End Time: 2012-04-05 00:28:09
Baseline: 4, Order:  153780, Start Time: 2012-03-30 22:20:19, End Time: 2012-03-30 22:34:44

===============
Tests Summary
===============

Performance Regressions: 61 (36 on baseline)
Performance Improvements: 5 (46 on baseline)
Existing Failures: 8 (8 on baseline)
Unchanged Tests: 814 (798 on baseline)
Total Tests: 888

===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/nestedloop: 200.00% (0.0100 => 0.0300, std. dev.: 0.0000)
  SingleSource/UnitTests/2002-05-02-CastTest: 200.00% (0.0100 => 0.0300, std. dev.: 0.0000)
  MultiSource/Benchmarks/Olden/tsp/tsp: 150.00% (0.0400 => 0.1000, std. dev.: 0.0047)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 100.00% (0.0200 => 0.0400, std. dev.: 0.0000)
  SingleSource/Regression/C++/global_ctor: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/Regression/C++/pointer_method2: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/Regression/C/2003-05-22-LocalTypeTest: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/Regression/C/PR1386: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/Regression/C/globalrefs: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/2002-05-03-NotTest: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/2002-05-19-DivTest: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/2003-04-22-Switch: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/2005-05-12-Int64ToFP: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/FloatPrecision: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/member-function-pointers: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/Vector/SSE/sse_expandfft: 42.86% (0.0700 => 0.1000, std. dev.: 0.0047)
  SingleSource/UnitTests/Vector/SSE/sse_isamax: 40.00% (0.0500 => 0.0700, std. dev.: 0.0047)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 33.33% (0.0600 => 0.0800, std. dev.: 0.0047)
  MultiSource/Benchmarks/Olden/mst/mst: 33.33% (0.0600 => 0.0800, std. dev.: 0.0047)
  SingleSource/Benchmarks/Shootout/heapsort: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 23.81% (0.2100 => 0.2600, std. dev.: 0.0000)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 20.00% (0.1500 => 0.1800, std. dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/ary3: 15.79% (0.1900 => 0.2200, std. dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.29% (0.2800 => 0.3200, std. dev.: 0.0094)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.11% (0.3600 => 0.4000, std. dev.: 0.0125)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 10.00% (0.2000 => 0.2200, std. dev.: 0.0047)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 8.33% (0.1200 => 0.1300, std. dev.: 0.0000)
  MultiSource/Benchmarks/Prolangs-C/football/football: 8.20% (0.6100 => 0.6600, std. dev.: 0.0094)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 7.69% (0.2600 => 0.2800, std. dev.: 0.0047)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.38% (0.4700 => 0.5000, std. dev.: 0.0094)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.34% (3.4700 => 3.6900, std. dev.: 0.0216)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.25% (0.1600 => 0.1700, std. dev.: 0.0000)
  MultiSource/Applications/treecc/treecc: 5.81% (1.5500 => 1.6400, std. dev.: 0.0047)
  SingleSource/Regression/C++/ofstream_ctor: 5.56% (0.1800 => 0.1900, std. dev.: 0.0000)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.00% (1.0000 => 1.0400, std. dev.: 0.0082)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.00% (0.2500 => 0.2600, std. dev.: 0.0000)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.2400 => 1.2800, std. dev.: 0.0141)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.30% (6.9500 => 7.1100, std. dev.: 0.0262)
  MultiSource/Applications/JM/ldecod/ldecod: 2.10% (5.2500 => 5.3600, std. dev.: 0.0082)
  MultiSource/Applications/d/make_dparser: 1.95% (2.5700 => 2.6200, std. dev.: 0.0125)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.29% (17.8400 => 18.0700, std. dev.: 0.0141)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.27% (3.9300 => 3.9800, std. dev.: 0.0125)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/d/make_dparser: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/moments: 100.00% (0.0200 => 0.0400, std. dev.: 0.0047)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 75.00% (0.0400 => 0.0700, std. dev.: 0.0000)
  SingleSource/Benchmarks/Stanford/Treesort: 50.00% (0.0400 => 0.0600, std. dev.: 0.0000)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 40.00% (0.0500 => 0.0700, std. dev.: 0.0000)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 38.46% (0.1300 => 0.1800, std. dev.: 0.0094)
  SingleSource/Benchmarks/Shootout/strcat: 27.27% (0.1100 => 0.1400, std. dev.: 0.0047)
  MultiSource/Benchmarks/McCat/18-imp/imp: 16.67% (0.0600 => 0.0700, std. dev.: 0.0000)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.44% (0.4100 => 0.4200, std. dev.: 0.0000)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.38% (0.4200 => 0.4300, std. dev.: 0.0000)
  SingleSource/Benchmarks/Shootout/hash: 1.51% (3.3200 => 3.3700, std. dev.: 0.0141)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.46% (1.3700 => 1.3900, std. dev.: 0.0000)
  SingleSource/Benchmarks/Misc/ffbench: 1.43% (0.7000 => 0.7100, std. dev.: 0.0000)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.20% (2.5100 => 2.5400, std. dev.: 0.0047)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -66.67% (0.0300 => 0.0100, std. dev.: 0.0047)
  SingleSource/Benchmarks/Shootout/random: -50.00% (0.0400 => 0.0200, std. dev.: 0.0047)
  SingleSource/Regression/C++/2011-03-28-Bitfield: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.67% (1.2000 => 1.1800, std. dev.: 0.0000)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Olden/voronoi/voronoi
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle

================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/Benchmarks/Shootout/hash: 100.00% (0.0200 => 0.0400, std. dev.: 0.0047)
  SingleSource/Regression/C++/pointer_method: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
  MultiSource/Applications/aha/aha: 60.00% (0.0500 => 0.0800, std. dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 47.06% (0.1700 => 0.2500, std. dev.: 0.0170)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 33.33% (0.0600 => 0.0800, std. dev.: 0.0047)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 33.33% (0.0600 => 0.0800, std. dev.: 0.0047)
  MultiSource/Benchmarks/Olden/mst/mst: 33.33% (0.0600 => 0.0800, std. dev.: 0.0047)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.43% (0.1400 => 0.1700, std. dev.: 0.0094)
  SingleSource/Regression/C++/ofstream_ctor: 18.75% (0.1600 => 0.1900, std. dev.: 0.0000)
  MultiSource/Benchmarks/Olden/bh/bh: 9.09% (0.2200 => 0.2400, std. dev.: 0.0047)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 7.69% (0.2600 => 0.2800, std. dev.: 0.0047)
  MultiSource/Applications/hexxagon/hexxagon: 7.69% (0.7800 => 0.8400, std. dev.: 0.0170)
  SingleSource/Benchmarks/Shootout-C++/moments: 6.67% (0.3000 => 0.3200, std. dev.: 0.0047)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.00% (0.2500 => 0.2600, std. dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.00% (0.2500 => 0.2600, std. dev.: 0.0000)
  MultiSource/Applications/treecc/treecc: 3.14% (1.5900 => 1.6400, std. dev.: 0.0047)
  MultiSource/Applications/JM/ldecod/ldecod: 2.29% (5.2400 => 5.3600, std. dev.: 0.0082)
  MultiSource/Applications/kimwitu++/kc: 2.06% (12.6200 => 12.8800, std. dev.: 0.0262)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.05% (3.9000 => 3.9800, std. dev.: 0.0125)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.65% (3.6300 => 3.6900, std. dev.: 0.0216)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.57% (7.0000 => 7.1100, std. dev.: 0.0262)
  MultiSource/Applications/lua/lua: 1.29% (3.0900 => 3.1300, std. dev.: 0.0094)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.56% (0.7200 => 0.9400, std. dev.: 0.0000)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.14% (1.3900 => 1.6700, std. dev.: 0.0125)
  MultiSource/Benchmarks/McCat/18-imp/imp: 16.67% (0.0600 => 0.0700, std. dev.: 0.0000)
  SingleSource/UnitTests/Vector/SSE/sse_stepfft: 5.00% (0.4000 => 0.4200, std. dev.: 0.0047)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 3.23% (0.3100 => 0.3200, std. dev.: 0.0000)
  MultiSource/Applications/lua/lua: 1.72% (22.6900 => 23.0800, std. dev.: 0.0450)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.48% (4.0500 => 4.1100, std. dev.: 0.0000)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.11% (26.2200 => 26.5100, std. dev.: 0.0082)
  MultiSource/Applications/siod/siod: 1.03% (2.9200 => 2.9500, std. dev.: 0.0000)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C++/EH/inlined_cleanup: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
  SingleSource/Regression/C++/pointer_member: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
  SingleSource/Regression/C/PR491: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -75.00% (0.0400 => 0.0100, std. dev.: 0.0047)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -60.00% (0.0500 => 0.0200, std. dev.: 0.0094)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -50.00% (0.0400 => 0.0200, std. dev.: 0.0047)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0400 => 0.0200, std. dev.: 0.0047)
  SingleSource/Regression/C++/2011-03-28-Bitfield: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
  SingleSource/UnitTests/2003-10-13-SwitchTest: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
  SingleSource/UnitTests/2005-11-29-LongSwitch: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
  SingleSource/UnitTests/Vector/sumarray: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
  SingleSource/UnitTests/byval-alignment: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -30.00% (0.1000 => 0.0700, std. dev.: 0.0082)
  MultiSource/Benchmarks/FreeBench/mason/mason: -28.57% (0.0700 => 0.0500, std. dev.: 0.0047)
  SingleSource/Benchmarks/Stanford/FloatMM: -25.00% (0.0400 => 0.0300, std. dev.: 0.0000)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -22.22% (0.1800 => 0.1400, std. dev.: 0.0094)
  SingleSource/Benchmarks/Shootout-C++/wc: -14.29% (0.2100 => 0.1800, std. dev.: 0.0094)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.52% (0.2100 => 0.1900, std. dev.: 0.0000)
  MultiSource/Benchmarks/McCat/05-eks/eks: -7.50% (0.4000 => 0.3700, std. dev.: 0.0094)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.27% (0.5500 => 0.5100, std. dev.: 0.0082)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -7.09% (1.2700 => 1.1800, std. dev.: 0.0170)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.71% (0.7000 => 0.6600, std. dev.: 0.0125)
  MultiSource/Applications/oggenc/oggenc: -5.24% (4.0100 => 3.8000, std. dev.: 0.0125)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.91% (2.6500 => 2.5200, std. dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.30% (0.9100 => 0.8800, std. dev.: 0.0082)
  MultiSource/Applications/d/make_dparser: -1.50% (2.6600 => 2.6200, std. dev.: 0.0125)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: -42.86% (0.0700 => 0.0400, std. dev.: 0.0094)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -20.00% (0.0500 => 0.0400, std. dev.: 0.0000)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.39% (0.2300 => 0.1900, std. dev.: 0.0125)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -14.29% (0.2100 => 0.1800, std. dev.: 0.0094)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -12.50% (0.1600 => 0.1400, std. dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.51% (0.4700 => 0.4300, std. dev.: 0.0125)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.33% (0.2400 => 0.2200, std. dev.: 0.0047)
  MultiSource/Applications/spiff/spiff: -6.45% (1.8600 => 1.7400, std. dev.: 0.0403)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -6.21% (3.2200 => 3.0200, std. dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/methcall: -5.80% (5.0000 => 4.7100, std. dev.: 0.0000)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -4.39% (1.1400 => 1.0900, std. dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/objinst: -3.82% (4.9700 => 4.7800, std. dev.: 0.0000)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.98% (3.5400 => 3.4700, std. dev.: 0.0094)
  SingleSource/Benchmarks/Misc/pi: -1.67% (0.6000 => 0.5900, std. dev.: 0.0000)
  SingleSource/Benchmarks/Misc/salsa20: -1.65% (7.8800 => 7.7500, std. dev.: 0.0141)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.65% (2.4300 => 2.3900, std. dev.: 0.0125)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.61% (3.7300 => 3.6700, std. dev.: 0.0216)
  MultiSource/Benchmarks/Olden/bh/bh: -1.29% (1.5500 => 1.5300, std. dev.: 0.0047)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Olden/voronoi/voronoi
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle

Report Time: 0.97s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120404/6473e4b4/attachment.html>

More information about the llvm-testresults mailing list