[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Mon May 6 14:01:33 PDT 2013
http://llvm.org/perf/db_default/v4/nts/11347?compare_to=11346&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11
Comparing:
Run: 11347, Order: 181233, Start Time: 2013-05-06 19:14:30, End Time: 2013-05-06 21:01:12
To: 11346, Order: 181211, Start Time: 2013-05-06 17:01:36, End Time: 2013-05-06 18:51:30
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00
===============
Tests Summary
===============
New Failures: 0 (1 on baseline)
New Passes: 0 (20 on baseline)
Performance Regressions: 10 (104 on baseline)
Performance Improvements: 66 (65 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 13 (12 on baseline)
Unchanged Tests: 1019 (900 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C++/garage/garage: 47.43% (0.0740 => 0.1091, std.dev.: 0.0131)
SingleSource/Benchmarks/Shootout-C++/hello: 5.41% (0.1921 => 0.2025, std.dev.: 0.0038)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.20% (0.5222 => 0.5337, std.dev.: 0.0043)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: 30.86% (0.2926 => 0.3829, std.dev.: 0.0189)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.25% (15.9130 => 19.1361, std.dev.: 0.1473)
MultiSource/Applications/lambda-0_1_3/lambda: 7.44% (8.3480 => 8.9689, std.dev.: 0.0748)
MultiSource/Applications/SIBsim4/SIBsim4: 6.05% (3.2149 => 3.4093, std.dev.: 0.0497)
SingleSource/Benchmarks/Shootout/lists: 2.88% (7.2678 => 7.4769, std.dev.: 0.0193)
SingleSource/Benchmarks/Misc/ffbench: 1.04% (1.4382 => 1.4532, std.dev.: 0.0054)
SingleSource/Benchmarks/CoyoteBench/huffbench: 1.03% (24.4687 => 24.7204, std.dev.: 0.0279)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -22.59% (0.1306 => 0.1011, std.dev.: 0.0035)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -21.38% (0.0636 => 0.0500, std.dev.: 0.0007)
MultiSource/Benchmarks/Fhourstones/fhourstones: -21.31% (0.2220 => 0.1747, std.dev.: 0.0021)
MultiSource/Benchmarks/Olden/em3d/em3d: -20.15% (0.2437 => 0.1946, std.dev.: 0.0026)
MultiSource/Benchmarks/McCat/05-eks/eks: -18.60% (0.6258 => 0.5094, std.dev.: 0.0009)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -18.16% (0.1217 => 0.0996, std.dev.: 0.0011)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: -16.57% (0.1153 => 0.0962, std.dev.: 0.0019)
MultiSource/Benchmarks/Olden/health/health: -14.74% (0.1791 => 0.1527, std.dev.: 0.0010)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -13.61% (0.0977 => 0.0844, std.dev.: 0.0006)
MultiSource/Benchmarks/Olden/bh/bh: -13.53% (0.3784 => 0.3272, std.dev.: 0.0014)
MultiSource/Benchmarks/MallocBench/gs/gs: -12.76% (5.2225 => 4.5560, std.dev.: 0.1631)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -12.22% (0.0998 => 0.0876, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.36% (0.7368 => 0.6678, std.dev.: 0.0043)
MultiSource/Benchmarks/McCat/04-bisect/bisect: -9.20% (0.1457 => 0.1323, std.dev.: 0.0021)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -9.06% (0.1181 => 0.1074, std.dev.: 0.0010)
MultiSource/Benchmarks/SciMark2-C/scimark2: -8.72% (0.3990 => 0.3642, std.dev.: 0.0100)
MultiSource/Benchmarks/McCat/09-vor/vor: -8.65% (0.3793 => 0.3465, std.dev.: 0.0043)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.57% (0.9577 => 0.8756, std.dev.: 0.0013)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.53% (0.2918 => 0.2669, std.dev.: 0.0031)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -8.21% (1.4897 => 1.3674, std.dev.: 0.0348)
MultiSource/Applications/minisat/minisat: -7.92% (0.8284 => 0.7628, std.dev.: 0.0239)
MultiSource/Applications/kimwitu++/kc: -7.51% (20.3744 => 18.8447, std.dev.: 0.2113)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.55% (0.4045 => 0.3780, std.dev.: 0.0040)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.33% (1.7412 => 1.6309, std.dev.: 0.0113)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.03% (4.8774 => 4.5834, std.dev.: 0.0361)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -5.86% (0.7580 => 0.7136, std.dev.: 0.0065)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.70% (1.6723 => 1.5769, std.dev.: 0.0146)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.67% (1.6575 => 1.5636, std.dev.: 0.0309)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.56% (1.5531 => 1.4667, std.dev.: 0.0253)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.55% (1.7617 => 1.6639, std.dev.: 0.0261)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.91% (0.2792 => 0.2655, std.dev.: 0.0046)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.83% (1.6290 => 1.5504, std.dev.: 0.0219)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.75% (1.7487 => 1.6656, std.dev.: 0.0230)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.52% (1.6484 => 1.5739, std.dev.: 0.0067)
MultiSource/Benchmarks/McCat/08-main/main: -4.42% (0.3032 => 0.2898, std.dev.: 0.0029)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.42% (0.2898 => 0.2770, std.dev.: 0.0006)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.40% (5.1565 => 4.9298, std.dev.: 0.0320)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.38% (0.7392 => 0.7068, std.dev.: 0.0108)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.23% (0.2906 => 0.2783, std.dev.: 0.0031)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.09% (1.1433 => 1.0965, std.dev.: 0.0102)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.05% (0.8165 => 0.7834, std.dev.: 0.0114)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.83% (1.5995 => 1.5382, std.dev.: 0.0140)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -3.06% (0.6872 => 0.6662, std.dev.: 0.0067)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.66% (1.5656 => 1.5240, std.dev.: 0.0132)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.61% (1.6377 => 1.5949, std.dev.: 0.0113)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.57% (9.9170 => 9.6623, std.dev.: 0.0233)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.32% (1.4486 => 1.4150, std.dev.: 0.0130)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.97% (0.9443 => 0.9257, std.dev.: 0.0014)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.46% (1.5890 => 1.5658, std.dev.: 0.0089)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: -43.55% (0.2358 => 0.1331, std.dev.: 0.0069)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -9.44% (2.6925 => 2.4382, std.dev.: 0.0747)
MultiSource/Benchmarks/Olden/health/health: -6.90% (0.3537 => 0.3293, std.dev.: 0.0022)
MultiSource/Benchmarks/Olden/bisort/bisort: -6.75% (0.7127 => 0.6646, std.dev.: 0.0129)
MultiSource/Benchmarks/llubenchmark/llu: -6.67% (2.1461 => 2.0030, std.dev.: 0.0158)
SingleSource/Benchmarks/McGill/chomp: -5.89% (1.1258 => 1.0595, std.dev.: 0.0137)
MultiSource/Benchmarks/Olden/bh/bh: -4.11% (2.5376 => 2.4332, std.dev.: 0.0056)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.10% (0.3269 => 0.3135, std.dev.: 0.0020)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.52% (0.3463 => 0.3341, std.dev.: 0.0012)
MultiSource/Applications/JM/lencod/lencod: -3.20% (7.1568 => 6.9281, std.dev.: 0.0357)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.87% (1.1534 => 1.1203, std.dev.: 0.0061)
SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.84% (1.2118 => 1.1774, std.dev.: 0.0021)
MultiSource/Applications/hexxagon/hexxagon: -2.59% (15.7789 => 15.3695, std.dev.: 0.0289)
SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.42% (1.2827 => 1.2517, std.dev.: 0.0047)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.40% (1.1395 => 1.1121, std.dev.: 0.0089)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.90% (5.9497 => 5.8369, std.dev.: 0.0257)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.89% (2.9358 => 2.8802, std.dev.: 0.0003)
Existing Failures - Compile Time
--------------------------------
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/obsequi/Obsequi: -11.30% (1.2902 => 1.1444, std.dev.: 0.1588)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lua/lua
MultiSource/Applications/obsequi/Obsequi
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
MultiSource/Benchmarks/MiBench/security-sha/security-sha
SingleSource/Regression/C/2003-05-21-UnionBitfields
SingleSource/Regression/C/2003-05-21-UnionTest
SingleSource/UnitTests/2005-07-15-Bitfield-ABI
SingleSource/UnitTests/2006-01-23-UnionInit
SingleSource/UnitTests/2007-04-10-BitfieldTest
SingleSource/UnitTests/SignlessTypes/Large/cast
MultiSource/Applications/ClamAV/clamscan: -5.73% (0.1519 => 0.1432, std.dev.: 0.0323)
MultiSource/Applications/lua/lua: -0.57% (28.4974 => 28.3338, std.dev.: 0.5019)
MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.08% (0.0515 => 0.0536, std.dev.: 0.0067)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.78% (0.0256 => 0.0258, std.dev.: 0.0021)
SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005)
SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0005)
SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/SignlessTypes/Large/cast: 128.95% (0.0038 => 0.0087, std.dev.: 0.0038)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Applications/lua/lua
MultiSource/Applications/lua/lua: 0.58% (28.1709 => 28.3338, std.dev.: 0.5019)
New Passes - Execution Time
---------------------------
MultiSource/Applications/ALAC/decode/alacconvert-decode
MultiSource/Applications/Burg/burg
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/McCat/12-IOtest/iotest
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Ptrdist/anagram/anagram
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
MultiSource/Benchmarks/mediabench/g721/g721encode/encode
MultiSource/Benchmarks/mediabench/gsm/toast/toast
SingleSource/Benchmarks/BenchmarkGame/puzzle
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
SingleSource/UnitTests/Vector/Altivec/alti_expandfft
SingleSource/UnitTests/Vector/Altivec/alti_isamax
SingleSource/UnitTests/Vector/Altivec/alti_sdot
SingleSource/UnitTests/Vector/Altivec/alti_stepfft
SingleSource/UnitTests/Vector/Altivec/casts
SingleSource/UnitTests/Vector/Altivec/test1
SingleSource/UnitTests/Vectorizer/gcc-loops
MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.02% (0.0248 => 0.0243, std.dev.: 0.0001)
MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002)
MultiSource/Applications/lemon/lemon: -28.60% (1.1794 => 0.8421, std.dev.: 0.4094)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.42% (0.4125 => 0.4431, std.dev.: 0.0188)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -13.52% (0.1309 => 0.1132, std.dev.: 0.0065)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -15.54% (0.0663 => 0.0560, std.dev.: 0.0016)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.40% (1.1660 => 1.3223, std.dev.: 0.0021)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0001)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.72% (0.0594 => 0.0628, std.dev.: 0.0041)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -42.66% (0.0361 => 0.0207, std.dev.: 0.0033)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -33.33% (1.6803 => 1.1203, std.dev.: 0.0061)
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.50% (29.7937 => 30.8379, std.dev.: 1.1238)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0034)
SingleSource/UnitTests/Vector/Altivec/casts: 800.00% (0.0001 => 0.0009, std.dev.: 0.0001)
SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/Vectorizer/gcc-loops: -15.23% (26.9213 => 22.8216, std.dev.: 0.1456)
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C++/garage/garage: 46.05% (0.0747 => 0.1091, std.dev.: 0.0131)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.81% (1.0418 => 1.3628, std.dev.: 0.0326)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 30.29% (1.0958 => 1.4277, std.dev.: 0.0708)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 29.55% (1.1626 => 1.5061, std.dev.: 0.0289)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.24% (1.1428 => 1.4769, std.dev.: 0.0310)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.05% (1.0528 => 1.3586, std.dev.: 0.0648)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 28.79% (1.0617 => 1.3674, std.dev.: 0.0348)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.62% (1.0864 => 1.3973, std.dev.: 0.0516)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.46% (1.0687 => 1.3728, std.dev.: 0.0327)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 28.37% (1.1023 => 1.4150, std.dev.: 0.0130)
MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.26% (1.0507 => 1.3476, std.dev.: 0.0298)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 28.18% (1.1209 => 1.4368, std.dev.: 0.0384)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.43% (1.2270 => 1.5636, std.dev.: 0.0309)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 27.01% (1.1744 => 1.4916, std.dev.: 0.0362)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 26.82% (1.1699 => 1.4837, std.dev.: 0.0261)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 26.45% (1.0526 => 1.3310, std.dev.: 0.0333)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.14% (1.0951 => 1.3814, std.dev.: 0.0757)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.09% (1.0890 => 1.3622, std.dev.: 0.0342)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 25.07% (1.1727 => 1.4667, std.dev.: 0.0253)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 24.36% (1.2537 => 1.5591, std.dev.: 0.0785)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 23.94% (1.2723 => 1.5769, std.dev.: 0.0146)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 23.63% (1.3692 => 1.6927, std.dev.: 0.0245)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.46% (1.3491 => 1.6656, std.dev.: 0.0230)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 23.41% (1.2925 => 1.5951, std.dev.: 0.0266)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 23.38% (1.2566 => 1.5504, std.dev.: 0.0219)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 23.36% (1.2929 => 1.5949, std.dev.: 0.0113)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.97% (1.2835 => 1.5783, std.dev.: 0.0407)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 22.77% (1.3046 => 1.6017, std.dev.: 0.0869)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.72% (1.2419 => 1.5240, std.dev.: 0.0132)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 22.50% (1.3313 => 1.6309, std.dev.: 0.0113)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 22.00% (1.3638 => 1.6639, std.dev.: 0.0261)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.86% (1.3451 => 1.6392, std.dev.: 0.0321)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 21.49% (1.3357 => 1.6227, std.dev.: 0.0342)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.08% (1.2704 => 1.5382, std.dev.: 0.0140)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.57% (1.4005 => 1.6886, std.dev.: 0.0279)
SingleSource/Benchmarks/Misc/whetstone: 13.77% (0.0828 => 0.0942, std.dev.: 0.0027)
SingleSource/Benchmarks/Stanford/Puzzle: 10.20% (0.1128 => 0.1243, std.dev.: 0.0013)
SingleSource/Benchmarks/Shootout-C++/heapsort: 8.73% (0.2130 => 0.2316, std.dev.: 0.0011)
SingleSource/Benchmarks/Shootout-C++/hello: 7.43% (0.1885 => 0.2025, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout-C++/sieve: 7.19% (0.2950 => 0.3162, std.dev.: 0.0059)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.18% (0.9184 => 0.9752, std.dev.: 0.0124)
MultiSource/Benchmarks/McCat/05-eks/eks: 6.17% (0.4798 => 0.5094, std.dev.: 0.0009)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.73% (0.2511 => 0.2655, std.dev.: 0.0046)
SingleSource/Benchmarks/Shootout-C++/ary: 5.68% (0.2643 => 0.2793, std.dev.: 0.0058)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.39% (0.5064 => 0.5337, std.dev.: 0.0043)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.68% (0.8843 => 0.9257, std.dev.: 0.0014)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.2970 => 0.3105, std.dev.: 0.0052)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.04% (0.6481 => 0.6678, std.dev.: 0.0043)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.51% (0.6775 => 0.6945, std.dev.: 0.0058)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.5284 => 1.5658, std.dev.: 0.0089)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.03% (9.4701 => 9.6623, std.dev.: 0.0233)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.78% (1.4308 => 1.4563, std.dev.: 0.0029)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.45% (0.8631 => 0.8756, std.dev.: 0.0013)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/BitBench/drop3/drop3: 53.79% (0.3010 => 0.4629, std.dev.: 0.0180)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.12% (12.6632 => 19.1361, std.dev.: 0.1473)
SingleSource/Benchmarks/Misc/lowercase: 46.83% (0.7986 => 1.1726, std.dev.: 0.0031)
SingleSource/Benchmarks/Misc/fp-convert: 40.97% (5.6800 => 8.0073, std.dev.: 0.0401)
MultiSource/Benchmarks/MallocBench/gs/gs: 38.65% (0.0608 => 0.0843, std.dev.: 0.0009)
SingleSource/Benchmarks/Shootout-C++/ary2: 35.03% (0.0314 => 0.0424, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/methcall: 33.33% (8.6184 => 11.4909, std.dev.: 0.0619)
MultiSource/Benchmarks/Ptrdist/ks/ks: 30.30% (1.1586 => 1.5097, std.dev.: 0.0203)
MultiSource/Applications/lambda-0_1_3/lambda: 28.32% (6.9897 => 8.9689, std.dev.: 0.0748)
SingleSource/Benchmarks/Shootout/hash: 25.50% (4.1780 => 5.2433, std.dev.: 0.2476)
SingleSource/Benchmarks/Shootout-C++/ary: 21.78% (0.0505 => 0.0615, std.dev.: 0.0040)
SingleSource/Benchmarks/Shootout-C++/matrix: 21.06% (2.8804 => 3.4870, std.dev.: 0.1628)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.62% (3.7569 => 4.4940, std.dev.: 0.1294)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.88% (4.0968 => 4.8294, std.dev.: 0.1645)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.89% (4.8478 => 5.6666, std.dev.: 0.0073)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.73% (4.5865 => 5.2621, std.dev.: 0.1254)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.20% (8.7510 => 9.9935, std.dev.: 0.0745)
SingleSource/Benchmarks/Misc/salsa20: 12.78% (9.1513 => 10.3204, std.dev.: 0.0085)
MultiSource/Benchmarks/Olden/tsp/tsp: 12.63% (1.4232 => 1.6030, std.dev.: 0.0097)
SingleSource/Benchmarks/Shootout/sieve: 11.75% (6.8087 => 7.6089, std.dev.: 0.0576)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.42% (0.1655 => 0.1844, std.dev.: 0.0052)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.26% (2.5283 => 2.8129, std.dev.: 0.0161)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.00% (4.8642 => 5.3993, std.dev.: 0.0723)
SingleSource/Benchmarks/Shootout/matrix: 10.90% (1.5499 => 1.7188, std.dev.: 0.0247)
SingleSource/Benchmarks/Shootout-C++/hash: 10.61% (0.6540 => 0.7234, std.dev.: 0.0096)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.75% (1.0088 => 1.0971, std.dev.: 0.0183)
SingleSource/Benchmarks/Misc/flops: 8.41% (9.3754 => 10.1636, std.dev.: 0.0066)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.65% (1.0331 => 1.1121, std.dev.: 0.0089)
SingleSource/Benchmarks/BenchmarkGame/recursive: 7.36% (2.3673 => 2.5416, std.dev.: 0.0529)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.41% (4.7982 => 5.1056, std.dev.: 0.0808)
MultiSource/Applications/hexxagon/hexxagon: 6.15% (14.4795 => 15.3695, std.dev.: 0.0289)
SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (3.3943 => 3.6021, std.dev.: 0.0062)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.24% (6.2349 => 6.5613, std.dev.: 0.0102)
SingleSource/Benchmarks/CoyoteBench/huffbench: 5.23% (23.4908 => 24.7204, std.dev.: 0.0279)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.01% (5.1346 => 5.3920, std.dev.: 0.0023)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.08% (1.0374 => 1.0797, std.dev.: 0.0076)
SingleSource/Benchmarks/Misc/whetstone: 3.98% (3.4590 => 3.5967, std.dev.: 0.0147)
SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.90% (4.7361 => 4.9207, std.dev.: 0.0228)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.88% (6.1397 => 6.3779, std.dev.: 0.0079)
SingleSource/Benchmarks/Shootout/lists: 3.77% (7.2055 => 7.4769, std.dev.: 0.0193)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.75% (5.1006 => 5.2918, std.dev.: 0.0379)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.66% (59.5643 => 61.7453, std.dev.: 0.4794)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 3.26% (2.7893 => 2.8802, std.dev.: 0.0003)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.92% (9.6958 => 9.9791, std.dev.: 0.0181)
MultiSource/Benchmarks/Olden/bh/bh: 2.45% (2.3749 => 2.4332, std.dev.: 0.0056)
MultiSource/Benchmarks/Olden/power/power: 2.28% (1.2248 => 1.2527, std.dev.: 0.0005)
SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.26% (1.4499 => 1.4826, std.dev.: 0.0017)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.22% (4.1182 => 4.2096, std.dev.: 0.0044)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.90% (2.0956 => 2.1354, std.dev.: 0.0072)
SingleSource/Benchmarks/Misc/ffbench: 1.77% (1.4279 => 1.4532, std.dev.: 0.0054)
SingleSource/Benchmarks/Shootout/fib2: 1.16% (4.9040 => 4.9607, std.dev.: 0.0069)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C/sumarraymalloc: -48.40% (0.0810 => 0.0418, std.dev.: 0.0012)
MultiSource/Benchmarks/FreeBench/neural/neural: -22.23% (0.2542 => 0.1977, std.dev.: 0.0016)
MultiSource/Benchmarks/FreeBench/mason/mason: -18.24% (0.0817 => 0.0668, std.dev.: 0.0005)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -15.44% (0.0803 => 0.0679, std.dev.: 0.0021)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -15.42% (0.0895 => 0.0757, std.dev.: 0.0018)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -13.55% (0.0893 => 0.0772, std.dev.: 0.0014)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -11.89% (0.0858 => 0.0756, std.dev.: 0.0014)
MultiSource/Benchmarks/McCat/04-bisect/bisect: -11.51% (0.1495 => 0.1323, std.dev.: 0.0021)
SingleSource/Benchmarks/McGill/chomp: -9.66% (0.1957 => 0.1768, std.dev.: 0.0033)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -9.43% (0.2947 => 0.2669, std.dev.: 0.0031)
MultiSource/Benchmarks/SciMark2-C/scimark2: -8.72% (0.3990 => 0.3642, std.dev.: 0.0100)
MultiSource/Applications/lemon/lemon: -7.22% (1.2932 => 1.1998, std.dev.: 0.0348)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.77% (1.6187 => 1.5739, std.dev.: 0.0067)
MultiSource/Benchmarks/nbench/nbench: -1.75% (1.2881 => 1.2656, std.dev.: 0.0049)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -64.69% (1.0845 => 0.3829, std.dev.: 0.0189)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.67% (0.3861 => 0.1364, std.dev.: 0.0071)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.02% (3.4380 => 1.4775, std.dev.: 0.0058)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -56.89% (3.8940 => 1.6787, std.dev.: 0.0012)
MultiSource/Benchmarks/FreeBench/mason/mason: -45.29% (0.5213 => 0.2852, std.dev.: 0.0020)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -43.06% (0.3091 => 0.1760, std.dev.: 0.0110)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.58% (6.8267 => 4.5345, std.dev.: 0.0285)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -27.39% (0.4520 => 0.3282, std.dev.: 0.0249)
MultiSource/Applications/viterbi/viterbi: -26.80% (3.4506 => 2.5257, std.dev.: 0.0237)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.64% (0.4111 => 0.3016, std.dev.: 0.0101)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -23.92% (0.1789 => 0.1361, std.dev.: 0.0005)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -23.27% (0.2316 => 0.1777, std.dev.: 0.0149)
MultiSource/Benchmarks/mafft/pairlocalalign: -21.40% (57.5400 => 45.2248, std.dev.: 0.5721)
SingleSource/Benchmarks/Misc/perlin: -20.51% (4.5691 => 3.6318, std.dev.: 0.0146)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.76% (0.3279 => 0.2664, std.dev.: 0.0015)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.11% (0.0950 => 0.0778, std.dev.: 0.0000)
SingleSource/Benchmarks/McGill/misr: -17.97% (0.4729 => 0.3879, std.dev.: 0.0046)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -16.99% (1.9660 => 1.6319, std.dev.: 0.0296)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.71% (6.0446 => 5.0345, std.dev.: 0.0906)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -14.23% (6.7010 => 5.7473, std.dev.: 0.0117)
SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -14.21% (3.5506 => 3.0461, std.dev.: 0.0867)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -10.82% (5.6245 => 5.0158, std.dev.: 0.1947)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.39% (5.8948 => 5.2822, std.dev.: 0.0091)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -9.32% (5.0054 => 4.5388, std.dev.: 0.0825)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.98% (5.0816 => 4.6253, std.dev.: 0.0687)
SingleSource/Benchmarks/McGill/queens: -7.59% (1.7928 => 1.6568, std.dev.: 0.0142)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.52% (3.3978 => 3.1422, std.dev.: 0.0032)
MultiSource/Benchmarks/NPB-serial/is/is: -7.49% (13.2022 => 12.2135, std.dev.: 0.0406)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.48% (9.5512 => 8.8371, std.dev.: 0.0644)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.13% (0.4924 => 0.4573, std.dev.: 0.0038)
MultiSource/Benchmarks/FreeBench/distray/distray: -6.62% (0.2431 => 0.2270, std.dev.: 0.0043)
SingleSource/Benchmarks/Dhrystone/dry: -5.48% (0.5278 => 0.4989, std.dev.: 0.0022)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.97% (3.9434 => 3.7475, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.64% (3.0513 => 2.9098, std.dev.: 0.0448)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.59% (0.3093 => 0.2951, std.dev.: 0.0017)
SingleSource/Benchmarks/BenchmarkGame/n-body: -4.56% (1.5779 => 1.5059, std.dev.: 0.0208)
SingleSource/Benchmarks/Misc/ReedSolomon: -4.36% (9.0356 => 8.6414, std.dev.: 0.0518)
SingleSource/Benchmarks/Misc/fbench: -4.17% (4.9661 => 4.7590, std.dev.: 0.0025)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.15% (3.3618 => 3.2223, std.dev.: 0.0416)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.82% (3.3922 => 3.2626, std.dev.: 0.0040)
SingleSource/Benchmarks/Linpack/linpack-pc: -3.45% (52.8418 => 51.0169, std.dev.: 0.4345)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.35% (4.3713 => 4.2248, std.dev.: 0.0048)
MultiSource/Applications/JM/lencod/lencod: -3.16% (7.1542 => 6.9281, std.dev.: 0.0357)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.10% (0.6582 => 0.6378, std.dev.: 0.0017)
SingleSource/Benchmarks/Stanford/FloatMM: -2.97% (0.8122 => 0.7881, std.dev.: 0.0090)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.78% (3.8286 => 3.7223, std.dev.: 0.0031)
SingleSource/Benchmarks/CoyoteBench/almabench: -2.23% (35.0623 => 34.2808, std.dev.: 0.0573)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.13% (6.7917 => 6.6471, std.dev.: 0.0025)
MultiSource/Benchmarks/Prolangs-C++/life/life: -1.94% (2.5722 => 2.5223, std.dev.: 0.0088)
SingleSource/Benchmarks/Misc/flops-3: -1.86% (2.0809 => 2.0422, std.dev.: 0.0048)
MultiSource/Benchmarks/SciMark2-C/scimark2: -1.40% (89.3093 => 88.0620, std.dev.: 0.0831)
Removed Tests - Compile Time
----------------------------
SingleSource/Benchmarks/Shootout-C++/except
Removed Tests - Execution Time
------------------------------
SingleSource/Benchmarks/Shootout-C++/except
Added Tests - Compile Time
--------------------------
SingleSource/Benchmarks/Shootout-C++/EH/except
SingleSource/Regression/C++/EH/recursive-throw
Added Tests - Execution Time
----------------------------
SingleSource/Benchmarks/Shootout-C++/EH/except
SingleSource/Regression/C++/EH/recursive-throw
Existing Failures - Compile Time
--------------------------------
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/obsequi/Obsequi: 1.38% (1.1288 => 1.1444, std.dev.: 0.1588)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/obsequi/Obsequi
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
MultiSource/Benchmarks/MiBench/security-sha/security-sha
SingleSource/Regression/C/2003-05-21-UnionBitfields
SingleSource/Regression/C/2003-05-21-UnionTest
SingleSource/UnitTests/2005-07-15-Bitfield-ABI
SingleSource/UnitTests/2006-01-23-UnionInit
SingleSource/UnitTests/2007-04-10-BitfieldTest
SingleSource/UnitTests/SignlessTypes/Large/cast
MultiSource/Applications/ClamAV/clamscan: -3.05% (0.1477 => 0.1432, std.dev.: 0.0323)
MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.56% (0.0613 => 0.0536, std.dev.: 0.0067)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.52% (0.0276 => 0.0258, std.dev.: 0.0021)
SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005)
SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005)
SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/SignlessTypes/Large/cast: -5.43% (0.0092 => 0.0087, std.dev.: 0.0038)
Report Time: 1.07s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130506/9feea9cc/attachment.html>
More information about the llvm-testresults
mailing list