[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Feb 1 19:17:04 PST 2013


http://llvm.org/perf/db_default/v4/nts/8192?compare_to=8189&baseline=7471
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8

Comparing:
     Run: 8192, Order: 174250, Start Time: 2013-02-02 01:10:40, End Time: 2013-02-02 03:17:30
      To: 8189, Order: 174219, Start Time: 2013-02-01 22:40:17, End Time: 2013-02-02 00:49:19
Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 0 (1 on baseline)
Performance Regressions: 13 (87 on baseline)
Performance Improvements: 42 (51 on baseline)
Existing Failures: 40 (39 on baseline)
Unchanged Tests: 1009 (925 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.68% (1.5242 => 1.7023, std.dev.: 0.0150)
  MultiSource/Applications/kimwitu++/kc: 6.61% (18.4413 => 19.6605, std.dev.: 0.2886)
  MultiSource/Applications/siod/siod: 4.75% (2.5734 => 2.6956, std.dev.: 0.0247)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.71% (0.5194 => 0.5335, std.dev.: 0.0011)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.16% (2.4611 => 2.8587, std.dev.: 0.0806)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 11.51% (3.9863 => 4.4451, std.dev.: 0.1290)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.01% (6.8003 => 7.4133, std.dev.: 0.1684)
  SingleSource/Benchmarks/Shootout-C++/lists1: 6.81% (0.6078 => 0.6492, std.dev.: 0.0134)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.36% (61.6114 => 63.0665, std.dev.: 0.3951)
  MultiSource/Benchmarks/Olden/bh/bh: 2.29% (2.3924 => 2.4471, std.dev.: 0.0114)
  MultiSource/Applications/viterbi/viterbi: 1.95% (3.6417 => 3.7126, std.dev.: 0.0080)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.72% (3.5386 => 3.5995, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.18% (1.8507 => 1.8726, std.dev.: 0.0075)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2003-05-21-UnionTest: -45.14% (0.0257 => 0.0141, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout/nestedloop: -42.05% (0.0516 => 0.0299, std.dev.: 0.0017)
  SingleSource/Regression/C/badidx: -42.03% (0.0433 => 0.0251, std.dev.: 0.0063)
  SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: -40.87% (0.0252 => 0.0149, std.dev.: 0.0030)
  SingleSource/Regression/C/PR491: -40.80% (0.0250 => 0.0148, std.dev.: 0.0035)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: -40.17% (0.0351 => 0.0210, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/sieve: -39.72% (0.0423 => 0.0255, std.dev.: 0.0009)
  SingleSource/UnitTests/2002-12-13-MishaTest: -39.30% (0.0313 => 0.0190, std.dev.: 0.0005)
  SingleSource/Regression/C/test_indvars: -38.95% (0.0475 => 0.0290, std.dev.: 0.0004)
  SingleSource/UnitTests/initp1: -38.86% (0.0790 => 0.0483, std.dev.: 0.0026)
  SingleSource/UnitTests/2002-05-02-CastTest2: -38.81% (0.0335 => 0.0205, std.dev.: 0.0048)
  SingleSource/UnitTests/2003-08-05-CastFPToUint: -38.73% (0.0346 => 0.0212, std.dev.: 0.0007)
  SingleSource/UnitTests/2003-05-02-DependentPHI: -37.73% (0.0273 => 0.0170, std.dev.: 0.0012)
  SingleSource/Regression/C/PR640: -36.81% (0.0364 => 0.0230, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -36.73% (0.1266 => 0.0801, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout/ackermann: -36.46% (0.0362 => 0.0230, std.dev.: 0.0020)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: -36.15% (0.0379 => 0.0242, std.dev.: 0.0026)
  SingleSource/Regression/C++/BuiltinTypeInfo: -36.05% (0.0294 => 0.0188, std.dev.: 0.0002)
  SingleSource/Regression/C/compare: -35.84% (0.0346 => 0.0222, std.dev.: 0.0039)
  SingleSource/UnitTests/2003-08-11-VaListArg: -35.49% (0.0479 => 0.0309, std.dev.: 0.0030)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -35.10% (0.0396 => 0.0257, std.dev.: 0.0019)
  SingleSource/UnitTests/SignlessTypes/rem: -34.55% (0.1812 => 0.1186, std.dev.: 0.0036)
  SingleSource/Regression/C++/pointer_method2: -33.95% (0.0380 => 0.0251, std.dev.: 0.0016)
  SingleSource/Regression/C/sumarray: -32.80% (0.0628 => 0.0422, std.dev.: 0.0072)
  SingleSource/Benchmarks/Dhrystone/fldry: -32.48% (0.0899 => 0.0607, std.dev.: 0.0011)
  SingleSource/Regression/C/casts: -28.80% (0.0625 => 0.0445, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -26.28% (0.1252 => 0.0923, std.dev.: 0.0054)
  SingleSource/Regression/C++/ofstream_ctor: -25.92% (0.2924 => 0.2166, std.dev.: 0.0026)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -21.77% (0.1346 => 0.1053, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/strcat: -10.74% (0.2309 => 0.2061, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.62% (0.1470 => 0.1358, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.71% (1.3532 => 1.2894, std.dev.: 0.0213)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.44% (0.3173 => 0.3064, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.16% (1.2989 => 1.2578, std.dev.: 0.0146)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.03% (0.3559 => 0.3451, std.dev.: 0.0029)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.07% (2.6142 => 2.5600, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.59% (1.4867 => 1.4631, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.51% (1.1939 => 1.1759, std.dev.: 0.0063)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -18.76% (2.1996 => 1.7870, std.dev.: 0.1388)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -12.03% (1.2181 => 1.0716, std.dev.: 0.0208)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -5.33% (0.3264 => 0.3090, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/fp-convert: -2.72% (6.1066 => 5.9406, std.dev.: 0.0476)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/obsequi/Obsequi: 1.95% (1.2057 => 1.2292, std.dev.: 0.1567)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.67% (0.0225 => 0.0240, std.dev.: 0.0082)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.88% (0.0453 => 0.0449, std.dev.: 0.0129)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0353 => 0.0353, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.30% (0.0335 => 0.0334, std.dev.: 0.0095)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.44% (0.0450 => 0.0470, std.dev.: 0.0090)
  SingleSource/UnitTests/Vector/Altivec/casts: 6.48% (0.0216 => 0.0230, std.dev.: 0.0053)
  SingleSource/UnitTests/Vector/Altivec/test1: 2.17% (0.0230 => 0.0235, std.dev.: 0.0070)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/PAQ8p/paq8p
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0253 => 0.0252, std.dev.: 0.0062)
  MultiSource/Applications/Burg/burg: 7.14% (0.0014 => 0.0015, std.dev.: 0.0002)
  MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1515 => 0.1518, std.dev.: 0.0250)
  MultiSource/Applications/lemon/lemon: 5.27% (1.2211 => 1.2855, std.dev.: 0.1622)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.56% (0.4342 => 0.4540, std.dev.: 0.0168)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.62% (0.1450 => 0.1459, std.dev.: 0.0067)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.36% (0.0660 => 0.0669, std.dev.: 0.0153)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.22% (0.0270 => 0.0276, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.33% (0.0540 => 0.0558, std.dev.: 0.0127)
  MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.16% (1.2849 => 1.2870, std.dev.: 0.0488)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.00% (0.0030 => 0.0018, std.dev.: 0.0009)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.69% (0.0580 => 0.0613, std.dev.: 0.0145)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0374 => 0.0374, std.dev.: 0.0000)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.12% (1.7480 => 1.7675, std.dev.: 0.0068)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: -90.00% (0.0010 => 0.0001, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 6.12% (0.0049 => 0.0052, std.dev.: 0.0034)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.02% (34.3989 => 34.4043, std.dev.: 0.2570)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/PAQ8p/paq8p
  MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000)

New Passes - Execution Time
---------------------------
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/factor: 414.88% (0.0336 => 0.1730, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.01% (0.8893 => 1.2540, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 40.78% (0.9120 => 1.2839, std.dev.: 0.0892)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 40.72% (0.8926 => 1.2561, std.dev.: 0.0461)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 39.97% (0.9612 => 1.3454, std.dev.: 0.0828)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 39.96% (0.9061 => 1.2682, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 39.76% (0.9998 => 1.3973, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.12% (0.9381 => 1.3051, std.dev.: 0.0310)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 38.99% (0.9564 => 1.3293, std.dev.: 0.0348)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 38.97% (0.9588 => 1.3324, std.dev.: 0.0939)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.42% (0.8990 => 1.2444, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.37% (0.9091 => 1.2579, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 37.96% (0.8736 => 1.2052, std.dev.: 0.0334)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.78% (0.9855 => 1.3578, std.dev.: 0.0327)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 36.99% (0.9422 => 1.2907, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 36.76% (0.9403 => 1.2860, std.dev.: 0.0472)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.60% (0.9512 => 1.2993, std.dev.: 0.0424)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.15% (0.9010 => 1.2267, std.dev.: 0.0378)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.64% (1.0119 => 1.3725, std.dev.: 0.0323)
  SingleSource/Benchmarks/Stanford/IntMM: 35.50% (0.0431 => 0.0584, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.23% (0.8912 => 1.2052, std.dev.: 0.0512)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.92% (1.0052 => 1.3562, std.dev.: 0.0407)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.67% (0.8732 => 1.1759, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 34.64% (1.0867 => 1.4631, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 33.72% (0.8846 => 1.1829, std.dev.: 0.0752)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.53% (0.9867 => 1.3077, std.dev.: 0.0386)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.09% (1.0017 => 1.3231, std.dev.: 0.0382)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.52% (0.9788 => 1.2873, std.dev.: 0.0835)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.02% (0.9507 => 1.2456, std.dev.: 0.0312)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 30.81% (0.9488 => 1.2411, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.03% (1.0088 => 1.3117, std.dev.: 0.0694)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 29.87% (0.9685 => 1.2578, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.63% (0.9127 => 1.1831, std.dev.: 0.0167)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.11% (0.9405 => 1.2143, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.03% (0.9993 => 1.2894, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.89% (0.9550 => 1.2309, std.dev.: 0.0119)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.17% (0.1587 => 0.1923, std.dev.: 0.0128)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.64% (1.4110 => 1.7023, std.dev.: 0.0150)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 20.33% (0.0669 => 0.0805, std.dev.: 0.0020)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.61% (0.0963 => 0.1123, std.dev.: 0.0055)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 16.08% (0.4596 => 0.5335, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.88% (3.6295 => 4.2058, std.dev.: 0.1040)
  SingleSource/Benchmarks/Shootout-C++/matrix: 14.42% (0.2385 => 0.2729, std.dev.: 0.0038)
  MultiSource/Benchmarks/mafft/pairlocalalign: 12.16% (9.5202 => 10.6780, std.dev.: 0.2268)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.37% (0.1240 => 0.1381, std.dev.: 0.0034)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.32% (0.5369 => 0.5923, std.dev.: 0.0131)
  SingleSource/Benchmarks/Shootout-C++/ary3: 8.39% (0.2564 => 0.2779, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 8.03% (0.1955 => 0.2112, std.dev.: 0.0038)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.43% (1.8127 => 1.9474, std.dev.: 0.0431)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.43% (0.2879 => 0.3064, std.dev.: 0.0029)
  SingleSource/Regression/C++/ofstream_ctor: 6.07% (0.2042 => 0.2166, std.dev.: 0.0026)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.90% (7.2721 => 7.5557, std.dev.: 0.1029)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/lowercase: 106887.50% (0.0008 => 0.8559, std.dev.: 0.0079)
  SingleSource/Benchmarks/Shootout/ary3: 380.37% (2.2304 => 10.7142, std.dev.: 1.4354)
  SingleSource/Benchmarks/Shootout/matrix: 354.79% (1.5825 => 7.1971, std.dev.: 0.5117)
  MultiSource/Applications/sgefa/sgefa: 257.67% (0.3515 => 1.2572, std.dev.: 0.0024)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.35% (1.1825 => 4.0719, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 226.67% (4.8185 => 15.7404, std.dev.: 0.2001)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 212.72% (0.0228 => 0.0713, std.dev.: 0.0083)
  SingleSource/Benchmarks/Shootout-C++/ary2: 181.40% (0.0129 => 0.0363, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/ary: 156.90% (0.0232 => 0.0596, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/matrix: 62.51% (2.9083 => 4.7264, std.dev.: 0.0490)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.57% (0.2562 => 0.3422, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.30% (5.6033 => 7.4133, std.dev.: 0.1684)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.24% (3.1254 => 4.1017, std.dev.: 0.0152)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.75% (1.4588 => 1.8491, std.dev.: 0.0314)
  SingleSource/Regression/C/uint64_to_float: 24.17% (1.5397 => 1.9118, std.dev.: 0.0246)
  SingleSource/Benchmarks/Misc/salsa20: 22.29% (7.4497 => 9.1102, std.dev.: 0.0278)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.45% (4.8112 => 5.7953, std.dev.: 0.0057)
  MultiSource/Applications/JM/lencod/lencod: 15.75% (6.8159 => 7.8897, std.dev.: 0.1875)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.58% (2.5170 => 2.8587, std.dev.: 0.0806)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.17% (5.1752 => 5.8569, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6502, std.dev.: 0.0086)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.04% (3.6477 => 3.9776, std.dev.: 0.0120)
  SingleSource/Benchmarks/Misc/ReedSolomon: 8.15% (8.6447 => 9.3496, std.dev.: 0.0472)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (0.6211 => 0.6570, std.dev.: 0.0004)
  SingleSource/Benchmarks/McGill/chomp: 5.37% (1.0425 => 1.0985, std.dev.: 0.0168)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.65% (4.1836 => 4.3782, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.95% (5.0310 => 5.2295, std.dev.: 0.0565)
  SingleSource/Benchmarks/Misc/pi: 3.88% (2.1390 => 2.2219, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.32% (61.0379 => 63.0665, std.dev.: 0.3951)
  SingleSource/Benchmarks/Linpack/linpack-pc: 3.19% (50.8945 => 52.5156, std.dev.: 0.6193)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.05% (4.7254 => 4.8694, std.dev.: 0.0052)
  MultiSource/Applications/viterbi/viterbi: 2.00% (3.6397 => 3.7126, std.dev.: 0.0080)
  MultiSource/Benchmarks/Olden/bh/bh: 1.46% (2.4120 => 2.4471, std.dev.: 0.0114)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.22% (1.5595 => 1.5786, std.dev.: 0.0060)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.08% (2.5681 => 2.5959, std.dev.: 0.0043)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.74% (0.0727 => 0.0489, std.dev.: 0.0086)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -19.36% (0.1684 => 0.1358, std.dev.: 0.0033)
  MultiSource/Applications/hbd/hbd: -18.39% (1.8964 => 1.5476, std.dev.: 0.0884)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -16.25% (0.1009 => 0.0845, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -13.07% (0.1079 => 0.0938, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -11.38% (0.7686 => 0.6811, std.dev.: 0.0304)
  MultiSource/Applications/treecc/treecc: -9.91% (2.4719 => 2.2269, std.dev.: 0.0639)
  MultiSource/Applications/hexxagon/hexxagon: -9.57% (1.1433 => 1.0339, std.dev.: 0.0224)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.76% (1.3220 => 1.2062, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.53% (6.4235 => 5.8753, std.dev.: 0.2114)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.55% (0.8653 => 0.8173, std.dev.: 0.0138)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.10% (1.0234 => 0.9712, std.dev.: 0.0134)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.83% (11.5523 => 3.9477, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/fp-convert: -62.05% (15.6525 => 5.9406, std.dev.: 0.0476)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.39% (0.4146 => 0.1808, std.dev.: 0.0140)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.84% (0.4578 => 0.2342, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.03% (11.3868 => 6.3737, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.92% (5.4023 => 3.6238, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.59% (0.4452 => 0.3090, std.dev.: 0.0011)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.08% (0.5495 => 0.4007, std.dev.: 0.0299)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.22% (5.2605 => 3.8812, std.dev.: 0.0105)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.28% (0.5826 => 0.4353, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.13% (4.4467 => 3.3294, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.16% (0.5897 => 0.4472, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8224, std.dev.: 0.0245)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.71% (16.6791 => 13.3918, std.dev.: 0.4416)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.43% (5.8755 => 4.7928, std.dev.: 0.0071)
  MultiSource/Applications/minisat/minisat: -16.92% (7.9891 => 6.6375, std.dev.: 0.4140)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.34% (7.0016 => 5.9975, std.dev.: 0.2242)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.09% (3.1921 => 2.7742, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6747, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.48% (9.7992 => 8.5767, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.46% (5.7056 => 4.9945, std.dev.: 0.0103)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -11.47% (0.4081 => 0.3613, std.dev.: 0.0077)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.05% (63.1520 => 57.4359, std.dev.: 0.4802)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -7.71% (0.3217 => 0.2969, std.dev.: 0.0035)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.81% (3.5443 => 3.3028, std.dev.: 0.0432)
  SingleSource/Benchmarks/Shootout/nestedloop: -6.73% (0.2200 => 0.2052, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.60% (5.5974 => 5.2278, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.45% (4.5424 => 4.2494, std.dev.: 0.0361)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.99% (4.2843 => 4.0278, std.dev.: 0.0442)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.30% (3.5127 => 3.3264, std.dev.: 0.0159)
  SingleSource/Benchmarks/McGill/queens: -5.29% (1.7443 => 1.6520, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.78% (3.7662 => 3.5860, std.dev.: 0.0642)
  SingleSource/Benchmarks/Shootout-C++/hash2: -4.32% (3.6768 => 3.5181, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.73% (3.5691 => 3.4360, std.dev.: 0.0502)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.63% (85.3042 => 83.9106, std.dev.: 0.0236)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.8249 => 8.6895, std.dev.: 0.0211)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3596 => 3.3180, std.dev.: 0.0083)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.23% (3.7450 => 3.6989, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.14% (6.8262 => 6.7481, std.dev.: 0.0137)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/obsequi/Obsequi: 2.03% (1.2047 => 1.2292, std.dev.: 0.1567)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.00% (0.0233 => 0.0240, std.dev.: 0.0082)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.44% (0.0451 => 0.0449, std.dev.: 0.0129)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.41% (0.0394 => 0.0353, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.83% (0.0328 => 0.0334, std.dev.: 0.0095)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.62% (0.0445 => 0.0470, std.dev.: 0.0090)
  SingleSource/UnitTests/Vector/Altivec/casts: 7.98% (0.0213 => 0.0230, std.dev.: 0.0053)
  SingleSource/UnitTests/Vector/Altivec/test1: 3.52% (0.0227 => 0.0235, std.dev.: 0.0070)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0062)
  MultiSource/Applications/Burg/burg: - (0.0015 => 0.0015, std.dev.: 0.0002)
  MultiSource/Applications/ClamAV/clamscan: -0.78% (0.1530 => 0.1518, std.dev.: 0.0250)
  MultiSource/Applications/lemon/lemon: -33.37% (1.9293 => 1.2855, std.dev.: 0.1622)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.13% (0.4049 => 0.4540, std.dev.: 0.0168)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.38% (0.1510 => 0.1459, std.dev.: 0.0067)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.60% (0.0978 => 0.0669, std.dev.: 0.0153)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.42% (0.0590 => 0.0558, std.dev.: 0.0127)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.79% (1.1617 => 1.2870, std.dev.: 0.0488)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -43.75% (0.0032 => 0.0018, std.dev.: 0.0009)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0145)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.55% (0.0268 => 0.0374, std.dev.: 0.0000)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 137.66% (0.7437 => 1.7675, std.dev.: 0.0068)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -43.48% (0.0092 => 0.0052, std.dev.: 0.0034)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 169.24% (12.7781 => 34.4043, std.dev.: 0.2570)

Report Time: 1.11s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130201/0f273654/attachment.html>


More information about the llvm-testresults mailing list