[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Apr 18 11:00:09 PDT 2013


http://llvm.org/perf/db_default/v4/nts/10769?compare_to=10766&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 10769, Order: 179761, Start Time: 2013-04-18 16:12:51, End Time: 2013-04-18 18:01:24
      To: 10766, Order: 179756, Start Time: 2013-04-18 14:07:45, End Time: 2013-04-18 15:51:53
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (13 on baseline)
Performance Regressions: 48 (99 on baseline)
Performance Improvements: 1 (50 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 19 (19 on baseline)
Unchanged Tests: 1040 (921 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 58.22% (0.0833 => 0.1318, std.dev.: 0.0065)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.75% (0.1007 => 0.1216, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.74% (1.5630 => 1.7777, std.dev.: 0.0361)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.37% (4.9203 => 5.4305, std.dev.: 0.1875)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.98% (2.5443 => 2.7981, std.dev.: 0.0462)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.50% (4.0622 => 4.4073, std.dev.: 0.0203)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.50% (25.8685 => 28.0661, std.dev.: 0.1221)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.11% (6.6327 => 7.1703, std.dev.: 0.0317)
  MultiSource/Applications/sqlite3/sqlite3: 7.96% (16.3556 => 17.6576, std.dev.: 0.1711)
  MultiSource/Benchmarks/Bullet/bullet: 7.68% (34.3672 => 37.0049, std.dev.: 0.5666)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.51% (1.5614 => 1.6787, std.dev.: 0.0394)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 6.15% (1.5258 => 1.6197, std.dev.: 0.0051)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.14% (0.9305 => 0.9876, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 6.03% (1.5217 => 1.6135, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.84% (1.7646 => 1.8677, std.dev.: 0.0389)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.33% (1.3617 => 1.4343, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.16% (1.5880 => 1.6699, std.dev.: 0.0131)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.80% (0.4649 => 0.4872, std.dev.: 0.0054)
  MultiSource/Applications/kimwitu++/kc: 4.69% (18.8669 => 19.7510, std.dev.: 0.2861)
  MultiSource/Applications/lambda-0_1_3/lambda: 4.02% (0.8151 => 0.8479, std.dev.: 0.0078)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.71% (0.2883 => 0.2990, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.48% (1.6292 => 1.6859, std.dev.: 0.0188)
  MultiSource/Applications/SPASS/SPASS: 2.51% (16.5409 => 16.9555, std.dev.: 0.0611)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.07% (1.3039 => 1.3309, std.dev.: 0.0089)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 75.67% (0.1344 => 0.2361, std.dev.: 0.0088)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.07% (4.5403 => 5.8602, std.dev.: 0.1459)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.95% (1.4745 => 1.8866, std.dev.: 0.0048)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.50% (0.0759 => 0.0907, std.dev.: 0.0027)
  MultiSource/Benchmarks/llubenchmark/llu: 11.71% (1.9887 => 2.2215, std.dev.: 0.0471)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 8.10% (3.3482 => 3.6193, std.dev.: 0.0811)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.08% (2.9395 => 3.1769, std.dev.: 0.0766)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.72% (5.0117 => 5.3987, std.dev.: 0.0223)
  SingleSource/Benchmarks/Misc/flops-7: 6.76% (1.9849 => 2.1191, std.dev.: 0.0125)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.73% (14.4061 => 15.3754, std.dev.: 0.1877)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.84% (41.8975 => 44.3434, std.dev.: 0.5180)
  SingleSource/Benchmarks/Shootout-C++/hash: 5.02% (0.7231 => 0.7594, std.dev.: 0.0093)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.52% (60.5473 => 63.2837, std.dev.: 0.5728)
  MultiSource/Applications/lua/lua: 4.25% (29.1585 => 30.3981, std.dev.: 0.0784)
  MultiSource/Benchmarks/Olden/tsp/tsp: 3.76% (1.6067 => 1.6671, std.dev.: 0.0074)
  SingleSource/Benchmarks/Misc/mandel-2: 3.39% (0.8348 => 0.8631, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.27% (2.6930 => 2.7810, std.dev.: 0.0013)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.63% (39.5389 => 40.5802, std.dev.: 0.2906)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 2.48% (85.4707 => 87.5905, std.dev.: 0.0382)
  MultiSource/Benchmarks/Olden/bh/bh: 2.24% (2.4059 => 2.4599, std.dev.: 0.0203)
  MultiSource/Applications/JM/lencod/lencod: 1.88% (6.8454 => 6.9739, std.dev.: 0.0116)
  SingleSource/Benchmarks/Misc/salsa20: 1.74% (9.4167 => 9.5804, std.dev.: 0.0571)
  MultiSource/Applications/sqlite3/sqlite3: 1.46% (4.4223 => 4.4870, std.dev.: 0.0214)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1098 => 1.1227, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.82% (7.5096 => 7.3726, std.dev.: 0.0456)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.44% (1.1331 => 1.1494, std.dev.: 0.2254)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0229 => 0.0229, std.dev.: 0.0034)
  MultiSource/Applications/ClamAV/clamscan: 1.56% (0.1470 => 0.1493, std.dev.: 0.0134)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.22% (0.1091 => 0.1137, std.dev.: 0.0181)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.18% (0.0592 => 0.0585, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.20% (0.0250 => 0.0258, std.dev.: 0.0003)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0625 => 0.0625, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.66% (0.0279 => 0.0266, std.dev.: 0.0060)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: -14.29% (0.0007 => 0.0006, std.dev.: 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0008 => 0.0008, std.dev.: 0.0002)
  SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 70.69% (0.0058 => 0.0099, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.22% (24.4935 => 24.4395, std.dev.: 0.1790)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: -23.08% (0.0013 => 0.0010, std.dev.: 0.0003)
  MultiSource/Applications/lemon/lemon: -19.92% (1.1794 => 0.9445, std.dev.: 0.2069)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.80% (0.4125 => 0.4488, std.dev.: 0.0370)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -20.66% (0.0663 => 0.0526, std.dev.: 0.0005)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.61% (1.1660 => 1.1731, std.dev.: 0.2513)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -24.36% (1.6803 => 1.2709, std.dev.: 0.0549)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.38% (29.7937 => 28.7858, std.dev.: 2.1500)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 62.92% (0.0809 => 0.1318, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 35.66% (1.1626 => 1.5772, std.dev.: 0.0731)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 33.46% (1.1744 => 1.5673, std.dev.: 0.0567)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 32.18% (1.0507 => 1.3888, std.dev.: 0.0441)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.94% (1.2723 => 1.6787, std.dev.: 0.0394)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 31.71% (1.0890 => 1.4343, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.65% (1.0687 => 1.3963, std.dev.: 0.0767)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.51% (1.0418 => 1.3597, std.dev.: 0.0263)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.25% (1.0617 => 1.3829, std.dev.: 0.1043)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.23% (1.1428 => 1.4883, std.dev.: 0.0204)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.16% (1.1209 => 1.4590, std.dev.: 0.0971)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 29.92% (1.2419 => 1.6135, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 29.75% (1.1023 => 1.4302, std.dev.: 0.0453)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 29.27% (1.1727 => 1.5160, std.dev.: 0.0342)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.15% (1.0864 => 1.4031, std.dev.: 0.0668)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.08% (1.0528 => 1.3590, std.dev.: 0.0383)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 28.76% (1.0951 => 1.4100, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.00% (1.3046 => 1.6699, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 27.78% (1.0526 => 1.3450, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 27.73% (1.4622 => 1.8677, std.dev.: 0.0389)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.57% (1.3357 => 1.7040, std.dev.: 0.0570)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 27.50% (1.2853 => 1.6387, std.dev.: 0.0426)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 27.50% (1.2704 => 1.6197, std.dev.: 0.0051)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 27.33% (0.0955 => 0.1216, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 26.58% (1.2537 => 1.5869, std.dev.: 0.0597)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 26.16% (1.1699 => 1.4759, std.dev.: 0.1051)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.23% (1.3692 => 1.7147, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 24.72% (1.3313 => 1.6604, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 24.32% (1.2925 => 1.6069, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 23.62% (1.3638 => 1.6859, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 23.21% (1.2929 => 1.5930, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 22.13% (1.4005 => 1.7105, std.dev.: 0.0821)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 17.78% (23.8286 => 28.0661, std.dev.: 0.1221)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.30% (4.8791 => 5.4305, std.dev.: 0.1875)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.82% (1.6187 => 1.7777, std.dev.: 0.0361)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.63% (2.5524 => 2.7981, std.dev.: 0.0462)
  MultiSource/Applications/sqlite3/sqlite3: 9.07% (16.1895 => 17.6576, std.dev.: 0.1711)
  MultiSource/Benchmarks/Bullet/bullet: 9.06% (33.9296 => 37.0049, std.dev.: 0.5666)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.32% (4.0688 => 4.4073, std.dev.: 0.0203)
  MultiSource/Applications/kimwitu++/kc: 7.07% (18.4474 => 19.7510, std.dev.: 0.2861)
  SingleSource/Benchmarks/Misc/ReedSolomon: 6.09% (0.2086 => 0.2213, std.dev.: 0.0046)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.04% (0.7996 => 0.8479, std.dev.: 0.0078)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.30% (0.9379 => 0.9876, std.dev.: 0.0130)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.26% (0.4673 => 0.4872, std.dev.: 0.0054)
  MultiSource/Applications/SPASS/SPASS: 3.83% (16.3304 => 16.9555, std.dev.: 0.0611)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.57% (6.9229 => 7.1703, std.dev.: 0.0317)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 3.00% (0.3598 => 0.3706, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 72.08% (0.1372 => 0.2361, std.dev.: 0.0088)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 56.18% (0.3010 => 0.4701, std.dev.: 0.0152)
  MultiSource/Benchmarks/MallocBench/gs/gs: 41.28% (0.0608 => 0.0859, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/fp-convert: 40.14% (5.6800 => 7.9602, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout-C++/methcall: 33.84% (8.6184 => 11.5350, std.dev.: 0.0402)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.36% (4.4954 => 5.8602, std.dev.: 0.1459)
  SingleSource/Benchmarks/Shootout/hash: 29.10% (4.1780 => 5.3936, std.dev.: 0.1087)
  MultiSource/Applications/lambda-0_1_3/lambda: 22.20% (6.9897 => 8.5413, std.dev.: 0.0252)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.42% (12.6632 => 15.3754, std.dev.: 0.1877)
  SingleSource/Benchmarks/Shootout-C++/matrix: 21.29% (2.8804 => 3.4937, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.49% (3.7569 => 4.4893, std.dev.: 0.2757)
  MultiSource/Benchmarks/Olden/tsp/tsp: 17.14% (1.4232 => 1.6671, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.81% (4.8478 => 5.6628, std.dev.: 0.0259)
  MultiSource/Applications/minisat/minisat: 16.14% (6.1945 => 7.1942, std.dev.: 0.3812)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.12% (0.6540 => 0.7594, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.09% (8.7510 => 9.9844, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.00% (4.5865 => 5.2284, std.dev.: 0.0218)
  SingleSource/Benchmarks/Shootout/sieve: 11.58% (6.8087 => 7.5972, std.dev.: 0.0172)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.55% (2.5283 => 2.8203, std.dev.: 0.0888)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.30% (0.1655 => 0.1842, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.11% (4.8642 => 5.4047, std.dev.: 0.0025)
  MultiSource/Benchmarks/llubenchmark/llu: 10.10% (2.0177 => 2.2215, std.dev.: 0.0471)
  SingleSource/Benchmarks/Misc/flops-7: 9.24% (1.9399 => 2.1191, std.dev.: 0.0125)
  SingleSource/Benchmarks/Misc/flops: 8.28% (9.3754 => 10.1521, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 8.13% (3.3471 => 3.6193, std.dev.: 0.0811)
  MultiSource/Applications/lua/lua: 7.91% (28.1709 => 30.3981, std.dev.: 0.0784)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.65% (2.9511 => 3.1769, std.dev.: 0.0766)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.17% (2.5458 => 2.7283, std.dev.: 0.0299)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.13% (41.3934 => 44.3434, std.dev.: 0.5180)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.71% (4.7982 => 5.1202, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/hash2: 6.35% (3.3943 => 3.6099, std.dev.: 0.0129)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.24% (59.5643 => 63.2837, std.dev.: 0.5728)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.67% (5.0818 => 5.3701, std.dev.: 0.0764)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.63% (9.0122 => 9.5196, std.dev.: 0.0182)
  SingleSource/Benchmarks/Dhrystone/fldry: 5.48% (0.6480 => 0.6835, std.dev.: 0.0012)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.14% (2.3673 => 2.4890, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.10% (5.1346 => 5.3965, std.dev.: 0.0130)
  MultiSource/Applications/sqlite3/sqlite3: 4.90% (4.2776 => 4.4870, std.dev.: 0.0214)
  MultiSource/Applications/hexxagon/hexxagon: 4.74% (14.4795 => 15.1664, std.dev.: 0.0232)
  SingleSource/Benchmarks/Misc/salsa20: 4.69% (9.1513 => 9.5804, std.dev.: 0.0571)
  SingleSource/Benchmarks/Misc/whetstone: 4.49% (3.4590 => 3.6144, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.73% (5.1006 => 5.2911, std.dev.: 0.0446)
  MultiSource/Benchmarks/Olden/bh/bh: 3.58% (2.3749 => 2.4599, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.16% (6.1397 => 6.3336, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.04% (7.1548 => 7.3726, std.dev.: 0.0456)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.91% (9.6958 => 9.9776, std.dev.: 0.0130)
  SingleSource/Benchmarks/Misc/mandel-2: 2.75% (0.8400 => 0.8631, std.dev.: 0.0074)
  MultiSource/Benchmarks/Olden/power/power: 2.49% (1.2248 => 1.2553, std.dev.: 0.0016)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.27% (2.0956 => 2.1431, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/lists: 1.40% (7.2055 => 7.3064, std.dev.: 0.0374)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.25% (1.1088 => 1.1227, std.dev.: 0.0025)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.13% (2.3310 => 2.3574, std.dev.: 0.0072)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -50.74% (0.0810 => 0.0399, std.dev.: 0.0044)
  MultiSource/Benchmarks/FreeBench/neural/neural: -19.39% (0.2542 => 0.2049, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.65% (0.1176 => 0.0992, std.dev.: 0.0029)
  SingleSource/Benchmarks/McGill/chomp: -12.77% (0.1957 => 0.1707, std.dev.: 0.0056)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.53% (0.4051 => 0.3665, std.dev.: 0.0052)
  MultiSource/Applications/lemon/lemon: -4.97% (1.2932 => 1.2289, std.dev.: 0.0192)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -67.43% (1.0845 => 0.3532, std.dev.: 0.0463)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.41% (0.3861 => 0.1374, std.dev.: 0.0021)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -56.89% (3.4380 => 1.4822, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -56.86% (3.8940 => 1.6797, std.dev.: 0.0346)
  MultiSource/Benchmarks/FreeBench/mason/mason: -44.95% (0.5213 => 0.2870, std.dev.: 0.0153)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -42.48% (0.3091 => 0.1778, std.dev.: 0.0431)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.26% (6.8267 => 4.5562, std.dev.: 0.0048)
  MultiSource/Benchmarks/mafft/pairlocalalign: -29.47% (57.5400 => 40.5824, std.dev.: 1.1926)
  MultiSource/Applications/viterbi/viterbi: -26.59% (3.4506 => 2.5330, std.dev.: 0.0284)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -25.44% (0.4520 => 0.3370, std.dev.: 0.0363)
  SingleSource/Benchmarks/Misc/perlin: -20.58% (4.5691 => 3.6288, std.dev.: 0.0292)
  SingleSource/Benchmarks/McGill/misr: -20.05% (0.4729 => 0.3781, std.dev.: 0.0081)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.48% (0.3279 => 0.2673, std.dev.: 0.0002)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -16.94% (1.9660 => 1.6329, std.dev.: 0.0332)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.47% (6.0446 => 5.0492, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -13.96% (6.7010 => 5.7656, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.53% (6.0602 => 5.3011, std.dev.: 0.0091)
  SingleSource/Benchmarks/Misc/mandel: -11.57% (1.0882 => 0.9623, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.24% (5.0054 => 4.4930, std.dev.: 0.0183)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.05% (5.8948 => 5.3026, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.81% (5.0816 => 4.6339, std.dev.: 0.0148)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.20% (0.4924 => 0.4520, std.dev.: 0.0048)
  MultiSource/Benchmarks/McCat/18-imp/imp: -7.99% (0.1465 => 0.1348, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.43% (3.3978 => 3.1454, std.dev.: 0.0245)
  SingleSource/Benchmarks/McGill/queens: -7.39% (1.7928 => 1.6603, std.dev.: 0.0116)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.37% (13.2022 => 12.2293, std.dev.: 0.0508)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.22% (9.5512 => 8.8616, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.20% (4.2970 => 3.9878, std.dev.: 0.1020)
  SingleSource/Benchmarks/Shootout/strcat: -7.19% (0.1572 => 0.1459, std.dev.: 0.0008)
  MultiSource/Applications/sgefa/sgefa: -6.27% (1.2184 => 1.1420, std.dev.: 0.0052)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.93% (3.9434 => 3.7095, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.53% (3.0513 => 2.9132, std.dev.: 0.0416)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.46% (5.7666 => 5.5096, std.dev.: 0.0410)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.42% (4.4289 => 4.2331, std.dev.: 0.0673)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.38% (3.3618 => 3.2147, std.dev.: 0.0365)
  MultiSource/Benchmarks/Olden/em3d/em3d: -4.29% (4.5899 => 4.3932, std.dev.: 0.0278)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.29% (9.0356 => 8.6484, std.dev.: 0.0176)
  SingleSource/Benchmarks/Misc/fbench: -4.19% (4.9661 => 4.7578, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.01% (5.6245 => 5.3987, std.dev.: 0.0223)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.47% (3.3922 => 3.2746, std.dev.: 0.0059)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.09% (4.3713 => 4.2362, std.dev.: 0.0391)
  MultiSource/Applications/JM/lencod/lencod: -2.52% (7.1542 => 6.9739, std.dev.: 0.0116)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.31% (35.0623 => 34.2514, std.dev.: 0.0365)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.92% (89.3093 => 87.5905, std.dev.: 0.0382)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.82% (1.1288 => 1.1494, std.dev.: 0.2254)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.66% (0.0248 => 0.0229, std.dev.: 0.0034)
  MultiSource/Applications/ClamAV/clamscan: 1.08% (0.1477 => 0.1493, std.dev.: 0.0134)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -13.14% (0.1309 => 0.1137, std.dev.: 0.0181)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.57% (0.0613 => 0.0585, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.52% (0.0276 => 0.0258, std.dev.: 0.0003)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.22% (0.0594 => 0.0625, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.32% (0.0361 => 0.0266, std.dev.: 0.0060)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002)
  SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 7.61% (0.0092 => 0.0099, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.22% (26.9213 => 24.4395, std.dev.: 0.1790)

Report Time: 1.97s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130418/87cea09e/attachment.html>


More information about the llvm-testresults mailing list