[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun May 5 23:19:33 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11332?compare_to=11329&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 11332, Order: 181179, Start Time: 2013-05-06 04:37:40, End Time: 2013-05-06 06:19:40
      To: 11329, Order: 181175, Start Time: 2013-05-06 02:31:31, End Time: 2013-05-06 04:18:37
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 0 (20 on baseline)
Performance Regressions: 7 (96 on baseline)
Performance Improvements: 18 (83 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 13 (12 on baseline)
Unchanged Tests: 1070 (890 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/constpool: 3.60% (8.5880 => 8.8974, std.dev.: 0.0250)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 23.60% (1.9242 => 2.3783, std.dev.: 0.0804)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.70% (7.2991 => 8.0074, std.dev.: 0.0759)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.68% (0.8405 => 0.8882, std.dev.: 0.0081)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.43% (2.4446 => 2.5040, std.dev.: 0.0120)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.76% (1.6110 => 1.6393, std.dev.: 0.0025)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.48% (2.5142 => 2.5514, std.dev.: 0.0135)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -23.48% (0.1137 => 0.0870, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -7.77% (2.7618 => 2.5471, std.dev.: 0.0185)
  MultiSource/Benchmarks/Olden/bh/bh: -7.00% (0.3528 => 0.3281, std.dev.: 0.0041)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -6.21% (0.1884 => 0.1767, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.56% (10.1402 => 9.5769, std.dev.: 0.1254)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.73% (0.8010 => 0.7631, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.72% (6.9350 => 6.6079, std.dev.: 0.0123)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.57% (1.9412 => 1.8524, std.dev.: 0.0023)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.62% (0.5272 => 0.5134, std.dev.: 0.0038)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.38% (4.2285 => 4.1277, std.dev.: 0.0136)
  MultiSource/Benchmarks/nbench/nbench: -2.32% (1.2953 => 1.2653, std.dev.: 0.0094)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.31% (1.6119 => 1.5747, std.dev.: 0.0092)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -25.99% (0.0704 => 0.0521, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.83% (42.9298 => 41.7128, std.dev.: 0.0765)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.54% (1.2468 => 1.2151, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -2.08% (4.0808 => 3.9960, std.dev.: 0.0189)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -1.21% (4.2548 => 4.2034, std.dev.: 0.0100)
  MultiSource/Benchmarks/Olden/bh/bh: -1.16% (2.4630 => 2.4345, std.dev.: 0.0109)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -11.77% (1.2989 => 1.1460, std.dev.: 0.0032)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lua/lua
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  MultiSource/Applications/ClamAV/clamscan: -3.94% (0.1574 => 0.1512, std.dev.: 0.0090)
  MultiSource/Applications/lua/lua: -3.39% (28.3231 => 27.3620, std.dev.: 0.5889)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.17% (0.0593 => 0.0594, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.77% (0.0260 => 0.0262, std.dev.: 0.0002)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 105.56% (0.0036 => 0.0074, std.dev.: 0.0014)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/lua/lua
  MultiSource/Applications/lua/lua: -2.87% (28.1709 => 27.3620, std.dev.: 0.5889)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.42% (0.0248 => 0.0242, std.dev.: 0.0054)
  MultiSource/Applications/Burg/burg: -23.08% (0.0013 => 0.0010, std.dev.: 0.0002)
  MultiSource/Applications/lemon/lemon: -30.61% (1.1794 => 0.8184, std.dev.: 0.2626)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.15% (0.4125 => 0.4296, std.dev.: 0.0115)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.13% (0.1309 => 0.1268, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.14% (0.0663 => 0.0556, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.96% (1.1660 => 1.3055, std.dev.: 0.0219)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.55% (0.0029 => 0.0001, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.93% (0.0027 => 0.0020, std.dev.: 0.0003)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.38% (0.0594 => 0.0568, std.dev.: 0.0073)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.27% (0.0361 => 0.0277, std.dev.: 0.0010)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -34.76% (1.6803 => 1.0962, std.dev.: 0.0504)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 700.00% (0.0001 => 0.0008)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.72% (29.7937 => 28.6862, std.dev.: 0.0039)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1100.00% (0.0001 => 0.0012)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.90% (0.0029 => 0.0031, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/Altivec/casts: 700.00% (0.0001 => 0.0008)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.40% (26.9213 => 22.7752, std.dev.: 0.5427)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 29.60% (1.1023 => 1.4286, std.dev.: 0.0341)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.72% (1.1428 => 1.4710, std.dev.: 0.0735)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.50% (1.0418 => 1.3387, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 28.22% (1.0617 => 1.3613, std.dev.: 0.0536)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.17% (1.0687 => 1.3698, std.dev.: 0.0409)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 28.02% (1.1626 => 1.4884, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.99% (1.0958 => 1.4025, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.41% (1.2270 => 1.5633, std.dev.: 0.0495)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 27.28% (1.0507 => 1.3373, std.dev.: 0.0371)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.09% (1.1209 => 1.4245, std.dev.: 0.0361)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 26.76% (1.0528 => 1.3345, std.dev.: 0.0356)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.61% (1.0864 => 1.3755, std.dev.: 0.0421)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.27% (1.0890 => 1.3751, std.dev.: 0.0246)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.81% (1.0951 => 1.3778, std.dev.: 0.0399)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.75% (1.0526 => 1.3236, std.dev.: 0.0563)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.58% (1.1699 => 1.4575, std.dev.: 0.0426)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 23.44% (1.1727 => 1.4476, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.68% (1.2537 => 1.5380, std.dev.: 0.0517)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.66% (1.2835 => 1.5743, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.62% (1.2419 => 1.5228, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 22.26% (1.3046 => 1.5950, std.dev.: 0.0438)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.25% (1.2723 => 1.5554, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 22.24% (1.2925 => 1.5800, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 22.13% (1.2929 => 1.5790, std.dev.: 0.0749)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 22.02% (1.2853 => 1.5683, std.dev.: 0.0530)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 21.75% (1.3313 => 1.6208, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 21.69% (1.3491 => 1.6417, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 21.36% (1.3692 => 1.6616, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.91% (1.2704 => 1.5360, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.36% (1.3357 => 1.6077, std.dev.: 0.0580)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.98% (1.3451 => 1.6139, std.dev.: 0.0826)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.97% (1.3638 => 1.6361, std.dev.: 0.0785)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.98% (1.4005 => 1.6663, std.dev.: 0.0467)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.51% (23.8286 => 25.8574, std.dev.: 0.4976)
  MultiSource/Benchmarks/McCat/05-eks/eks: 7.00% (0.4798 => 0.5134, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.93% (0.2511 => 0.2660, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/constpool: 4.51% (8.5132 => 8.8974, std.dev.: 0.0250)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3598 => 0.3714, std.dev.: 0.0038)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.03% (1.5284 => 1.5747, std.dev.: 0.0092)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.94% (0.9184 => 0.9454, std.dev.: 0.0040)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 2.88% (0.3887 => 0.3999, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.98% (1.5423 => 1.5728, std.dev.: 0.0059)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.97% (0.5064 => 0.5164, std.dev.: 0.0014)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.92% (4.8791 => 4.9730, std.dev.: 0.0242)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.45% (4.0688 => 4.1277, std.dev.: 0.0136)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 53.89% (0.3010 => 0.4632, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/lowercase: 46.18% (0.7986 => 1.1674, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/fp-convert: 39.78% (5.6800 => 7.9393, std.dev.: 0.0450)
  SingleSource/Benchmarks/Shootout-C++/ary2: 35.35% (0.0314 => 0.0425, std.dev.: 0.0011)
  MultiSource/Benchmarks/MallocBench/gs/gs: 34.21% (0.0608 => 0.0816, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/methcall: 34.13% (8.6184 => 11.5596, std.dev.: 0.0217)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 30.04% (1.1586 => 1.5066, std.dev.: 0.0224)
  SingleSource/Benchmarks/Shootout-C++/ary: 24.75% (0.0505 => 0.0630, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout/hash: 24.14% (4.1780 => 5.1867, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.49% (3.7569 => 4.4891, std.dev.: 0.0151)
  MultiSource/Applications/lambda-0_1_3/lambda: 19.35% (6.9897 => 8.3425, std.dev.: 0.0728)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.23% (12.6632 => 15.0985, std.dev.: 0.3233)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.03% (4.0968 => 4.8355, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.80% (4.8478 => 5.6620, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/pi: 15.95% (2.0512 => 2.3783, std.dev.: 0.0804)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.03% (8.7510 => 9.9785, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.82% (4.5865 => 5.2202, std.dev.: 0.0959)
  MultiSource/Benchmarks/Olden/tsp/tsp: 12.75% (1.4232 => 1.6046, std.dev.: 0.0641)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.92% (7.1548 => 8.0074, std.dev.: 0.0759)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.38% (2.5283 => 2.8159, std.dev.: 0.0091)
  SingleSource/Benchmarks/Shootout/sieve: 11.34% (6.8087 => 7.5811, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.86% (4.8642 => 5.3923, std.dev.: 0.0063)
  MultiSource/Applications/hexxagon/hexxagon: 8.77% (14.4795 => 15.7488, std.dev.: 0.0287)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.30% (2.4191 => 2.6199, std.dev.: 0.0499)
  SingleSource/Benchmarks/McGill/chomp: 7.91% (1.0339 => 1.1157, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.07% (2.5458 => 2.7257, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.63% (0.8330 => 0.8882, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.18% (4.7982 => 5.0945, std.dev.: 0.0137)
  SingleSource/Benchmarks/Shootout-C++/hash2: 6.15% (3.3943 => 3.6029, std.dev.: 0.0049)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.77% (2.3673 => 2.5040, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.37% (5.0818 => 5.3548, std.dev.: 0.0204)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.33% (6.2349 => 6.5670, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.87% (9.0122 => 9.4512, std.dev.: 0.0327)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.74% (2.7893 => 2.9215, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.64% (5.1346 => 5.3731, std.dev.: 0.0188)
  SingleSource/Benchmarks/Dhrystone/fldry: 4.55% (0.6480 => 0.6775, std.dev.: 0.0038)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.38% (1.0331 => 1.0783, std.dev.: 0.0116)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.21% (2.4484 => 2.5514, std.dev.: 0.0135)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.06% (23.4908 => 24.4435, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.88% (1.0374 => 1.0776, std.dev.: 0.0025)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.79% (1.0088 => 1.0470, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.35% (5.1006 => 5.2716, std.dev.: 0.0485)
  SingleSource/Benchmarks/Misc/whetstone: 3.23% (3.4590 => 3.5706, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.03% (6.1397 => 6.3259, std.dev.: 0.0281)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.95% (9.6958 => 9.9816, std.dev.: 0.0082)
  MultiSource/Benchmarks/Olden/bh/bh: 2.51% (2.3749 => 2.4345, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.89% (4.1182 => 4.1961, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.69% (1.6120 => 1.6393, std.dev.: 0.0025)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.13% (2.3310 => 2.3573, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout/fib2: 1.03% (4.9040 => 4.9545, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/ary3: 1.02% (2.0100 => 2.0306, std.dev.: 0.0037)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -50.25% (0.0810 => 0.0403, std.dev.: 0.0010)
  MultiSource/Benchmarks/FreeBench/neural/neural: -21.24% (0.2542 => 0.2002, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -20.30% (0.0803 => 0.0640, std.dev.: 0.0023)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.12% (0.0817 => 0.0669, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -15.87% (0.0895 => 0.0753, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -15.84% (0.0985 => 0.0829, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.48% (0.1176 => 0.0994, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -14.67% (0.0893 => 0.0762, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -13.29% (0.0858 => 0.0744, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -12.93% (0.0789 => 0.0687, std.dev.: 0.0004)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -12.51% (0.1495 => 0.1308, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -12.17% (0.0937 => 0.0823, std.dev.: 0.0020)
  SingleSource/Benchmarks/McGill/chomp: -11.91% (0.1957 => 0.1724, std.dev.: 0.0020)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.44% (0.4051 => 0.3628, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.15% (0.3438 => 0.3261, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.55% (6.9229 => 6.6079, std.dev.: 0.0123)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.39% (0.7818 => 0.7631, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -73.03% (1.0845 => 0.2925, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.34% (0.3861 => 0.1377, std.dev.: 0.0007)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.55% (3.4380 => 1.4593, std.dev.: 0.0030)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -57.05% (3.8940 => 1.6726, std.dev.: 0.0034)
  MultiSource/Benchmarks/FreeBench/mason/mason: -46.50% (0.5213 => 0.2789, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -42.48% (0.3091 => 0.1778, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.48% (6.8267 => 4.5410, std.dev.: 0.0107)
  MultiSource/Applications/viterbi/viterbi: -27.01% (3.4506 => 2.5185, std.dev.: 0.0203)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.93% (0.4111 => 0.3004, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -26.39% (0.4520 => 0.3327, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.91% (0.4368 => 0.3280, std.dev.: 0.0060)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -24.43% (0.1789 => 0.1352, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout/ary3: -24.32% (8.2895 => 6.2735, std.dev.: 0.3821)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -22.97% (0.2316 => 0.1784, std.dev.: 0.0000)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -22.34% (0.1871 => 0.1453, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.89% (0.3279 => 0.2594, std.dev.: 0.0059)
  SingleSource/Benchmarks/Misc/perlin: -20.77% (4.5691 => 3.6199, std.dev.: 0.0050)
  MultiSource/Benchmarks/mafft/pairlocalalign: -19.73% (57.5400 => 46.1868, std.dev.: 0.2500)
  SingleSource/Benchmarks/McGill/misr: -19.71% (0.4729 => 0.3797, std.dev.: 0.0159)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -17.26% (1.9660 => 1.6267, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.79% (6.0446 => 5.0298, std.dev.: 0.1005)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -15.11% (3.5506 => 3.0141, std.dev.: 0.1341)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -14.24% (6.7010 => 5.7471, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.60% (6.0602 => 5.2966, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc/mandel: -12.55% (1.0882 => 0.9516, std.dev.: 0.0069)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -11.03% (4.7243 => 4.2034, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.37% (5.0054 => 4.4864, std.dev.: 0.0269)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.35% (5.8948 => 5.2849, std.dev.: 0.0136)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -9.65% (1.3761 => 1.2433, std.dev.: 0.0501)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -9.01% (5.0816 => 4.6236, std.dev.: 0.0117)
  MultiSource/Benchmarks/McCat/18-imp/imp: -8.94% (0.1465 => 0.1334, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -8.24% (4.2970 => 3.9430, std.dev.: 0.0718)
  SingleSource/Benchmarks/McGill/queens: -8.04% (1.7928 => 1.6486, std.dev.: 0.0136)
  SingleSource/Benchmarks/Shootout/strcat: -7.89% (0.1572 => 0.1448, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.63% (3.3978 => 3.1386, std.dev.: 0.0075)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.51% (13.2022 => 12.2107, std.dev.: 0.0500)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.37% (9.5512 => 8.8471, std.dev.: 0.0686)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.03% (0.4924 => 0.4578, std.dev.: 0.0031)
  SingleSource/Benchmarks/Linpack/linpack-pc: -6.34% (52.8418 => 49.4910, std.dev.: 1.0181)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.89% (0.5182 => 0.4877, std.dev.: 0.0117)
  MultiSource/Applications/sgefa/sgefa: -5.86% (1.2184 => 1.1470, std.dev.: 0.0144)
  SingleSource/Benchmarks/Dhrystone/dry: -5.65% (0.5278 => 0.4980, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -5.21% (0.2167 => 0.2054, std.dev.: 0.0007)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -5.17% (1.5779 => 1.4963, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.14% (3.9434 => 3.7409, std.dev.: 0.0466)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.74% (3.0513 => 2.9066, std.dev.: 0.0454)
  SingleSource/Benchmarks/Misc/fbench: -4.66% (4.9661 => 4.7347, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.65% (3.3618 => 3.2055, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.65% (5.7666 => 5.4985, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.39% (4.4289 => 4.2345, std.dev.: 0.0445)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.28% (5.6245 => 5.3838, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.09% (3.3922 => 3.2535, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.25% (4.3713 => 4.2292, std.dev.: 0.0461)
  SingleSource/Benchmarks/Shootout/heapsort: -3.16% (3.1404 => 3.0411, std.dev.: 0.0121)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.05% (0.8122 => 0.7874, std.dev.: 0.0090)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.89% (3.8286 => 3.7179, std.dev.: 0.0010)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.66% (1.2483 => 1.2151, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.57% (2.7587 => 2.6878, std.dev.: 0.0175)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.41% (5.6426 => 5.5065, std.dev.: 0.0153)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.33% (35.0623 => 34.2450, std.dev.: 0.0025)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.22% (6.7917 => 6.6412, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/flops-3: -1.94% (2.0809 => 2.0406, std.dev.: 0.0032)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.49% (1.3158 => 1.2962, std.dev.: 0.0005)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.26% (89.3093 => 88.1860, std.dev.: 0.3885)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.16% (3.6942 => 3.6512, std.dev.: 0.0052)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.01% (1.1828 => 1.1708, std.dev.: 0.0002)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.52% (1.1288 => 1.1460, std.dev.: 0.0032)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  MultiSource/Applications/ClamAV/clamscan: 2.37% (0.1477 => 0.1512, std.dev.: 0.0090)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.10% (0.0613 => 0.0594, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.07% (0.0276 => 0.0262, std.dev.: 0.0002)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -19.57% (0.0092 => 0.0074, std.dev.: 0.0014)

Report Time: 1.15s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130506/4521a556/attachment.html>


More information about the llvm-testresults mailing list