[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed May 1 12:30:17 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11203?compare_to=11201&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 11203, Order: 180853, Start Time: 2013-05-01 17:42:44, End Time: 2013-05-01 19:30:19
      To: 11201, Order: 180852, Start Time: 2013-05-01 15:40:58, End Time: 2013-05-01 17:22:32
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 0 (20 on baseline)
Performance Regressions: 32 (94 on baseline)
Performance Improvements: 2 (63 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 13 (12 on baseline)
Unchanged Tests: 1061 (912 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/byval-alignment: 61.14% (0.0175 => 0.0282, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-07-09-SignedArgs: 60.73% (0.0275 => 0.0442, std.dev.: 0.0024)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 35.85% (0.2547 => 0.3460, std.dev.: 0.0280)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.79% (0.0779 => 0.0902, std.dev.: 0.0017)
  MultiSource/Applications/hbd/hbd: 12.14% (1.5786 => 1.7702, std.dev.: 0.0066)
  MultiSource/Applications/sqlite3/sqlite3: 7.46% (16.3237 => 17.5410, std.dev.: 0.1591)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.22% (1.6616 => 1.7815, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.66% (1.3396 => 1.4288, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.58% (1.4493 => 1.5446, std.dev.: 0.0201)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.18% (10.1144 => 10.7393, std.dev.: 0.2128)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.14% (44.4998 => 47.2311, std.dev.: 1.0146)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.98% (1.4566 => 1.5437, std.dev.: 0.0331)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.97% (25.6638 => 27.1963, std.dev.: 0.3924)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.96% (1.3598 => 1.4409, std.dev.: 0.0092)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.87% (0.2776 => 0.2939, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.73% (1.3725 => 1.4511, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.59% (1.6304 => 1.7216, std.dev.: 0.0190)
  MultiSource/Applications/d/make_dparser: 5.47% (3.5683 => 3.7635, std.dev.: 0.0511)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.35% (1.3767 => 1.4503, std.dev.: 0.0101)
  MultiSource/Applications/kimwitu++/kc: 4.70% (18.7737 => 19.6562, std.dev.: 0.2996)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.81% (1.6152 => 1.6767, std.dev.: 0.0195)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 41.40% (1.5110 => 2.1365, std.dev.: 0.0353)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.02% (0.0769 => 0.0946, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/ary: 17.90% (0.0609 => 0.0718, std.dev.: 0.0006)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 13.59% (8.9401 => 10.1553, std.dev.: 0.1938)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.49% (28.4700 => 31.7406, std.dev.: 0.9522)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 10.09% (0.4320 => 0.4756, std.dev.: 0.0093)
  SingleSource/Benchmarks/Dhrystone/dry: 8.82% (0.4945 => 0.5381, std.dev.: 0.0045)
  MultiSource/Benchmarks/FreeBench/distray/distray: 7.50% (0.2186 => 0.2350, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout/methcall: 1.57% (8.3492 => 8.4799, std.dev.: 0.0361)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.48% (4.2318 => 4.2946, std.dev.: 0.0161)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.00% (22.8588 => 23.0884, std.dev.: 0.0143)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/pi: -15.55% (2.2874 => 1.9317, std.dev.: 0.0580)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.39% (7.8437 => 7.4212, std.dev.: 0.0947)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.09% (1.1326 => 1.1450, std.dev.: 0.0891)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lua/lua
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  MultiSource/Applications/ClamAV/clamscan: 1.75% (0.1487 => 0.1513, std.dev.: 0.0377)
  MultiSource/Applications/lua/lua: 2.20% (27.4695 => 28.0737, std.dev.: 0.2103)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 800.00% (0.0001 => 0.0009, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.21% (0.0548 => 0.0593, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.44% (0.0264 => 0.0247, std.dev.: 0.0007)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -19.35% (0.0062 => 0.0050, std.dev.: 0.0046)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/lua/lua
  MultiSource/Applications/lua/lua: -0.35% (28.1709 => 28.0737, std.dev.: 0.2103)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.21% (0.0248 => 0.0245, std.dev.: 0.0027)
  MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0000)
  MultiSource/Applications/lemon/lemon: -7.66% (1.1794 => 1.0890, std.dev.: 0.1616)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.30% (0.4125 => 0.4756, std.dev.: 0.0093)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.71% (0.1309 => 0.1195, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.03% (0.0663 => 0.0623, std.dev.: 0.0073)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.98% (1.1660 => 1.3174, std.dev.: 0.0311)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 10.34% (0.0029 => 0.0032, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.05% (0.0594 => 0.0564, std.dev.: 0.0039)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.21% (0.0361 => 0.0270, std.dev.: 0.0074)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -32.95% (1.6803 => 1.1267, std.dev.: 0.0156)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.53% (29.7937 => 31.7406, std.dev.: 0.9522)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 68.97% (0.0029 => 0.0049, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -14.24% (26.9213 => 23.0884, std.dev.: 0.0143)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/byval-alignment: 59.32% (0.0177 => 0.0282, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-07-09-SignedArgs: 56.74% (0.0282 => 0.0442, std.dev.: 0.0024)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 39.57% (0.2479 => 0.3460, std.dev.: 0.0280)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 36.40% (1.0687 => 1.4577, std.dev.: 0.0660)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.99% (1.0507 => 1.4288, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.72% (1.0617 => 1.4409, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 35.16% (1.1428 => 1.5446, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 35.03% (1.0958 => 1.4797, std.dev.: 0.0588)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 34.26% (1.1626 => 1.5609, std.dev.: 0.0792)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 33.57% (1.0864 => 1.4511, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 33.44% (1.0528 => 1.4049, std.dev.: 0.0866)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 32.88% (1.0526 => 1.3987, std.dev.: 0.0342)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 32.44% (1.0951 => 1.4503, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 32.10% (1.1744 => 1.5514, std.dev.: 0.0556)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 31.95% (1.1699 => 1.5437, std.dev.: 0.0331)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 30.25% (1.1023 => 1.4357, std.dev.: 0.0444)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 29.65% (1.1209 => 1.4532, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.91% (1.2270 => 1.5817, std.dev.: 0.0924)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.80% (1.3692 => 1.7498, std.dev.: 0.0389)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.20% (1.4005 => 1.7815, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 26.72% (1.3357 => 1.6926, std.dev.: 0.0622)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 26.71% (1.2537 => 1.5886, std.dev.: 0.0829)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.63% (1.1727 => 1.4850, std.dev.: 0.0707)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 26.24% (1.3638 => 1.7216, std.dev.: 0.0190)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 26.23% (1.2566 => 1.5862, std.dev.: 0.0976)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.95% (1.0890 => 1.3716, std.dev.: 0.0347)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.94% (1.3313 => 1.6767, std.dev.: 0.0195)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 25.20% (1.2853 => 1.6092, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 24.82% (1.3046 => 1.6284, std.dev.: 0.0727)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 24.33% (1.2723 => 1.5819, std.dev.: 0.0656)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 24.31% (1.2835 => 1.5955, std.dev.: 0.0321)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 23.63% (1.2929 => 1.5984, std.dev.: 0.0340)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.27% (1.4622 => 1.8024, std.dev.: 0.0335)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.69% (1.2925 => 1.5729, std.dev.: 0.0840)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.41% (1.2704 => 1.5424, std.dev.: 0.0395)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.37% (1.3451 => 1.6325, std.dev.: 0.0536)
  MultiSource/Applications/hbd/hbd: 15.65% (1.5307 => 1.7702, std.dev.: 0.0066)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.13% (23.8286 => 27.1963, std.dev.: 0.3924)
  MultiSource/Applications/sqlite3/sqlite3: 8.35% (16.1895 => 17.5410, std.dev.: 0.1591)
  MultiSource/Applications/kimwitu++/kc: 6.55% (18.4474 => 19.6562, std.dev.: 0.2996)
  MultiSource/Applications/d/make_dparser: 6.45% (3.5353 => 3.7635, std.dev.: 0.0511)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.18% (0.2768 => 0.2939, std.dev.: 0.0017)
  MultiSource/Benchmarks/Bullet/bullet: 4.68% (33.9296 => 35.5179, std.dev.: 0.5435)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 54.75% (0.3010 => 0.4658, std.dev.: 0.0129)
  SingleSource/Benchmarks/Misc/lowercase: 46.89% (0.7986 => 1.1731, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/ary: 42.18% (0.0505 => 0.0718, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/fp-convert: 39.83% (5.6800 => 7.9422, std.dev.: 0.0250)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 36.07% (1.5701 => 2.1365, std.dev.: 0.0353)
  SingleSource/Benchmarks/Shootout-C++/methcall: 31.28% (8.6184 => 11.3144, std.dev.: 0.1514)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 30.13% (1.1586 => 1.5077, std.dev.: 0.0018)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.70% (12.6632 => 15.9177, std.dev.: 0.1869)
  SingleSource/Benchmarks/Shootout/hash: 24.49% (4.1780 => 5.2010, std.dev.: 0.1587)
  SingleSource/Benchmarks/Shootout-C++/matrix: 21.46% (2.8804 => 3.4984, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.69% (3.7569 => 4.4967, std.dev.: 0.0174)
  MultiSource/Applications/lambda-0_1_3/lambda: 19.59% (6.9897 => 8.3592, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.38% (4.0968 => 4.8499, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.07% (4.8478 => 5.6753, std.dev.: 0.0853)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.91% (4.5865 => 5.2704, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.21% (8.7510 => 9.9947, std.dev.: 0.0191)
  SingleSource/Benchmarks/Misc/salsa20: 12.60% (9.1513 => 10.3041, std.dev.: 0.0210)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.81% (2.5283 => 2.8269, std.dev.: 0.0240)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.55% (9.1037 => 10.1553, std.dev.: 0.1938)
  SingleSource/Benchmarks/Shootout/sieve: 11.42% (6.8087 => 7.5864, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.10% (4.8642 => 5.4040, std.dev.: 0.1126)
  SingleSource/Benchmarks/Shootout-C++/hash: 10.67% (0.6540 => 0.7238, std.dev.: 0.0168)
  SingleSource/Benchmarks/Shootout/matrix: 10.29% (1.5499 => 1.7094, std.dev.: 0.0119)
  MultiSource/Applications/hexxagon/hexxagon: 9.21% (14.4795 => 15.8125, std.dev.: 0.1068)
  SingleSource/Benchmarks/McGill/chomp: 8.36% (1.0339 => 1.1203, std.dev.: 0.0298)
  SingleSource/Benchmarks/Misc/flops: 8.15% (9.3754 => 10.1396, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.84% (2.5458 => 2.7454, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.61% (4.7982 => 5.1155, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout-C++/hash2: 6.34% (3.3943 => 3.6094, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.08% (9.0122 => 9.5598, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.13% (5.1346 => 5.3979, std.dev.: 0.0021)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.11% (2.7893 => 2.9319, std.dev.: 0.0098)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.92% (6.2349 => 6.5417, std.dev.: 0.0169)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.38% (2.3673 => 2.4710, std.dev.: 0.0304)
  MultiSource/Benchmarks/Olden/bh/bh: 4.18% (2.3749 => 2.4742, std.dev.: 0.0323)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.17% (23.4908 => 24.4711, std.dev.: 0.0161)
  SingleSource/Benchmarks/Misc/whetstone: 4.13% (3.4590 => 3.6017, std.dev.: 0.0067)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.87% (1.0088 => 1.0478, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.84% (5.1006 => 5.2963, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.72% (7.1548 => 7.4212, std.dev.: 0.0947)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.55% (1.0374 => 1.0742, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.19% (6.1397 => 6.3358, std.dev.: 0.0405)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.06% (9.6958 => 9.9923, std.dev.: 0.0145)
  MultiSource/Applications/aha/aha: 2.53% (3.4994 => 3.5879, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.39% (1.4499 => 1.4846, std.dev.: 0.0021)
  MultiSource/Benchmarks/Olden/power/power: 2.36% (1.2248 => 1.2537, std.dev.: 0.0006)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.19% (2.0956 => 2.1414, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout-C++/ary3: 1.46% (2.0100 => 2.0393, std.dev.: 0.0026)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.14% (2.3310 => 2.3575, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.12% (1.3414 => 1.3564, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.04% (3.4522 => 3.4881, std.dev.: 0.0043)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -44.20% (0.0810 => 0.0452, std.dev.: 0.0011)
  MultiSource/Benchmarks/FreeBench/neural/neural: -20.93% (0.2542 => 0.2010, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -16.19% (0.0803 => 0.0673, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -15.87% (0.0895 => 0.0753, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -15.79% (0.0893 => 0.0752, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -12.22% (0.0908 => 0.0797, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -11.63% (0.0937 => 0.0828, std.dev.: 0.0004)
  SingleSource/Benchmarks/Linpack/linpack-pc: -8.14% (0.2751 => 0.2527, std.dev.: 0.0053)
  MultiSource/Applications/sgefa/sgefa: -4.15% (0.4027 => 0.3860, std.dev.: 0.0031)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -72.95% (1.0845 => 0.2934, std.dev.: 0.0456)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.05% (0.3861 => 0.1388, std.dev.: 0.0030)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.08% (3.4380 => 1.4757, std.dev.: 0.0008)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -56.90% (3.8940 => 1.6785, std.dev.: 0.0794)
  MultiSource/Benchmarks/FreeBench/mason/mason: -45.06% (0.5213 => 0.2864, std.dev.: 0.0468)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -42.51% (0.3091 => 0.1777, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.35% (6.8267 => 4.5498, std.dev.: 0.0072)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -28.83% (0.4520 => 0.3217, std.dev.: 0.0166)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.95% (0.4111 => 0.3003, std.dev.: 0.0079)
  MultiSource/Applications/viterbi/viterbi: -26.34% (3.4506 => 2.5416, std.dev.: 0.0501)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.89% (0.4368 => 0.3281, std.dev.: 0.0053)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -23.53% (0.2316 => 0.1771, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -22.66% (0.1871 => 0.1447, std.dev.: 0.0083)
  SingleSource/Benchmarks/Misc/perlin: -20.52% (4.5691 => 3.6315, std.dev.: 0.0027)
  MultiSource/Benchmarks/mafft/pairlocalalign: -19.67% (57.5400 => 46.2211, std.dev.: 0.4627)
  SingleSource/Benchmarks/McGill/misr: -18.69% (0.4729 => 0.3845, std.dev.: 0.0057)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -16.66% (1.9660 => 1.6384, std.dev.: 0.0539)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.66% (6.0446 => 5.0377, std.dev.: 0.0958)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.34% (6.4626 => 5.4068, std.dev.: 0.1081)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -13.88% (6.7010 => 5.7712, std.dev.: 0.0099)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -13.78% (3.5506 => 3.0613, std.dev.: 0.1040)
  SingleSource/Benchmarks/Misc/mandel: -12.41% (1.0882 => 0.9532, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.38% (6.0602 => 5.3102, std.dev.: 0.0318)
  SingleSource/Benchmarks/Stanford/Puzzle: -11.58% (0.1650 => 0.1459, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.15% (5.0054 => 4.4976, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.08% (5.8948 => 5.3008, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.86% (5.0816 => 4.6315, std.dev.: 0.0065)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.29% (0.4924 => 0.4516, std.dev.: 0.0029)
  SingleSource/Benchmarks/McGill/queens: -7.69% (1.7928 => 1.6549, std.dev.: 0.0051)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.48% (9.5512 => 8.8365, std.dev.: 0.0594)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.45% (13.2022 => 12.2185, std.dev.: 0.0408)
  SingleSource/Benchmarks/Shootout/strcat: -7.38% (0.1572 => 0.1456, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.21% (3.3978 => 3.1527, std.dev.: 0.0766)
  MultiSource/Applications/sgefa/sgefa: -6.02% (1.2184 => 1.1451, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.03% (3.9434 => 3.7452, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.71% (3.0513 => 2.9077, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/fbench: -4.59% (4.9661 => 4.7382, std.dev.: 0.0117)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -4.59% (1.5779 => 1.5055, std.dev.: 0.0074)
  MultiSource/Benchmarks/Olden/em3d/em3d: -4.50% (4.5899 => 4.3834, std.dev.: 0.0440)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.42% (5.7666 => 5.5118, std.dev.: 0.0090)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.42% (9.0356 => 8.6365, std.dev.: 0.0944)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.20% (5.6245 => 5.3883, std.dev.: 0.0900)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.19% (3.3618 => 3.2211, std.dev.: 0.0207)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.99% (3.3922 => 3.2569, std.dev.: 0.0189)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.31% (4.3713 => 4.2266, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.03% (4.4289 => 4.2946, std.dev.: 0.0161)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.92% (3.8286 => 3.7169, std.dev.: 0.0039)
  SingleSource/Benchmarks/Linpack/linpack-pc: -2.66% (52.8418 => 51.4374, std.dev.: 0.2644)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.17% (6.7917 => 6.6441, std.dev.: 0.0070)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.11% (35.0623 => 34.3233, std.dev.: 0.1099)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.49% (1.3158 => 1.2962, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/flops-3: -1.41% (2.0809 => 2.0515, std.dev.: 0.0012)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.18% (89.3093 => 88.2547, std.dev.: 0.0293)
  MultiSource/Benchmarks/sim/sim: -1.11% (3.8564 => 3.8135, std.dev.: 0.0042)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.44% (1.1288 => 1.1450, std.dev.: 0.0891)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  MultiSource/Applications/ClamAV/clamscan: 2.44% (0.1477 => 0.1513, std.dev.: 0.0377)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.26% (0.0613 => 0.0593, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.51% (0.0276 => 0.0247, std.dev.: 0.0007)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -45.65% (0.0092 => 0.0050, std.dev.: 0.0046)

Report Time: 0.84s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130501/80033cf4/attachment.html>


More information about the llvm-testresults mailing list