[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Apr 22 14:12:57 PDT 2013


http://llvm.org/perf/db_default/v4/nts/10910?compare_to=10908&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 10910, Order: 180034, Start Time: 2013-04-22 19:24:36, End Time: 2013-04-22 21:14:17
      To: 10908, Order: 180026, Start Time: 2013-04-22 17:16:31, End Time: 2013-04-22 19:01:19
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 0 (13 on baseline)
Performance Regressions: 49 (103 on baseline)
Performance Improvements: 2 (56 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 20 (19 on baseline)
Unchanged Tests: 1037 (910 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/methcall: 68.26% (0.0334 => 0.0562, std.dev.: 0.0036)
  SingleSource/Benchmarks/Stanford/Queens: 66.51% (0.0427 => 0.0711, std.dev.: 0.0030)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 63.98% (0.0161 => 0.0264, std.dev.: 0.0011)
  SingleSource/Benchmarks/SmallPT/smallpt: 59.93% (0.1405 => 0.2247, std.dev.: 0.0138)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 56.54% (0.0260 => 0.0407, std.dev.: 0.0021)
  SingleSource/Regression/C/DuffsDevice: 55.92% (0.0245 => 0.0382, std.dev.: 0.0023)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 51.34% (0.1718 => 0.2600, std.dev.: 0.0114)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.40% (0.0966 => 0.1192, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.78% (0.0776 => 0.0914, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.04% (1.3649 => 1.5156, std.dev.: 0.0327)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.64% (1.4121 => 1.5482, std.dev.: 0.0396)
  MultiSource/Applications/siod/siod: 8.64% (2.4188 => 2.6278, std.dev.: 0.0496)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.27% (44.7677 => 48.0209, std.dev.: 0.9194)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.12% (1.4518 => 1.5552, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.91% (1.4008 => 1.4976, std.dev.: 0.0366)
  MultiSource/Applications/SPASS/SPASS: 6.22% (16.3900 => 17.4087, std.dev.: 0.2646)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 6.12% (1.5271 => 1.6206, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.45% (1.6541 => 1.7443, std.dev.: 0.0283)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.16% (0.6915 => 0.7272, std.dev.: 0.0048)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.37% (0.5153 => 0.5378, std.dev.: 0.0048)
  MultiSource/Benchmarks/Bullet/bullet: 4.34% (34.7143 => 36.2195, std.dev.: 0.1143)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 3.03% (0.5150 => 0.5306, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.37% (0.9369 => 0.9591, std.dev.: 0.0007)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 53.59% (7.1396 => 10.9654, std.dev.: 0.2613)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 38.08% (3.4905 => 4.8197, std.dev.: 0.3659)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 37.47% (1.5245 => 2.0958, std.dev.: 0.1346)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.57% (4.1244 => 4.8079, std.dev.: 0.0158)
  MultiSource/Applications/SPASS/SPASS: 15.18% (8.2874 => 9.5452, std.dev.: 0.1423)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.96% (2.9492 => 3.2135, std.dev.: 0.0223)
  SingleSource/Benchmarks/Shootout/hash: 7.61% (5.1532 => 5.5455, std.dev.: 0.0382)
  SingleSource/Benchmarks/Misc/flops-7: 7.59% (1.9542 => 2.1025, std.dev.: 0.0381)
  SingleSource/Benchmarks/Misc/pi: 7.30% (1.8653 => 2.0015, std.dev.: 0.0235)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.42% (15.1460 => 16.1181, std.dev.: 0.1896)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.32% (2.0655 => 2.1754, std.dev.: 0.0078)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.04% (41.5947 => 43.6897, std.dev.: 0.7431)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.74% (59.7372 => 62.5716, std.dev.: 0.3438)
  MultiSource/Benchmarks/FreeBench/distray/distray: 4.60% (0.2259 => 0.2363, std.dev.: 0.0023)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.16% (39.5733 => 41.2201, std.dev.: 0.5544)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.54% (91.8627 => 95.1150, std.dev.: 0.8887)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.39% (3.9888 => 4.1241, std.dev.: 0.0219)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.74% (4.0166 => 4.1267, std.dev.: 0.0370)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.09% (4.1301 => 4.2166, std.dev.: 0.0210)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.95% (51.0715 => 52.0688, std.dev.: 0.0292)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.95% (4.0544 => 4.1335, std.dev.: 0.0246)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.59% (2.1324 => 2.1664, std.dev.: 0.0074)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.51% (11.4800 => 11.6536, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.19% (4.4214 => 4.4742, std.dev.: 0.0173)
  MultiSource/Applications/sqlite3/sqlite3: 1.07% (4.4180 => 4.4651, std.dev.: 0.0181)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.03% (1.0712 => 1.0822, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -7.05% (0.1915 => 0.1780, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.71% (3.7031 => 3.5658, std.dev.: 0.0419)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.14% (1.1384 => 1.1514, std.dev.: 0.1544)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lua/lua
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.41% (0.0243 => 0.0225, std.dev.: 0.0016)
  MultiSource/Applications/ClamAV/clamscan: -0.33% (0.1508 => 0.1503, std.dev.: 0.0024)
  MultiSource/Applications/lua/lua: 1.32% (27.3879 => 27.7499, std.dev.: 0.1953)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.77% (0.1151 => 0.1275, std.dev.: 0.0174)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 49.83% (0.0592 => 0.0887, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.05% (0.0262 => 0.0254, std.dev.: 0.0032)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.28% (0.0627 => 0.0635, std.dev.: 0.0090)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.17% (0.0277 => 0.0271, std.dev.: 0.0033)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -75.00% (0.0008 => 0.0002, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 900.00% (0.0001 => 0.0010, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -50.00% (0.0002 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -25.76% (0.0066 => 0.0049, std.dev.: 0.0062)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.46% (22.9968 => 22.8902, std.dev.: 0.0519)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/lua/lua
  MultiSource/Applications/lua/lua: -1.49% (28.1709 => 27.7499, std.dev.: 0.1953)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: 15.38% (0.0013 => 0.0015, std.dev.: 0.0002)
  MultiSource/Applications/lemon/lemon: -20.35% (1.1794 => 0.9394, std.dev.: 0.2449)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 11.15% (0.4125 => 0.4585, std.dev.: 0.1194)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.35% (0.0663 => 0.0548, std.dev.: 0.0133)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.96% (1.1660 => 1.3171, std.dev.: 0.0080)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -33.56% (1.6803 => 1.1164, std.dev.: 0.0289)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.75% (29.7937 => 30.3149, std.dev.: 1.7186)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/DuffsDevice: 71.30% (0.0223 => 0.0382, std.dev.: 0.0023)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 67.49% (0.0243 => 0.0407, std.dev.: 0.0021)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 62.96% (0.0162 => 0.0264, std.dev.: 0.0011)
  SingleSource/Benchmarks/Stanford/Queens: 62.70% (0.0437 => 0.0711, std.dev.: 0.0030)
  SingleSource/Benchmarks/SmallPT/smallpt: 61.54% (0.1391 => 0.2247, std.dev.: 0.0138)
  SingleSource/Benchmarks/Shootout/methcall: 58.76% (0.0354 => 0.0562, std.dev.: 0.0036)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 52.40% (0.1706 => 0.2600, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 42.69% (1.0890 => 1.5539, std.dev.: 0.1029)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 39.51% (1.0864 => 1.5156, std.dev.: 0.0327)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 38.65% (1.0507 => 1.4568, std.dev.: 0.0700)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 38.12% (1.1209 => 1.5482, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 37.59% (1.0687 => 1.4704, std.dev.: 0.0986)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 37.31% (1.0958 => 1.5046, std.dev.: 0.0848)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 37.26% (0.2112 => 0.2899, std.dev.: 0.0283)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.92% (1.0617 => 1.4537, std.dev.: 0.0419)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 35.96% (1.1428 => 1.5538, std.dev.: 0.0476)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 35.93% (1.1626 => 1.5803, std.dev.: 0.0542)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 35.86% (1.1023 => 1.4976, std.dev.: 0.0366)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.63% (1.0528 => 1.4279, std.dev.: 0.0427)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 35.59% (1.2270 => 1.6637, std.dev.: 0.1665)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.85% (1.1744 => 1.5837, std.dev.: 0.0504)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.93% (1.1699 => 1.5552, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.19% (1.1727 => 1.5385, std.dev.: 0.0972)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 27.57% (1.2704 => 1.6206, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 26.81% (1.2566 => 1.5935, std.dev.: 0.0956)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.58% (1.2419 => 1.5720, std.dev.: 0.0997)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 26.48% (1.3491 => 1.7063, std.dev.: 0.1207)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 26.29% (1.2723 => 1.6068, std.dev.: 0.0560)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 25.79% (1.2537 => 1.5770, std.dev.: 0.0312)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 25.70% (1.3046 => 1.6399, std.dev.: 0.0830)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.42% (1.3313 => 1.6697, std.dev.: 0.1023)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 25.06% (1.2853 => 1.6074, std.dev.: 0.0855)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.82% (1.3692 => 1.7091, std.dev.: 0.0648)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.82% (0.0955 => 0.1192, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 24.71% (1.2929 => 1.6124, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 24.55% (1.4005 => 1.7443, std.dev.: 0.0283)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 24.28% (1.3357 => 1.6600, std.dev.: 0.0704)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 24.06% (1.2925 => 1.6035, std.dev.: 0.0541)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 23.83% (1.3451 => 1.6657, std.dev.: 0.0525)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 23.08% (1.3638 => 1.6785, std.dev.: 0.0607)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.89% (23.8286 => 26.6621, std.dev.: 0.3440)
  MultiSource/Applications/siod/siod: 8.60% (2.4196 => 2.6278, std.dev.: 0.0496)
  MultiSource/Benchmarks/Bullet/bullet: 6.75% (33.9296 => 36.2195, std.dev.: 0.1143)
  MultiSource/Applications/SPASS/SPASS: 6.60% (16.3304 => 17.4087, std.dev.: 0.2646)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.20% (0.5064 => 0.5378, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/wc: 4.70% (0.2275 => 0.2382, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.43% (0.9184 => 0.9591, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.12% (0.6984 => 0.7272, std.dev.: 0.0048)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 48.38% (3.2482 => 4.8197, std.dev.: 0.3659)
  SingleSource/Benchmarks/Misc/lowercase: 48.12% (0.7986 => 1.1829, std.dev.: 0.0718)
  SingleSource/Benchmarks/Misc/fp-convert: 40.02% (5.6800 => 7.9531, std.dev.: 0.0607)
  SingleSource/Benchmarks/Shootout-C++/ary2: 38.85% (0.0314 => 0.0436, std.dev.: 0.0017)
  MultiSource/Benchmarks/MallocBench/gs/gs: 37.01% (0.0608 => 0.0833, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout-C++/methcall: 35.22% (8.6184 => 11.6536, std.dev.: 0.0054)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 33.48% (1.5701 => 2.0958, std.dev.: 0.1346)
  SingleSource/Benchmarks/Shootout-C++/ary: 33.27% (0.0505 => 0.0673, std.dev.: 0.0061)
  SingleSource/Benchmarks/Shootout/hash: 32.73% (4.1780 => 5.5455, std.dev.: 0.0382)
  SingleSource/Benchmarks/Shootout/ary3: 32.28% (8.2895 => 10.9654, std.dev.: 0.2613)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 30.11% (1.1586 => 1.5075, std.dev.: 0.0225)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 27.28% (12.6632 => 16.1181, std.dev.: 0.1896)
  SingleSource/Benchmarks/Shootout-C++/matrix: 21.35% (2.8804 => 3.4954, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.56% (3.7569 => 4.4917, std.dev.: 0.0033)
  MultiSource/Applications/lambda-0_1_3/lambda: 19.36% (6.9897 => 8.3429, std.dev.: 0.0446)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.84% (4.8478 => 5.6642, std.dev.: 0.0554)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.83% (4.5865 => 5.2667, std.dev.: 0.2466)
  MultiSource/Benchmarks/Olden/tsp/tsp: 14.43% (1.4232 => 1.6286, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.21% (8.7510 => 9.9941, std.dev.: 0.0177)
  MultiSource/Applications/SPASS/SPASS: 12.65% (8.4733 => 9.5452, std.dev.: 0.1423)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.35% (2.5283 => 2.8405, std.dev.: 0.0274)
  SingleSource/Benchmarks/Shootout/sieve: 11.68% (6.8087 => 7.6037, std.dev.: 0.2744)
  SingleSource/Benchmarks/Shootout-C++/hash: 11.62% (0.6540 => 0.7300, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.05% (4.8642 => 5.4017, std.dev.: 0.0965)
  MultiSource/Applications/hexxagon/hexxagon: 8.98% (14.4795 => 15.7794, std.dev.: 0.0158)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.89% (2.9511 => 3.2135, std.dev.: 0.0223)
  SingleSource/Benchmarks/Misc/flops-7: 8.38% (1.9399 => 2.1025, std.dev.: 0.0381)
  SingleSource/Benchmarks/Shootout-C++/ary3: 8.23% (2.0100 => 2.1754, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/flops: 8.22% (9.3754 => 10.1456, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.21% (2.5458 => 2.7293, std.dev.: 0.0020)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.61% (1.8732 => 1.9971, std.dev.: 0.0419)
  SingleSource/Benchmarks/Shootout-C++/hash2: 6.46% (3.3943 => 3.6136, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.63% (5.0818 => 5.3678, std.dev.: 0.0119)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.55% (41.3934 => 43.6897, std.dev.: 0.7431)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.34% (9.0122 => 9.4935, std.dev.: 0.0163)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.33% (6.2349 => 6.5675, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.10% (5.1346 => 5.3964, std.dev.: 0.0187)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.05% (59.5643 => 62.5716, std.dev.: 0.3438)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.01% (90.5803 => 95.1150, std.dev.: 0.8887)
  MultiSource/Applications/sqlite3/sqlite3: 4.38% (4.2776 => 4.4651, std.dev.: 0.0181)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.32% (1.0374 => 1.0822, std.dev.: 0.0025)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.21% (23.4908 => 24.4807, std.dev.: 0.0269)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.87% (5.1006 => 5.2979, std.dev.: 0.0172)
  SingleSource/Benchmarks/Misc/salsa20: 3.70% (9.1513 => 9.4900, std.dev.: 0.0559)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (4.1146 => 4.2616, std.dev.: 0.0504)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.38% (2.0956 => 2.1664, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.53% (4.0247 => 4.1267, std.dev.: 0.0370)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.49% (9.6958 => 9.9376, std.dev.: 0.0318)
  MultiSource/Applications/spiff/spiff: 2.49% (2.7749 => 2.8440, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.39% (4.1182 => 4.2166, std.dev.: 0.0210)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.05% (22.0762 => 22.5283, std.dev.: 0.1753)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (3.4522 => 3.4957, std.dev.: 0.0018)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.24% (2.3310 => 2.3598, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.11% (4.4250 => 4.4742, std.dev.: 0.0173)
  SingleSource/Benchmarks/Shootout/lists: 1.04% (7.2055 => 7.2804, std.dev.: 0.0210)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -44.94% (0.0810 => 0.0446, std.dev.: 0.0129)
  MultiSource/Benchmarks/FreeBench/neural/neural: -22.42% (0.2542 => 0.1972, std.dev.: 0.0106)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.36% (0.0817 => 0.0667, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -11.84% (0.0895 => 0.0789, std.dev.: 0.0007)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -73.03% (1.0845 => 0.2925, std.dev.: 0.0098)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.21% (0.3861 => 0.1382, std.dev.: 0.0020)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.34% (3.4380 => 1.4665, std.dev.: 0.0089)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -56.96% (3.8940 => 1.6760, std.dev.: 0.0036)
  MultiSource/Benchmarks/FreeBench/mason/mason: -45.37% (0.5213 => 0.2848, std.dev.: 0.0128)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -42.41% (0.3091 => 0.1780, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.18% (6.8267 => 4.5614, std.dev.: 0.1469)
  MultiSource/Applications/viterbi/viterbi: -26.75% (3.4506 => 2.5277, std.dev.: 0.0232)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.51% (0.4111 => 0.3021, std.dev.: 0.0150)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -25.73% (0.4520 => 0.3357, std.dev.: 0.0104)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -24.14% (0.2316 => 0.1757, std.dev.: 0.0013)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -24.04% (0.1789 => 0.1359, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.95% (0.4368 => 0.3322, std.dev.: 0.0117)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -22.34% (0.1871 => 0.1453, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/perlin: -20.58% (4.5691 => 3.6288, std.dev.: 0.0045)
  MultiSource/Benchmarks/mafft/pairlocalalign: -19.92% (57.5400 => 46.0778, std.dev.: 0.1598)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.78% (0.3279 => 0.2696, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.45% (6.0446 => 5.0505, std.dev.: 0.0279)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.41% (6.4626 => 5.4019, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -14.08% (6.7010 => 5.7577, std.dev.: 0.0105)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -12.46% (3.5506 => 3.1083, std.dev.: 0.0566)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.34% (6.0602 => 5.3126, std.dev.: 0.0141)
  SingleSource/Benchmarks/Misc/mandel: -11.26% (1.0882 => 0.9657, std.dev.: 0.0375)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.24% (5.0054 => 4.4926, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.06% (5.8948 => 5.3016, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.83% (5.0816 => 4.6331, std.dev.: 0.0595)
  SingleSource/Benchmarks/McGill/queens: -7.93% (1.7928 => 1.6506, std.dev.: 0.0042)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.62% (9.5512 => 8.8234, std.dev.: 0.0371)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.40% (13.2022 => 12.2258, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.39% (3.3978 => 3.1467, std.dev.: 0.0094)
  MultiSource/Applications/sgefa/sgefa: -6.25% (1.2184 => 1.1423, std.dev.: 0.0148)
  MultiSource/Applications/oggenc/oggenc: -5.81% (0.1826 => 0.1720, std.dev.: 0.0000)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.43% (3.4205 => 3.2346, std.dev.: 0.0273)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.36% (0.5182 => 0.4904, std.dev.: 0.0029)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.04% (3.9434 => 3.7447, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.82% (3.0513 => 2.9042, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.49% (5.7666 => 5.5074, std.dev.: 0.0067)
  MultiSource/Benchmarks/Olden/em3d/em3d: -4.49% (4.5899 => 4.3839, std.dev.: 0.0655)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.41% (9.0356 => 8.6369, std.dev.: 0.0688)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.32% (3.3618 => 3.2166, std.dev.: 0.0201)
  SingleSource/Benchmarks/Misc/fbench: -4.21% (4.9661 => 4.7569, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.15% (5.6245 => 5.3909, std.dev.: 0.0521)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.04% (3.3922 => 3.2553, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -4.02% (4.2970 => 4.1241, std.dev.: 0.0219)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.38% (4.3713 => 4.2237, std.dev.: 0.0034)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.81% (3.8286 => 3.7211, std.dev.: 0.0078)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.19% (6.7917 => 6.6432, std.dev.: 0.0064)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.15% (35.0623 => 34.3073, std.dev.: 0.0268)
  SingleSource/Benchmarks/Linpack/linpack-pc: -1.46% (52.8418 => 52.0688, std.dev.: 0.0292)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.35% (89.3093 => 88.1019, std.dev.: 0.0776)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.19% (5.6426 => 5.5756, std.dev.: 0.0056)
  MultiSource/Benchmarks/sim/sim: -1.13% (3.8564 => 3.8129, std.dev.: 0.0166)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 2.00% (1.1288 => 1.1514, std.dev.: 0.1544)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.27% (0.0248 => 0.0225, std.dev.: 0.0016)
  MultiSource/Applications/ClamAV/clamscan: 1.76% (0.1477 => 0.1503, std.dev.: 0.0024)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.60% (0.1309 => 0.1275, std.dev.: 0.0174)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 44.70% (0.0613 => 0.0887, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.97% (0.0276 => 0.0254, std.dev.: 0.0032)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.90% (0.0594 => 0.0635, std.dev.: 0.0090)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.93% (0.0361 => 0.0271, std.dev.: 0.0033)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 900.00% (0.0001 => 0.0010, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -46.74% (0.0092 => 0.0049, std.dev.: 0.0062)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -14.97% (26.9213 => 22.8902, std.dev.: 0.0519)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130422/d1ac6a5d/attachment.html>


More information about the llvm-testresults mailing list