[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jun 6 14:28:59 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12127?compare_to=12123&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12127, Order: 183432, Start Time: 2013-06-06 19:38:02, End Time: 2013-06-06 21:29:40
      To: 12123, Order: 183421, Start Time: 2013-06-06 17:21:26, End Time: 2013-06-06 19:14:13
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 28 (68 on baseline)
Performance Improvements: 19 (24 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1060 (1015 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-2: 56.35% (0.0323 => 0.0505, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/dt: 54.52% (0.0398 => 0.0615, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc-C++/mandel-text: 48.61% (0.0251 => 0.0373, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/mandel: 44.51% (0.0528 => 0.0763, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 33.16% (10.0033 => 13.3205, std.dev.: 0.4071)
  SingleSource/Regression/C++/EH/exception_spec_test: 32.26% (0.0341 => 0.0451, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 30.55% (0.7008 => 0.9149, std.dev.: 0.0657)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.80% (0.1143 => 0.1415, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.96% (0.1047 => 0.1235, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.16% (1.6247 => 1.7085, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.55% (1.6520 => 1.7272, std.dev.: 0.0223)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.70% (27.1294 => 28.1321, std.dev.: 0.1068)
  MultiSource/Applications/lemon/lemon: 3.28% (1.2731 => 1.3148, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.35% (1.9418 => 1.9874, std.dev.: 0.0122)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/lemon/lemon: 39.23% (0.9779 => 1.3615, std.dev.: 0.1047)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 32.29% (0.9449 => 1.2500, std.dev.: 0.0942)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 17.56% (1.7544 => 2.0625, std.dev.: 0.0524)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.47% (0.2150 => 0.2504, std.dev.: 0.0050)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.82% (0.1904 => 0.2148, std.dev.: 0.0039)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.46% (2.6799 => 3.0139, std.dev.: 0.1045)
  MultiSource/Benchmarks/Bullet/bullet: 5.63% (6.9964 => 7.3901, std.dev.: 0.1112)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.96% (40.7574 => 42.7802, std.dev.: 0.5012)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.99% (16.1101 => 16.7522, std.dev.: 0.0956)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.94% (3.0386 => 3.1279, std.dev.: 0.0083)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 1.78% (1.6046 => 1.6331, std.dev.: 0.0025)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.40% (51.2472 => 51.9623, std.dev.: 0.2305)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.03% (11.4636 => 11.5821, std.dev.: 0.0417)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.00% (1.0994 => 1.1104, std.dev.: 0.0033)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -33.63% (0.2254 => 0.1496, std.dev.: 0.0187)
  SingleSource/UnitTests/Vector/constpool: -28.47% (12.6856 => 9.0745, std.dev.: 1.1872)
  MultiSource/Benchmarks/Olden/bh/bh: -15.70% (0.4370 => 0.3684, std.dev.: 0.0260)
  MultiSource/Applications/JM/ldecod/ldecod: -13.31% (8.7310 => 7.5692, std.dev.: 0.3572)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -12.98% (0.2511 => 0.2185, std.dev.: 0.0115)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -12.48% (0.3101 => 0.2714, std.dev.: 0.0130)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -10.44% (0.4089 => 0.3662, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.55% (1.8392 => 1.7187, std.dev.: 0.0444)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.31% (1.7059 => 1.5982, std.dev.: 0.0280)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.00% (0.3218 => 0.3057, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.63% (1.7375 => 1.6570, std.dev.: 0.0299)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.14% (1.4834 => 1.4220, std.dev.: 0.0127)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.87% (0.5794 => 0.5570, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.74% (1.6170 => 1.5565, std.dev.: 0.0214)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.44% (0.5575 => 0.5439, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.37% (4.5845 => 4.5216, std.dev.: 0.0229)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/strcat: -10.05% (0.1553 => 0.1397, std.dev.: 0.0039)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.42% (33.1445 => 30.6847, std.dev.: 0.8646)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.15% (5.9588 => 5.8902, std.dev.: 0.0096)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.25% (0.1568 => 0.1517, std.dev.: 0.0191)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc-C++/mandel-text: 65.78% (0.0225 => 0.0373, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/dt: 64.44% (0.0374 => 0.0615, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 60.07% (0.0884 => 0.1415, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/flops-2: 59.81% (0.0316 => 0.0505, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/mandel: 58.63% (0.0481 => 0.0763, std.dev.: 0.0074)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 54.50% (0.1121 => 0.1732, std.dev.: 0.0087)
  MultiSource/Benchmarks/MallocBench/gs/gs: 36.22% (4.7091 => 6.4149, std.dev.: 0.2062)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 32.60% (0.0727 => 0.0964, std.dev.: 0.0091)
  MultiSource/Benchmarks/McCat/18-imp/imp: 32.10% (0.4199 => 0.5547, std.dev.: 0.0327)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 31.10% (10.1602 => 13.3205, std.dev.: 0.4071)
  MultiSource/Benchmarks/Olden/health/health: 20.41% (0.1612 => 0.1941, std.dev.: 0.0078)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.76% (5.6424 => 6.7573, std.dev.: 0.2712)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.05% (2.6076 => 2.8696, std.dev.: 0.0136)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.47% (25.9348 => 28.1321, std.dev.: 0.1068)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.34% (4.1734 => 4.5216, std.dev.: 0.0229)
  MultiSource/Applications/sqlite3/sqlite3: 8.32% (16.9719 => 18.3843, std.dev.: 0.3037)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.23% (1.6070 => 1.7393, std.dev.: 0.0394)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.20% (1.6299 => 1.7636, std.dev.: 0.0423)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.09% (1.5806 => 1.7085, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.06% (1.5984 => 1.7272, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.88% (1.6292 => 1.7576, std.dev.: 0.0489)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.81% (1.8435 => 1.9874, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (1.6275 => 1.7375, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.36% (1.5727 => 1.6570, std.dev.: 0.0299)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.84% (2.5078 => 2.6292, std.dev.: 0.0190)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.68% (0.5196 => 0.5439, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.09% (0.2937 => 0.3057, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.92% (1.4757 => 1.5335, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.83% (1.4991 => 1.5565, std.dev.: 0.0214)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.59% (6.6236 => 6.8612, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.58% (1.3838 => 1.4333, std.dev.: 0.0183)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.26% (1.5959 => 1.6480, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.80% (1.3833 => 1.4220, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.73% (1.4165 => 1.4551, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.67% (1.4999 => 1.5399, std.dev.: 0.0140)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 55.63% (6.0122 => 9.3566, std.dev.: 0.6296)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.71% (4.6452 => 6.0253, std.dev.: 0.1736)
  MultiSource/Benchmarks/McCat/18-imp/imp: 29.16% (0.0991 => 0.1280, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/ary: 21.80% (0.0633 => 0.0771, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.85% (0.2072 => 0.2504, std.dev.: 0.0050)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.82% (2.5366 => 3.0139, std.dev.: 0.1045)
  MultiSource/Applications/sgefa/sgefa: 18.14% (1.1695 => 1.3817, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.11% (6.1372 => 7.1870, std.dev.: 0.0303)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 12.76% (1.8291 => 2.0625, std.dev.: 0.0524)
  MultiSource/Applications/obsequi/Obsequi: 12.39% (2.2398 => 2.5172, std.dev.: 0.0171)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.1945 => 0.2148, std.dev.: 0.0039)
  MultiSource/Applications/minisat/minisat: 9.13% (7.3703 => 8.0434, std.dev.: 0.1896)
  MultiSource/Benchmarks/Olden/bisort/bisort: 7.47% (0.8606 => 0.9249, std.dev.: 0.0177)
  SingleSource/Benchmarks/Misc/pi: 7.39% (1.8318 => 1.9672, std.dev.: 0.0439)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.36% (5.2003 => 5.5831, std.dev.: 0.0460)
  MultiSource/Benchmarks/llubenchmark/llu: 7.33% (2.0425 => 2.1923, std.dev.: 0.0443)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.48% (3.1853 => 3.3918, std.dev.: 0.0121)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.32% (40.6198 => 42.7802, std.dev.: 0.5012)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 5.04% (1.0571 => 1.1104, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.01% (4.6639 => 4.8975, std.dev.: 0.0785)
  MultiSource/Applications/lua/lua: 4.50% (28.2496 => 29.5207, std.dev.: 0.0275)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.23% (5.9362 => 6.1873, std.dev.: 0.0310)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.96% (5.2788 => 5.4878, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.92% (5.5010 => 5.7167, std.dev.: 0.0484)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.46% (3.0234 => 3.1279, std.dev.: 0.0083)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.38% (94.2966 => 97.4872, std.dev.: 0.6085)
  MultiSource/Benchmarks/Olden/bh/bh: 2.45% (2.4435 => 2.5033, std.dev.: 0.0165)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.33% (4.3727 => 4.4746, std.dev.: 0.0135)
  MultiSource/Applications/siod/siod: 1.77% (3.7240 => 3.7901, std.dev.: 0.0221)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.74% (16.4665 => 16.7522, std.dev.: 0.0956)
  MultiSource/Benchmarks/sim/sim: 1.71% (3.8805 => 3.9468, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.47% (3.2604 => 3.3083, std.dev.: 0.0172)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 1.40% (1.6105 => 1.6331, std.dev.: 0.0025)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.58% (0.1113 => 0.0717, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.20% (0.1646 => 0.1511, std.dev.: 0.0038)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -7.87% (0.1322 => 0.1218, std.dev.: 0.0030)
  MultiSource/Applications/Burg/burg: -5.20% (1.5375 => 1.4575, std.dev.: 0.0291)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -42.81% (1.2911 => 0.7384, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -25.96% (4.4050 => 3.2614, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.54% (6.2328 => 5.0147, std.dev.: 0.0101)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.03% (25.3677 => 21.3002, std.dev.: 0.4187)
  SingleSource/Benchmarks/Misc/salsa20: -12.93% (10.3398 => 9.0028, std.dev.: 0.0160)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.20% (48.3307 => 43.3990, std.dev.: 0.0515)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.28% (1.6679 => 1.5132, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -8.91% (0.2973 => 0.2708, std.dev.: 0.0081)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.16% (3.5327 => 3.2796, std.dev.: 0.0655)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.55% (5.5889 => 5.2228, std.dev.: 0.0604)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.28% (4.5717 => 4.3302, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.32% (5.3184 => 5.0888, std.dev.: 0.0106)
  MultiSource/Applications/hexxagon/hexxagon: -3.68% (15.4979 => 14.9275, std.dev.: 0.0205)
  SingleSource/Benchmarks/Misc/flops: -3.21% (10.2170 => 9.8888, std.dev.: 0.0367)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.03% (5.3276 => 5.1661, std.dev.: 0.0238)
  SingleSource/Benchmarks/Shootout/sieve: -2.83% (8.0178 => 7.7905, std.dev.: 0.0416)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.72% (3.8665 => 3.7614, std.dev.: 0.0178)
  MultiSource/Applications/lambda-0_1_3/lambda: -2.71% (9.1099 => 8.8633, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.00% (4.2167 => 4.1325, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.66% (4.5094 => 4.4346, std.dev.: 0.0075)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 5.27% (0.1441 => 0.1517, std.dev.: 0.0191)

Report Time: 1.81s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130606/bbbb5eef/attachment.html>


More information about the llvm-testresults mailing list