[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Sep 23 17:53:01 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15598?compare_to=15595&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15598, Order: 191226, Start Time: 2013-09-23 22:59:31, End Time: 2013-09-24 00:55:46
      To: 15595, Order: 191216, Start Time: 2013-09-23 20:47:09, End Time: 2013-09-23 22:36:23
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 47 (58 on baseline)
Performance Improvements: 3 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1057 (1036 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/testtrace: 101.19% (0.0252 => 0.0507, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout/fib2: 93.10% (0.0174 => 0.0336, std.dev.: 0.0012)
  SingleSource/Regression/C/2004-02-03-AggregateCopy: 79.58% (0.0142 => 0.0255, std.dev.: 0.0014)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 72.70% (0.0282 => 0.0487, std.dev.: 0.0032)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 56.58% (0.7123 => 1.1153, std.dev.: 0.0312)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 48.76% (0.6919 => 1.0293, std.dev.: 0.0860)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 44.72% (0.7399 => 1.0708, std.dev.: 0.0715)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 43.92% (0.5692 => 0.8192, std.dev.: 0.0667)
  MultiSource/Benchmarks/MallocBench/gs/gs: 35.23% (4.6949 => 6.3488, std.dev.: 0.5490)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 34.29% (1.6265 => 2.1843, std.dev.: 0.0870)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 33.74% (1.4916 => 1.9948, std.dev.: 0.1327)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 31.76% (0.6722 => 0.8857, std.dev.: 0.0614)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 29.12% (9.9198 => 12.8080, std.dev.: 0.7010)
  MultiSource/Applications/siod/siod: 20.96% (2.5278 => 3.0576, std.dev.: 0.1771)
  MultiSource/Benchmarks/Bullet/bullet: 16.71% (33.6044 => 39.2203, std.dev.: 1.1466)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.88% (2.7338 => 3.1405, std.dev.: 0.0817)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.53% (1.2705 => 1.4551, std.dev.: 0.0123)
  MultiSource/Applications/sqlite3/sqlite3: 13.76% (16.8719 => 19.1934, std.dev.: 0.2996)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.56% (1.3018 => 1.4783, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.28% (1.2637 => 1.4315, std.dev.: 0.0568)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 12.63% (6.1591 => 6.9369, std.dev.: 0.2203)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.21% (1.3165 => 1.4773, std.dev.: 0.0513)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.88% (2.0078 => 2.2464, std.dev.: 0.0627)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.86% (4.1839 => 4.6381, std.dev.: 0.1032)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.81% (1.3619 => 1.5091, std.dev.: 0.0480)
  SingleSource/Regression/C++/ofstream_ctor: 10.51% (0.2046 => 0.2261, std.dev.: 0.0081)
  MultiSource/Benchmarks/Olden/mst/mst: 10.16% (0.1348 => 0.1485, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.68% (1.2582 => 1.3800, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.25% (1.2954 => 1.4152, std.dev.: 0.0380)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 9.03% (0.2137 => 0.2330, std.dev.: 0.0045)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.62% (1.1666 => 1.1855, std.dev.: 0.0053)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: 24.29% (4.0601 => 5.0463, std.dev.: 0.2827)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 19.79% (28.7649 => 34.4579, std.dev.: 1.0701)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.15% (2.1109 => 2.4096, std.dev.: 0.0763)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.61% (4.9421 => 5.4666, std.dev.: 0.0451)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 10.38% (2.3319 => 2.5740, std.dev.: 0.0292)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.85% (7.6521 => 8.0234, std.dev.: 0.0959)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.50% (3.9840 => 4.1632, std.dev.: 0.0353)
  SingleSource/Benchmarks/Misc/fp-convert: 3.95% (7.5310 => 7.8282, std.dev.: 0.0166)
  MultiSource/Applications/JM/lencod/lencod: 3.91% (7.6706 => 7.9706, std.dev.: 0.0928)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.86% (39.3455 => 40.8653, std.dev.: 0.2023)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.59% (5.0929 => 5.2757, std.dev.: 0.0420)
  SingleSource/Benchmarks/Shootout-C++/lists: 3.45% (15.8476 => 16.3940, std.dev.: 0.1059)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.97% (4.5035 => 4.6371, std.dev.: 0.0033)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.99% (3.6171 => 3.6890, std.dev.: 0.0059)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.98% (18.2977 => 18.6604, std.dev.: 0.0992)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.15% (5.3329 => 5.3941, std.dev.: 0.0228)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/pi: -4.93% (1.7062 => 1.6220, std.dev.: 0.0202)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.40% (1.8809 => 1.8169, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.77% (6.6493 => 6.4650, std.dev.: 0.0646)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 8.44% (0.1363 => 0.1478, std.dev.: 0.0151)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2005-05-06-LongLongSignedShift: 163.49% (0.0063 => 0.0166, std.dev.: 0.0014)
  SingleSource/Regression/C/testtrace: 101.99% (0.0251 => 0.0507, std.dev.: 0.0002)
  SingleSource/Regression/C/2004-02-03-AggregateCopy: 68.87% (0.0151 => 0.0255, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout/fib2: 65.52% (0.0203 => 0.0336, std.dev.: 0.0012)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 65.08% (0.0295 => 0.0487, std.dev.: 0.0032)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 58.49% (0.7037 => 1.1153, std.dev.: 0.0312)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 49.87% (0.6868 => 1.0293, std.dev.: 0.0860)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 46.05% (0.5609 => 0.8192, std.dev.: 0.0667)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 43.52% (0.7461 => 1.0708, std.dev.: 0.0715)
  MultiSource/Benchmarks/MallocBench/gs/gs: 38.37% (4.5883 => 6.3488, std.dev.: 0.5490)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 36.12% (1.6047 => 2.1843, std.dev.: 0.0870)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 35.28% (1.4746 => 1.9948, std.dev.: 0.1327)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 33.85% (0.6617 => 0.8857, std.dev.: 0.0614)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 31.56% (9.7354 => 12.8080, std.dev.: 0.7010)
  MultiSource/Applications/siod/siod: 24.90% (2.4480 => 3.0576, std.dev.: 0.1771)
  MultiSource/Benchmarks/Bullet/bullet: 19.74% (32.7552 => 39.2203, std.dev.: 1.1466)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 18.55% (2.6492 => 3.1405, std.dev.: 0.0817)
  MultiSource/Applications/sqlite3/sqlite3: 17.83% (16.2888 => 19.1934, std.dev.: 0.2996)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 15.94% (1.2550 => 1.4551, std.dev.: 0.0123)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.34% (1.9476 => 2.2464, std.dev.: 0.0627)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.07% (6.0284 => 6.9369, std.dev.: 0.2203)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.81% (4.0397 => 4.6381, std.dev.: 0.1032)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.31% (1.2523 => 1.4315, std.dev.: 0.0568)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (1.2932 => 1.4773, std.dev.: 0.0513)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.17% (1.2948 => 1.4783, std.dev.: 0.0215)
  MultiSource/Benchmarks/Olden/mst/mst: 13.27% (0.1311 => 0.1485, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.32% (0.0820 => 0.0921, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 11.67% (1.3514 => 1.5091, std.dev.: 0.0480)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.48% (1.2695 => 1.4152, std.dev.: 0.0380)
  SingleSource/Regression/C++/ofstream_ctor: 11.21% (0.2033 => 0.2261, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.45% (1.2494 => 1.3800, std.dev.: 0.0218)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 10.22% (0.2114 => 0.2330, std.dev.: 0.0045)
  MultiSource/Applications/kimwitu++/kc: 9.35% (18.3608 => 20.0776, std.dev.: 0.6470)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.07% (0.8802 => 0.9424, std.dev.: 0.0196)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.64% (0.5705 => 0.6027, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.04% (1.3365 => 1.4039, std.dev.: 0.0190)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.37% (1.1580 => 1.1855, std.dev.: 0.0053)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: 23.07% (4.1004 => 5.0463, std.dev.: 0.2827)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.16% (30.1838 => 34.4579, std.dev.: 1.0701)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.14% (2.1111 => 2.4096, std.dev.: 0.0763)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.60% (4.9428 => 5.4666, std.dev.: 0.0451)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 10.16% (2.3365 => 2.5740, std.dev.: 0.0292)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.84% (0.8273 => 0.9004, std.dev.: 0.0271)
  SingleSource/UnitTests/Vector/multiplies: 6.67% (0.5561 => 0.5932, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.83% (6.1088 => 6.4650, std.dev.: 0.0646)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.98% (7.6426 => 8.0234, std.dev.: 0.0959)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.89% (3.9691 => 4.1632, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.75% (4.4696 => 4.6371, std.dev.: 0.0033)
  MultiSource/Applications/siod/siod: 3.60% (3.5310 => 3.6580, std.dev.: 0.0204)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.49% (5.0980 => 5.2757, std.dev.: 0.0420)
  SingleSource/Benchmarks/Misc/fp-convert: 3.17% (7.5877 => 7.8282, std.dev.: 0.0166)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.88% (3.5683 => 3.6710, std.dev.: 0.0344)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.29% (39.9519 => 40.8653, std.dev.: 0.2023)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.73% (5.3022 => 5.3941, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.39% (6.6028 => 6.6947, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.29% (1.5940 => 1.6146, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.14% (3.4725 => 3.5122, std.dev.: 0.0128)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.08% (1.6182 => 1.6357, std.dev.: 0.0065)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -19.55% (0.1483 => 0.1193, std.dev.: 0.0069)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.31% (0.5226 => 0.2388, std.dev.: 0.0385)
  MultiSource/Applications/sgefa/sgefa: -45.78% (1.5790 => 0.8561, std.dev.: 0.0259)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.81% (15.9508 => 13.2698, std.dev.: 0.2525)
  SingleSource/Benchmarks/Linpack/linpack-pc: -13.61% (57.2347 => 49.4439, std.dev.: 1.6729)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.40% (3.4956 => 3.1319, std.dev.: 0.0368)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.39% (20.8247 => 18.6604, std.dev.: 0.0992)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.18% (50.0284 => 45.9362, std.dev.: 0.3404)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.66% (5.2422 => 5.1027, std.dev.: 0.0493)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.52% (17.1431 => 16.7118, std.dev.: 0.1122)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.89% (1.8519 => 1.8169, std.dev.: 0.0057)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.46% (3.7437 => 3.6890, std.dev.: 0.0059)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.07% (89.7126 => 88.7564, std.dev.: 0.3308)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 9.64% (0.1348 => 0.1478, std.dev.: 0.0151)

Report Time: 1.01s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130923/fc0e5555/attachment.html>


More information about the llvm-testresults mailing list