[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Aug 21 03:19:02 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14632?compare_to=14627&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14632, Order: 188889, Start Time: 2013-08-21 08:27:58, End Time: 2013-08-21 10:21:09
      To: 14627, Order: 188867, Start Time: 2013-08-21 06:09:29, End Time: 2013-08-21 08:02:29
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 25 (35 on baseline)
Performance Improvements: 6 (22 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1076 (1050 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2005-05-13-SDivTwo: 65.41% (0.0159 => 0.0263, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C++/family/family: 65.30% (0.0487 => 0.0805, std.dev.: 0.0017)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 48.06% (1.0049 => 1.4879, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.41% (1.4631 => 1.6886, std.dev.: 0.0168)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.19% (0.1008 => 0.1141, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 13.07% (1.4357 => 1.6233, std.dev.: 0.0338)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.23% (1.3536 => 1.5056, std.dev.: 0.0487)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 10.90% (0.1128 => 0.1251, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.94% (1.4092 => 1.5493, std.dev.: 0.0490)
  MultiSource/Benchmarks/PAQ8p/paq8p: 9.25% (2.5255 => 2.7590, std.dev.: 0.0376)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.55% (1.4825 => 1.5945, std.dev.: 0.0402)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.19% (47.3142 => 50.7144, std.dev.: 0.7569)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.55% (1.4604 => 1.5560, std.dev.: 0.0217)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.88% (2.7794 => 3.3596, std.dev.: 0.0456)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.51% (2.5532 => 3.0768, std.dev.: 0.0764)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 12.63% (0.1877 => 0.2114, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.71% (4.9591 => 5.2422, std.dev.: 0.0171)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.29% (90.7107 => 95.5087, std.dev.: 1.7780)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.05% (1.2939 => 1.3463, std.dev.: 0.0044)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.63% (16.5225 => 16.9563, std.dev.: 0.1638)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.55% (2.8260 => 2.8980, std.dev.: 0.0058)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.73% (51.5210 => 52.4124, std.dev.: 0.2261)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.56% (5.7821 => 5.8722, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.48% (5.0905 => 5.1657, std.dev.: 0.0278)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.47% (21.1712 => 21.4821, std.dev.: 0.0141)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -17.18% (0.1007 => 0.0834, std.dev.: 0.0038)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -6.87% (0.3145 => 0.2929, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -5.01% (0.3371 => 0.3202, std.dev.: 0.0026)
  MultiSource/Benchmarks/FreeBench/neural/neural: -4.88% (0.4369 => 0.4156, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -3.36% (3.0946 => 2.9905, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.40% (6.0384 => 5.9537, std.dev.: 0.0215)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.08% (0.1315 => 0.1314, std.dev.: 0.0098)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/family/family: 80.49% (0.0446 => 0.0805, std.dev.: 0.0017)
  SingleSource/UnitTests/2005-05-13-SDivTwo: 62.35% (0.0162 => 0.0263, std.dev.: 0.0016)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 35.12% (1.1012 => 1.4879, std.dev.: 0.0093)
  MultiSource/Benchmarks/FreeBench/distray/distray: 18.78% (0.1033 => 0.1227, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.30% (0.1016 => 0.1141, std.dev.: 0.0030)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 11.50% (0.1122 => 0.1251, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.39% (1.5437 => 1.6886, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.60% (1.4947 => 1.6233, std.dev.: 0.0338)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.31% (3.7285 => 6.2380, std.dev.: 0.1246)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.56% (2.8867 => 4.2886, std.dev.: 0.0614)
  MultiSource/Benchmarks/FreeBench/neural/neural: 31.06% (0.3171 => 0.4156, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc/pi: 26.23% (1.9835 => 2.5037, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.63% (1.5030 => 1.8882, std.dev.: 0.0043)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 24.47% (2.6992 => 3.3596, std.dev.: 0.0456)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.91% (2.6094 => 3.0768, std.dev.: 0.0764)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.36% (14.9584 => 16.9563, std.dev.: 0.1638)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.08% (7.0762 => 7.8600, std.dev.: 0.0731)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.46% (48.3256 => 52.4124, std.dev.: 0.2261)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.43% (5.4910 => 5.9537, std.dev.: 0.0215)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.90% (1.2557 => 1.3549, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.48% (3.2027 => 3.4423, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.99% (3.4085 => 3.6467, std.dev.: 0.0413)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.23% (5.3042 => 5.6349, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.57% (5.5008 => 5.8071, std.dev.: 0.0447)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.34% (5.1471 => 5.3706, std.dev.: 0.0429)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.31% (4.3151 => 4.5009, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.98% (5.0417 => 5.2422, std.dev.: 0.0171)
  SingleSource/Benchmarks/Misc/whetstone: 3.77% (3.4559 => 3.5863, std.dev.: 0.0254)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.46% (4.8739 => 5.0424, std.dev.: 0.0096)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.43% (25.0200 => 25.8777, std.dev.: 0.0496)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.93% (2.8156 => 2.8980, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.78% (4.4624 => 4.5863, std.dev.: 0.0337)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.74% (1.3104 => 1.3463, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.99% (12.8625 => 13.1189, std.dev.: 0.0514)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.84% (3.3464 => 3.4081, std.dev.: 0.0213)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.48% (2.1022 => 1.4194, std.dev.: 0.0610)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.01% (0.1189 => 0.0856, std.dev.: 0.0129)
  MultiSource/Applications/viterbi/viterbi: -26.61% (3.4923 => 2.5630, std.dev.: 0.0566)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.67% (6.9552 => 5.2394, std.dev.: 0.3480)
  SingleSource/Benchmarks/Misc/perlin: -21.36% (4.5989 => 3.6168, std.dev.: 0.0092)
  MultiSource/Applications/obsequi/Obsequi: -15.95% (2.6081 => 2.1921, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.70% (6.2627 => 5.4047, std.dev.: 0.1485)
  SingleSource/Benchmarks/Misc/mandel: -12.34% (1.1996 => 1.0516, std.dev.: 0.0379)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (47.2250 => 44.5924, std.dev.: 0.3080)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.05% (0.2849 => 0.2705, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/fbench: -4.27% (4.9602 => 4.7486, std.dev.: 0.0121)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.16% (0.7355 => 0.7049, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.07% (1.1024 => 1.0575, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.45% (6.0444 => 5.8361, std.dev.: 0.0325)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.37% (3.8119 => 3.6834, std.dev.: 0.0211)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.60% (1.7207 => 1.6759, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.31% (6.1482 => 6.0060, std.dev.: 0.0081)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.11% (1.8144 => 1.7761, std.dev.: 0.0093)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.92% (34.8438 => 34.1751, std.dev.: 0.0778)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.89% (2.7049 => 2.6539, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.35% (5.8810 => 5.8014, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.29% (4.9231 => 4.8594, std.dev.: 0.0204)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.64% (0.1378 => 0.1314, std.dev.: 0.0098)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130821/78a8739e/attachment.html>


More information about the llvm-testresults mailing list