[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 27 00:52:23 PST 2013


http://llvm.org/perf/db_default/v4/nts/19103?compare_to=19099&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19103, Order: 198070, Start Time: 2013-12-27 07:14:45, End Time: 2013-12-27 08:56:55
      To: 19099, Order: 198068, Start Time: 2013-12-27 05:06:30, End Time: 2013-12-27 06:48:56
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 18 (29 on baseline)
Performance Improvements: 3 (59 on baseline)
Unchanged Tests: 1089 (1022 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.74% (1.3061 => 1.3288, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.55% (1.2621 => 1.2817, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.40% (1.2320 => 1.2493, std.dev.: 0.0022)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: 20.27% (6.7636 => 8.1346, std.dev.: 0.0014)
  MultiSource/Benchmarks/nbench/nbench: 14.74% (19.7179 => 22.6249, std.dev.: 0.0976)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.53% (6.2692 => 6.9919, std.dev.: 0.2637)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.11% (3.5743 => 3.7213, std.dev.: 0.0012)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.29% (2.4012 => 2.4802, std.dev.: 0.0097)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.48% (1.6477 => 1.6885, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/lists: 2.28% (7.3055 => 7.4721, std.dev.: 0.0232)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 2.19% (9.2695 => 9.4727, std.dev.: 0.0280)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.02% (11.8972 => 12.1376, std.dev.: 0.0052)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.84% (23.3958 => 23.8272, std.dev.: 0.0067)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.79% (0.7412 => 0.7545, std.dev.: 0.0010)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.39% (8.8102 => 8.9326, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout/methcall: 1.19% (8.5635 => 8.6652, std.dev.: 0.0323)
  SingleSource/Benchmarks/Misc/mandel: 1.03% (1.0555 => 1.0664, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.03% (6.6340 => 6.7023, std.dev.: 0.0095)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.50% (0.5795 => 0.5650, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.84% (1.2121 => 1.1898, std.dev.: 0.0086)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/SPASS/SPASS: -7.34% (8.7892 => 8.1438, std.dev.: 0.1152)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 39.39% (15.7419 => 21.9419, std.dev.: 1.3008)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 25.52% (0.3859 => 0.4844, std.dev.: 0.0065)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: 20.59% (6.7454 => 8.1346, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.37% (5.9583 => 6.9933, std.dev.: 0.1062)
  SingleSource/Benchmarks/Stanford/Puzzle: 11.09% (0.1668 => 0.1853, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.93% (3.5771 => 3.8607, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout/lists: 6.85% (6.9930 => 7.4721, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.24% (3.5027 => 3.7213, std.dev.: 0.0012)
  MultiSource/Applications/siod/siod: 5.08% (3.4258 => 3.5998, std.dev.: 0.0030)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.44% (3.4043 => 3.5555, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.75% (5.0601 => 5.2498, std.dev.: 0.0147)
  MultiSource/Applications/sgefa/sgefa: 3.58% (0.8745 => 0.9058, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.46% (5.7952 => 5.9959, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.32% (5.9126 => 6.1087, std.dev.: 0.0034)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.95% (0.5112 => 0.5263, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.65% (6.5291 => 6.7023, std.dev.: 0.0095)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.51% (1.5986 => 1.6387, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.39% (11.7894 => 12.0708, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.22% (5.5032 => 5.6253, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.08% (11.8902 => 12.1376, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.03% (5.2486 => 5.3552, std.dev.: 0.0385)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.99% (50.9650 => 51.9775, std.dev.: 0.3714)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.84% (23.3972 => 23.8272, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.80% (3.1547 => 3.2115, std.dev.: 0.0044)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.74% (2.5025 => 2.5461, std.dev.: 0.0029)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.42% (8.8073 => 8.9326, std.dev.: 0.0058)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.11% (1.6699 => 1.6885, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.08% (5.3463 => 5.4038, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.05% (3.5451 => 3.5823, std.dev.: 0.0020)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -16.51% (0.1938 => 0.1618, std.dev.: 0.0031)
  MultiSource/Benchmarks/Bullet/bullet: -9.78% (36.6274 => 33.0456, std.dev.: 0.3314)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.47% (0.1088 => 0.0985, std.dev.: 0.0009)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -8.68% (0.3247 => 0.2965, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3402 => 0.3163, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.90% (0.2810 => 0.2616, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.71% (1.3676 => 1.2759, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.68% (0.6882 => 0.6422, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.12% (1.2824 => 1.2039, std.dev.: 0.0095)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.67% (2.0207 => 1.9062, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (1.4277 => 1.3483, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.48% (1.3819 => 1.3062, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.17% (1.1409 => 1.0819, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.15% (1.2544 => 1.1898, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.13% (1.4113 => 1.3389, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.09% (1.3505 => 1.2817, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.97% (1.3146 => 1.2493, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.75% (1.2914 => 1.2301, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.65% (1.5305 => 1.4593, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.57% (1.3660 => 1.3036, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.48% (1.3127 => 1.2539, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.37% (1.3264 => 1.2684, std.dev.: 0.0072)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.23% (0.2906 => 0.2783, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.22% (1.4125 => 1.3529, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.20% (1.3157 => 1.2605, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.10% (1.2724 => 1.2202, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.90% (0.5879 => 0.5650, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.89% (1.4074 => 1.3527, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.79% (1.3510 => 1.2998, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.74% (1.3024 => 1.2537, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.74% (1.2583 => 1.2113, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.73% (1.3918 => 1.3399, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.54% (1.3460 => 1.2984, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.41% (1.2785 => 1.2349, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.03% (1.3182 => 1.2783, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.02% (1.3702 => 1.3288, std.dev.: 0.0012)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.02% (7.5124 => 7.2858, std.dev.: 0.0410)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.54% (1.3608 => 1.3262, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.47% (1.3457 => 1.3125, std.dev.: 0.0024)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.27% (10.3096 => 10.0751, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.23% (1.2670 => 1.2387, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.18% (1.2952 => 1.2669, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.08% (1.3551 => 1.3269, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.04% (4.7807 => 4.6830, std.dev.: 0.0115)
  MultiSource/Benchmarks/nbench/nbench: -1.93% (1.2647 => 1.2403, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.92% (1.3068 => 1.2817, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.56% (0.7375 => 0.7260, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.31% (1.2356 => 1.2194, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.21% (1.3750 => 1.3584, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.05% (1.2495 => 1.2364, std.dev.: 0.0022)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -5.71% (7.4226 => 6.9985, std.dev.: 0.0025)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -5.48% (10.0217 => 9.4727, std.dev.: 0.0280)
  MultiSource/Applications/SPASS/SPASS: -4.60% (8.5363 => 8.1438, std.dev.: 0.1152)
  MultiSource/Applications/sqlite3/sqlite3: -4.58% (4.2978 => 4.1010, std.dev.: 0.0513)
  MultiSource/Benchmarks/PAQ8p/paq8p: -4.22% (99.3511 => 95.1541, std.dev.: 0.6283)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -3.82% (0.8636 => 0.8306, std.dev.: 0.0114)
  MultiSource/Benchmarks/nbench/nbench: -3.60% (23.4696 => 22.6249, std.dev.: 0.0976)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.96% (2.5559 => 2.4802, std.dev.: 0.0097)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.54% (3.6583 => 3.5654, std.dev.: 0.0166)

Report Time: 2.51s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131227/b310caa0/attachment.html>


More information about the llvm-testresults mailing list