[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 4 16:14:10 PST 2013


http://llvm.org/perf/db_default/v4/nts/17976?compare_to=17971&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17976, Order: 196414, Start Time: 2013-12-04 22:19:04, End Time: 2013-12-05 00:18:15
      To: 17971, Order: 196400, Start Time: 2013-12-04 19:54:33, End Time: 2013-12-04 21:45:21
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 29 (48 on baseline)
Performance Improvements: 11 (4 on baseline)
Unchanged Tests: 1070 (1058 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/simple_throw: 63.21% (0.0193 => 0.0315, std.dev.: 0.0039)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 53.46% (0.1429 => 0.2193, std.dev.: 0.0099)
  SingleSource/Benchmarks/Misc/richards_benchmark: 53.02% (0.0845 => 0.1293, std.dev.: 0.0037)
  SingleSource/UnitTests/2002-05-02-CastTest: 45.91% (0.0281 => 0.0410, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops-8: 44.10% (0.0322 => 0.0464, std.dev.: 0.0046)
  SingleSource/Regression/C++/EH/ConditionalExpr: 43.25% (0.0252 => 0.0361, std.dev.: 0.0038)
  SingleSource/Regression/C++/pointer_method2: 37.91% (0.0277 => 0.0382, std.dev.: 0.0033)
  SingleSource/UnitTests/Vector/Altivec/casts: 30.90% (0.1220 => 0.1597, std.dev.: 0.0142)
  MultiSource/Applications/spiff/spiff: 20.21% (0.9441 => 1.1349, std.dev.: 0.0182)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.21% (4.9783 => 5.9348, std.dev.: 0.2389)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.49% (5.5193 => 6.3192, std.dev.: 0.1588)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 12.47% (1.3131 => 1.4769, std.dev.: 0.0593)
  MultiSource/Applications/siod/siod: 11.70% (2.5953 => 2.8990, std.dev.: 0.0671)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.27% (4.9935 => 5.5563, std.dev.: 0.1535)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.72% (2.7992 => 2.9593, std.dev.: 0.0157)
  MultiSource/Applications/kimwitu++/kc: 4.21% (19.3314 => 20.1449, std.dev.: 0.1778)
  MultiSource/Applications/lemon/lemon: 4.17% (1.2246 => 1.2757, std.dev.: 0.0127)
  MultiSource/Applications/sqlite3/sqlite3: 1.86% (16.3964 => 16.7017, std.dev.: 0.1137)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 57.09% (0.1368 => 0.2149, std.dev.: 0.0055)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 40.67% (0.8112 => 1.1411, std.dev.: 0.0871)
  MultiSource/Applications/minisat/minisat: 23.43% (6.7576 => 8.3407, std.dev.: 0.0581)
  MultiSource/Benchmarks/Olden/bisort/bisort: 21.99% (0.8198 => 1.0001, std.dev.: 0.0472)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 20.10% (1.3301 => 1.5975, std.dev.: 0.0204)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.53% (2.1126 => 2.3773, std.dev.: 0.0215)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.13% (61.9923 => 64.5540, std.dev.: 0.9577)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.04% (96.4618 => 100.3624, std.dev.: 1.2673)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (4.1109 => 4.2417, std.dev.: 0.0171)
  MultiSource/Applications/sgefa/sgefa: 2.90% (0.8859 => 0.9116, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.05% (5.7068 => 5.8240, std.dev.: 0.0339)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout/random: -37.86% (0.0552 => 0.0343, std.dev.: 0.0051)
  SingleSource/Benchmarks/Stanford/Towers: -20.36% (0.0663 => 0.0528, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -7.10% (1.3728 => 1.2753, std.dev.: 0.0270)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -23.27% (0.3025 => 0.2321, std.dev.: 0.0248)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.23% (0.5313 => 0.5088, std.dev.: 0.0074)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.25% (0.6497 => 0.6286, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.71% (5.4566 => 5.3088, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.22% (6.0019 => 5.8688, std.dev.: 0.0211)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.21% (3.8562 => 3.8096, std.dev.: 0.0084)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.16% (4.2680 => 4.2185, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.10% (3.5294 => 3.4906, std.dev.: 0.0116)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/simple_throw: 83.14% (0.0172 => 0.0315, std.dev.: 0.0039)
  SingleSource/Regression/C++/pointer_member: 60.95% (0.0169 => 0.0272, std.dev.: 0.0031)
  SingleSource/UnitTests/2002-05-02-CastTest: 59.53% (0.0257 => 0.0410, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/richards_benchmark: 59.24% (0.0812 => 0.1293, std.dev.: 0.0037)
  SingleSource/Regression/C++/EH/ConditionalExpr: 57.64% (0.0229 => 0.0361, std.dev.: 0.0038)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 57.43% (0.1393 => 0.2193, std.dev.: 0.0099)
  SingleSource/Regression/C++/pointer_method2: 48.64% (0.0257 => 0.0382, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/flops-8: 45.45% (0.0319 => 0.0464, std.dev.: 0.0046)
  SingleSource/UnitTests/Vector/Altivec/casts: 34.09% (0.1191 => 0.1597, std.dev.: 0.0142)
  MultiSource/Applications/spiff/spiff: 25.85% (0.9018 => 1.1349, std.dev.: 0.0182)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.77% (5.0823 => 5.9348, std.dev.: 0.2389)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.22% (4.7807 => 5.5563, std.dev.: 0.1535)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.00% (5.5433 => 6.3192, std.dev.: 0.1588)
  MultiSource/Applications/siod/siod: 13.73% (2.5491 => 2.8990, std.dev.: 0.0671)
  MultiSource/Applications/SPASS/SPASS: 11.30% (16.7177 => 18.6061, std.dev.: 0.4116)
  MultiSource/Applications/d/make_dparser: 8.84% (3.6428 => 3.9650, std.dev.: 0.1064)
  MultiSource/Applications/kimwitu++/kc: 7.81% (18.6861 => 20.1449, std.dev.: 0.1778)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.33% (2.7572 => 2.9593, std.dev.: 0.0157)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.48% (1.9834 => 2.1120, std.dev.: 0.0410)
  MultiSource/Applications/sqlite3/sqlite3: 6.10% (15.7419 => 16.7017, std.dev.: 0.1137)
  SingleSource/Benchmarks/Shootout-C++/hello: 5.95% (0.1816 => 0.1924, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.84% (0.8787 => 0.9300, std.dev.: 0.0187)
  MultiSource/Applications/lemon/lemon: 4.57% (1.2200 => 1.2757, std.dev.: 0.0127)
  SingleSource/Benchmarks/Shootout-C++/ary: 4.39% (0.2482 => 0.2591, std.dev.: 0.0007)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 72.57% (0.1345 => 0.2321, std.dev.: 0.0248)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 58.25% (0.1358 => 0.2149, std.dev.: 0.0055)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 48.77% (0.7670 => 1.1411, std.dev.: 0.0871)
  MultiSource/Benchmarks/Olden/bisort/bisort: 48.56% (0.6732 => 1.0001, std.dev.: 0.0472)
  MultiSource/Applications/minisat/minisat: 30.57% (6.3881 => 8.3407, std.dev.: 0.0581)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.04% (1.2278 => 1.4616, std.dev.: 0.0901)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.10% (2.1020 => 2.3773, std.dev.: 0.0215)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 11.44% (1.4335 => 1.5975, std.dev.: 0.0204)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 11.11% (2.8940 => 3.2156, std.dev.: 0.0346)
  SingleSource/Benchmarks/Misc/salsa20: 8.08% (7.5947 => 8.2083, std.dev.: 0.0565)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.02% (1.1019 => 1.1903, std.dev.: 0.0193)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.85% (35.9684 => 38.7919, std.dev.: 0.9500)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.69% (61.0792 => 64.5540, std.dev.: 0.9577)
  MultiSource/Benchmarks/Olden/tsp/tsp: 5.32% (1.5425 => 1.6246, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.75% (4.5883 => 4.8063, std.dev.: 0.0291)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.49% (4.0593 => 4.2417, std.dev.: 0.0171)
  MultiSource/Applications/sgefa/sgefa: 4.24% (0.8745 => 0.9116, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.11% (5.9133 => 6.1566, std.dev.: 0.0364)
  SingleSource/Benchmarks/Misc/flops: 3.98% (9.2673 => 9.6362, std.dev.: 0.0485)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.83% (4.1462 => 4.3048, std.dev.: 0.0195)
  SingleSource/Benchmarks/Shootout/lists: 3.53% (6.9930 => 7.2402, std.dev.: 0.0768)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.58% (1.2556 => 1.2880, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.07% (5.7060 => 5.8240, std.dev.: 0.0339)
  SingleSource/Benchmarks/Misc/fbench: 1.74% (4.9225 => 5.0082, std.dev.: 0.0289)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.15% (1.3505 => 1.2944, std.dev.: 0.0188)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/sim/sim: -3.28% (4.0134 => 3.8817, std.dev.: 0.0284)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.83% (3.6605 => 3.5936, std.dev.: 0.0210)
  SingleSource/Benchmarks/Misc/pi: -1.60% (1.6685 => 1.6418, std.dev.: 0.0094)

Report Time: 1.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131204/19b28815/attachment.html>


More information about the llvm-testresults mailing list