[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 26 17:18:27 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12796?compare_to=12793&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12796, Order: 185024, Start Time: 2013-06-26 22:27:59, End Time: 2013-06-27 00:19:32
      To: 12793, Order: 185015, Start Time: 2013-06-26 20:15:52, End Time: 2013-06-26 22:05:26
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 31 (55 on baseline)
Performance Improvements: 11 (26 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1065 (1026 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 61.00% (0.0359 => 0.0578, std.dev.: 0.0009)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 60.93% (0.1029 => 0.1656, std.dev.: 0.0055)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 38.90% (0.0509 => 0.0707, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 15.66% (0.3473 => 0.4017, std.dev.: 0.0174)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.83% (2.6227 => 2.8544, std.dev.: 0.0652)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.78% (6.3263 => 6.8818, std.dev.: 0.0514)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.15% (1.9469 => 2.1056, std.dev.: 0.0575)
  SingleSource/Benchmarks/Shootout-C++/hash2: 7.72% (0.4753 => 0.5120, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.96% (4.2677 => 4.5647, std.dev.: 0.0090)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.84% (0.9607 => 1.0264, std.dev.: 0.0113)
  MultiSource/Benchmarks/Bullet/bullet: 6.67% (37.1142 => 39.5891, std.dev.: 0.6259)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.84% (1.6272 => 1.7223, std.dev.: 0.0079)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.75% (0.7099 => 0.7507, std.dev.: 0.0063)
  MultiSource/Applications/kimwitu++/kc: 5.20% (20.0815 => 21.1249, std.dev.: 0.0706)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.15% (1.5954 => 1.6775, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.72% (1.5666 => 1.6405, std.dev.: 0.0235)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 66.62% (5.8499 => 9.7472, std.dev.: 0.4775)
  SingleSource/Benchmarks/Shootout/heapsort: 43.16% (2.8861 => 4.1316, std.dev.: 0.2485)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 38.96% (2.9105 => 4.0444, std.dev.: 0.4151)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.00% (4.5438 => 5.8613, std.dev.: 0.1391)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 20.39% (4.0291 => 4.8505, std.dev.: 0.1515)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 20.24% (1.3062 => 1.5706, std.dev.: 0.0481)
  MultiSource/Benchmarks/nbench/nbench: 17.21% (19.2843 => 22.6022, std.dev.: 0.2333)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.88% (4.1226 => 4.8186, std.dev.: 0.2441)
  SingleSource/Benchmarks/Misc/fp-convert: 16.75% (6.9257 => 8.0859, std.dev.: 0.0165)
  SingleSource/Benchmarks/Misc/salsa20: 11.89% (8.0384 => 8.9939, std.dev.: 0.0100)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.94% (0.2883 => 0.3083, std.dev.: 0.0063)
  SingleSource/Benchmarks/Misc/flops-4: 6.06% (1.5426 => 1.6361, std.dev.: 0.0275)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.77% (0.7217 => 0.7417, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.67% (4.2254 => 4.3381, std.dev.: 0.0272)
  SingleSource/Benchmarks/Misc/flops: 2.12% (9.6286 => 9.8332, std.dev.: 0.0081)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/McCat/05-eks/eks: -28.02% (0.7541 => 0.5428, std.dev.: 0.0759)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -20.02% (7.3674 => 5.8921, std.dev.: 0.5580)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -10.57% (1.6649 => 1.4890, std.dev.: 0.0619)
  MultiSource/Applications/sqlite3/sqlite3: -9.67% (18.3359 => 16.5636, std.dev.: 0.6363)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -34.05% (0.1295 => 0.0854, std.dev.: 0.0070)
  MultiSource/Benchmarks/McCat/08-main/main: -17.50% (0.0937 => 0.0773, std.dev.: 0.0045)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -13.24% (0.5357 => 0.4648, std.dev.: 0.0228)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.76% (0.1926 => 0.1815, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.05% (0.2830 => 0.2687, std.dev.: 0.0033)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.53% (2.5938 => 2.5283, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.26% (4.8255 => 4.7648, std.dev.: 0.0024)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -15.69% (0.1644 => 0.1386, std.dev.: 0.0032)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 65.14% (0.0350 => 0.0578, std.dev.: 0.0009)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 60.15% (0.1034 => 0.1656, std.dev.: 0.0055)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 37.28% (0.0515 => 0.0707, std.dev.: 0.0071)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 24.57% (10.1602 => 12.6568, std.dev.: 0.6814)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 17.28% (0.3425 => 0.4017, std.dev.: 0.0174)
  MultiSource/Benchmarks/Bullet/bullet: 11.43% (35.5296 => 39.5891, std.dev.: 0.6259)
  MultiSource/Benchmarks/mafft/pairlocalalign: 11.26% (10.7257 => 11.9334, std.dev.: 0.2481)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.36% (1.9079 => 2.1056, std.dev.: 0.0575)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.46% (2.6076 => 2.8544, std.dev.: 0.0652)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.38% (4.1734 => 4.5647, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.98% (1.6563 => 1.8051, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.96% (1.5806 => 1.7223, std.dev.: 0.0079)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.65% (0.2937 => 0.3191, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/hash2: 8.02% (0.4740 => 0.5120, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.97% (1.6070 => 1.7350, std.dev.: 0.0414)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.45% (1.5612 => 1.6775, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.93% (0.9599 => 1.0264, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.72% (1.5372 => 1.6405, std.dev.: 0.0235)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.65% (25.9348 => 27.6596, std.dev.: 0.2243)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.59% (1.6881 => 1.7993, std.dev.: 0.0426)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.41% (1.6993 => 1.8083, std.dev.: 0.0289)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.35% (0.7059 => 0.7507, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.40% (1.5984 => 1.6847, std.dev.: 0.0273)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.21% (2.5078 => 2.6384, std.dev.: 0.0419)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.81% (1.7006 => 1.7824, std.dev.: 0.0095)
  MultiSource/Applications/kimwitu++/kc: 4.65% (20.1855 => 21.1249, std.dev.: 0.0706)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.39% (1.5478 => 1.6157, std.dev.: 0.0258)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.90% (6.6236 => 6.8818, std.dev.: 0.0514)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.60% (1.5959 => 1.6534, std.dev.: 0.0195)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 62.12% (6.0122 => 9.7472, std.dev.: 0.4775)
  SingleSource/Benchmarks/Shootout/heapsort: 37.78% (2.9988 => 4.1316, std.dev.: 0.2485)
  MultiSource/Applications/sgefa/sgefa: 30.40% (1.1695 => 1.5250, std.dev.: 0.0147)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 26.18% (4.6452 => 5.8613, std.dev.: 0.1391)
  SingleSource/Benchmarks/Stanford/Puzzle: 21.92% (0.1455 => 0.1774, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.02% (6.1372 => 7.1818, std.dev.: 0.0844)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 16.13% (4.1768 => 4.8505, std.dev.: 0.1515)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 16.08% (1.3530 => 1.5706, std.dev.: 0.0481)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.70% (0.9806 => 1.1346, std.dev.: 0.0162)
  SingleSource/Benchmarks/Misc/pi: 11.55% (1.8318 => 2.0433, std.dev.: 0.0628)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.61% (5.2003 => 5.6483, std.dev.: 0.0449)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.20% (0.2876 => 0.3083, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.87% (3.1853 => 3.4041, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.93% (4.6639 => 4.9403, std.dev.: 0.0289)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.03% (5.9362 => 6.2350, std.dev.: 0.0176)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.49% (2.8994 => 3.0297, std.dev.: 0.0167)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.21% (1.0571 => 1.1016, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/lowercase: 3.91% (0.7746 => 0.8049, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.74% (4.6379 => 4.7648, std.dev.: 0.0024)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (4.3727 => 4.4855, std.dev.: 0.0277)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.47% (4.2334 => 4.3381, std.dev.: 0.0272)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.26% (39.9248 => 40.8254, std.dev.: 0.1214)
  SingleSource/Benchmarks/Misc/flops-7: 2.02% (1.7987 => 1.8351, std.dev.: 0.0109)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.00% (2.5309 => 2.5814, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.86% (5.6582 => 5.7633, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.72% (3.6122 => 3.6744, std.dev.: 0.0098)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -23.12% (0.2431 => 0.1869, std.dev.: 0.0172)
  SingleSource/Benchmarks/Misc/whetstone: -12.40% (0.1097 => 0.0961, std.dev.: 0.0030)
  SingleSource/Benchmarks/Linpack/linpack-pc: -5.00% (0.2738 => 0.2601, std.dev.: 0.0039)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -42.55% (1.2911 => 0.7417, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -38.05% (4.4050 => 2.7287, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.83% (4.8986 => 3.8784, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.92% (5.7264 => 4.5858, std.dev.: 0.0524)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.87% (6.2328 => 5.0567, std.dev.: 0.0199)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.19% (25.3677 => 21.2601, std.dev.: 0.0253)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.60% (48.3307 => 41.7564, std.dev.: 0.0902)
  SingleSource/Benchmarks/Misc/salsa20: -13.02% (10.3398 => 8.9939, std.dev.: 0.0100)
  MultiSource/Applications/siod/siod: -9.86% (3.7240 => 3.3568, std.dev.: 0.0965)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.52% (1.6679 => 1.5258, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.07% (4.5717 => 4.2484, std.dev.: 0.0046)
  MultiSource/Applications/sqlite3/sqlite3: -6.99% (4.6358 => 4.3118, std.dev.: 0.0888)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.68% (0.1945 => 0.1815, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.59% (5.5889 => 5.2205, std.dev.: 0.0298)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.82% (9.8728 => 9.2984, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.35% (5.3184 => 5.0873, std.dev.: 0.0278)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.96% (9.1099 => 8.7487, std.dev.: 0.0740)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.92% (5.3276 => 5.1190, std.dev.: 0.0411)
  SingleSource/Benchmarks/Misc/flops: -3.76% (10.2170 => 9.8332, std.dev.: 0.0081)
  MultiSource/Applications/hexxagon/hexxagon: -3.58% (15.4979 => 14.9436, std.dev.: 0.0475)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.97% (5.7342 => 5.5641, std.dev.: 0.0447)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.78% (3.8665 => 3.7592, std.dev.: 0.0135)
  SingleSource/Benchmarks/Shootout/sieve: -2.39% (8.0178 => 7.8265, std.dev.: 0.0183)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.82% (0.1441 => 0.1386, std.dev.: 0.0032)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130626/133ce2c1/attachment.html>


More information about the llvm-testresults mailing list