[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 10 04:54:51 PST 2013


http://llvm.org/perf/db_default/v4/nts/18246?compare_to=18243&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18246, Order: 196903, Start Time: 2013-12-10 11:09:56, End Time: 2013-12-10 12:59:05
      To: 18243, Order: 196892, Start Time: 2013-12-10 09:00:17, End Time: 2013-12-10 10:41:14
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 60 (49 on baseline)
Performance Improvements: 13 (9 on baseline)
Unchanged Tests: 1037 (1052 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/aha/aha: 67.30% (0.1257 => 0.2103, std.dev.: 0.0112)
  SingleSource/Benchmarks/Misc/flops-7: 65.15% (0.0307 => 0.0507, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 64.84% (0.0657 => 0.1083, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 49.89% (0.5532 => 0.8292, std.dev.: 0.0457)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 48.43% (0.2137 => 0.3172, std.dev.: 0.0061)
  MultiSource/Benchmarks/Prolangs-C++/family/family: 46.01% (0.0363 => 0.0530, std.dev.: 0.0027)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 44.27% (0.0951 => 0.1372, std.dev.: 0.0104)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 38.90% (0.6620 => 0.9195, std.dev.: 0.0775)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 37.30% (0.0496 => 0.0681, std.dev.: 0.0066)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.98% (1.3905 => 1.9047, std.dev.: 0.1186)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.34% (0.6783 => 0.9248, std.dev.: 0.0512)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 33.76% (0.1641 => 0.2195, std.dev.: 0.0159)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 32.41% (0.3808 => 0.5042, std.dev.: 0.0196)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 27.98% (0.7410 => 0.9483, std.dev.: 0.0210)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.70% (0.6727 => 0.8523, std.dev.: 0.0621)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 24.30% (0.8759 => 1.0887, std.dev.: 0.0544)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 21.90% (1.3993 => 1.7058, std.dev.: 0.0568)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.88% (1.0857 => 1.3233, std.dev.: 0.0569)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.25% (5.4844 => 6.4854, std.dev.: 0.1511)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.69% (9.8185 => 11.5550, std.dev.: 0.6466)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.63% (0.0692 => 0.0814, std.dev.: 0.0022)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 13.82% (43.8719 => 49.9334, std.dev.: 1.3285)
  MultiSource/Applications/kimwitu++/kc: 9.16% (18.4844 => 20.1780, std.dev.: 0.6406)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.54% (5.4606 => 5.8724, std.dev.: 0.0482)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.34% (0.2166 => 0.2325, std.dev.: 0.0055)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.33% (2.7530 => 2.9548, std.dev.: 0.0483)
  MultiSource/Applications/sqlite3/sqlite3: 7.01% (15.8153 => 16.9233, std.dev.: 0.3143)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.75% (2.5189 => 2.6890, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.49% (4.2650 => 4.5417, std.dev.: 0.0372)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.19% (0.8865 => 0.9325, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.47% (1.2415 => 1.2970, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.54% (1.2387 => 1.2826, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.38% (1.3268 => 1.3584, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.10% (1.2407 => 1.2543, std.dev.: 0.0045)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 34.04% (0.0658 => 0.0882, std.dev.: 0.0041)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 33.95% (0.0648 => 0.0868, std.dev.: 0.0047)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 30.13% (0.2758 => 0.3589, std.dev.: 0.0138)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.92% (4.5373 => 5.8947, std.dev.: 0.1994)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.28% (1.4812 => 1.8556, std.dev.: 0.0327)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 13.57% (9.4296 => 10.7089, std.dev.: 0.2911)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 11.27% (2.0978 => 2.3343, std.dev.: 0.0265)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.20% (6.2444 => 6.9437, std.dev.: 0.1443)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 11.04% (1.3096 => 1.4542, std.dev.: 0.0549)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.75% (35.7640 => 39.2510, std.dev.: 1.1974)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.27% (10.9248 => 11.9371, std.dev.: 0.0971)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.42% (2.9162 => 3.1617, std.dev.: 0.0207)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.68% (14.4329 => 15.5415, std.dev.: 0.3251)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.94% (60.3967 => 63.3833, std.dev.: 0.6277)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.89% (3.8040 => 3.9901, std.dev.: 0.0476)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.84% (4.5741 => 4.7955, std.dev.: 0.0322)
  MultiSource/Applications/sgefa/sgefa: 4.33% (0.8756 => 0.9135, std.dev.: 0.0016)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.31% (2.3239 => 2.4241, std.dev.: 0.0081)
  SingleSource/Benchmarks/Misc/flops: 3.89% (9.2699 => 9.6303, std.dev.: 0.0144)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (4.0428 => 4.1668, std.dev.: 0.0335)
  MultiSource/Applications/lua/lua: 2.88% (28.0360 => 28.8424, std.dev.: 0.1880)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.81% (21.7096 => 22.3202, std.dev.: 0.1993)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.45% (39.4202 => 40.3879, std.dev.: 0.2902)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.21% (3.6270 => 3.7071, std.dev.: 0.0180)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.01% (15.5689 => 15.8816, std.dev.: 0.0441)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.5873 => 3.6573, std.dev.: 0.0131)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -9.85% (23.9923 => 21.6288, std.dev.: 0.2753)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.90% (0.4659 => 0.4291, std.dev.: 0.0030)
  SingleSource/Benchmarks/Stanford/Puzzle: -7.80% (0.1821 => 0.1679, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -7.30% (3.8540 => 3.5727, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/fp-convert: -6.17% (7.7987 => 7.3178, std.dev.: 0.1665)
  MultiSource/Applications/spiff/spiff: -4.10% (2.9314 => 2.8113, std.dev.: 0.0453)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.36% (0.6493 => 0.6275, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.33% (5.4357 => 5.2549, std.dev.: 0.0595)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.94% (4.3396 => 4.2120, std.dev.: 0.0138)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.70% (1.6935 => 1.6477, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.31% (2.5361 => 2.4774, std.dev.: 0.0037)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.03% (51.8390 => 50.7873, std.dev.: 0.2227)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.02% (2.5277 => 2.4767, std.dev.: 0.0085)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-7: 69.57% (0.0299 => 0.0507, std.dev.: 0.0024)
  MultiSource/Applications/aha/aha: 67.17% (0.1258 => 0.2103, std.dev.: 0.0112)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 64.34% (0.0659 => 0.1083, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 48.16% (0.0926 => 0.1372, std.dev.: 0.0104)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 46.42% (0.5663 => 0.8292, std.dev.: 0.0457)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 40.85% (0.2252 => 0.3172, std.dev.: 0.0061)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 39.38% (0.6597 => 0.9195, std.dev.: 0.0775)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 37.02% (0.0497 => 0.0681, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.62% (0.6769 => 0.9248, std.dev.: 0.0512)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.82% (1.4449 => 1.9047, std.dev.: 0.1186)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 30.66% (0.3859 => 0.5042, std.dev.: 0.0196)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 28.58% (0.7375 => 0.9483, std.dev.: 0.0210)
  MultiSource/Benchmarks/Prolangs-C++/family/family: 23.83% (0.0428 => 0.0530, std.dev.: 0.0027)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 22.60% (0.8880 => 1.0887, std.dev.: 0.0544)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.19% (1.0830 => 1.3233, std.dev.: 0.0569)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.66% (0.0686 => 0.0814, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.40% (9.8425 => 11.5550, std.dev.: 0.6466)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.00% (5.5433 => 6.4854, std.dev.: 0.1511)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.46% (1.5034 => 1.7058, std.dev.: 0.0568)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.16% (44.9186 => 49.9334, std.dev.: 1.3285)
  MultiSource/Applications/sqlite3/sqlite3: 7.50% (15.7419 => 16.9233, std.dev.: 0.3143)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.17% (2.7572 => 2.9548, std.dev.: 0.0483)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.32% (4.2717 => 4.5417, std.dev.: 0.0372)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.12% (0.8787 => 0.9325, std.dev.: 0.0173)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.93% (2.5384 => 2.6890, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.98% (1.2845 => 1.3228, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.37% (1.2670 => 1.2970, std.dev.: 0.0098)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 34.45% (0.0656 => 0.0882, std.dev.: 0.0041)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 30.13% (0.0667 => 0.0868, std.dev.: 0.0047)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 29.85% (0.2764 => 0.3589, std.dev.: 0.0138)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.79% (4.5769 => 5.8947, std.dev.: 0.1994)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.42% (1.4795 => 1.8556, std.dev.: 0.0327)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 11.05% (2.1020 => 2.3343, std.dev.: 0.0265)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.25% (2.8940 => 3.1617, std.dev.: 0.0207)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.13% (35.9684 => 39.2510, std.dev.: 1.1974)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.36% (1.1019 => 1.1940, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.83% (3.8062 => 3.9901, std.dev.: 0.0476)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.52% (4.5883 => 4.7955, std.dev.: 0.0322)
  MultiSource/Applications/sgefa/sgefa: 4.46% (0.8745 => 0.9135, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/flops: 3.92% (9.2673 => 9.6303, std.dev.: 0.0144)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.79% (2.3355 => 2.4241, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.77% (61.0792 => 63.3833, std.dev.: 0.6277)
  SingleSource/Benchmarks/McGill/chomp: 3.68% (1.0099 => 1.0471, std.dev.: 0.0131)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.35% (21.5962 => 22.3202, std.dev.: 0.1993)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.65% (4.0593 => 4.1668, std.dev.: 0.0335)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.17% (3.1547 => 3.2232, std.dev.: 0.0247)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.49% (4.4509 => 4.5171, std.dev.: 0.0151)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.33% (3.6583 => 3.7071, std.dev.: 0.0180)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.28% (15.6810 => 15.8816, std.dev.: 0.0441)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -25.44% (0.0688 => 0.0513, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.95% (1.4113 => 1.3556, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.76% (1.3127 => 1.2633, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.89% (1.2785 => 1.2543, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -7.84% (23.4696 => 21.6288, std.dev.: 0.2753)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.19% (0.4526 => 0.4291, std.dev.: 0.0030)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.72% (2.5200 => 2.4767, std.dev.: 0.0085)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.50% (7.9597 => 7.8405, std.dev.: 0.0422)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.33% (1.6699 => 1.6477, std.dev.: 0.0007)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131210/bcb0fcfe/attachment.html>


More information about the llvm-testresults mailing list