[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 7 13:38:15 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16078?compare_to=16075&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16078, Order: 192117, Start Time: 2013-10-07 18:45:00, End Time: 2013-10-07 20:41:15
      To: 16075, Order: 192104, Start Time: 2013-10-07 16:28:19, End Time: 2013-10-07 18:19:42
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 39 (57 on baseline)
Performance Improvements: 13 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1055 (1037 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 77.45% (0.1215 => 0.2156, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 69.81% (0.0785 => 0.1333, std.dev.: 0.0059)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 63.04% (0.0836 => 0.1363, std.dev.: 0.0065)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.36% (0.2740 => 0.3435, std.dev.: 0.0129)
  MultiSource/Benchmarks/Olden/power/power: 22.13% (0.1428 => 0.1744, std.dev.: 0.0115)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.56% (0.0763 => 0.0897, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.68% (1.2659 => 1.4771, std.dev.: 0.0277)
  MultiSource/Applications/JM/ldecod/ldecod: 13.87% (7.5805 => 8.6318, std.dev.: 0.1861)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 12.24% (0.1430 => 0.1605, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.72% (1.2541 => 1.4011, std.dev.: 0.0269)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.49% (1.3191 => 1.4707, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.37% (1.3172 => 1.4670, std.dev.: 0.0137)
  MultiSource/Applications/oggenc/oggenc: 10.59% (5.4448 => 6.0214, std.dev.: 0.0496)
  MultiSource/Applications/sqlite3/sqlite3: 10.31% (16.7079 => 18.4311, std.dev.: 0.3994)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.20% (1.2393 => 1.3657, std.dev.: 0.0407)
  MultiSource/Applications/lemon/lemon: 8.09% (1.2205 => 1.3192, std.dev.: 0.0311)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.35% (0.2870 => 0.3081, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.09% (1.2688 => 1.3588, std.dev.: 0.0258)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 73.33% (0.1376 => 0.2385, std.dev.: 0.0349)
  MultiSource/Benchmarks/Olden/bisort/bisort: 51.90% (0.6619 => 1.0054, std.dev.: 0.0109)
  MultiSource/Applications/JM/ldecod/ldecod: 50.69% (0.0655 => 0.0987, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.28% (1.4825 => 1.9018, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 24.37% (0.4596 => 0.5716, std.dev.: 0.0066)
  MultiSource/Applications/oggenc/oggenc: 20.98% (0.1625 => 0.1966, std.dev.: 0.0069)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.52% (2.4927 => 3.0042, std.dev.: 0.0559)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.50% (1.2895 => 1.5539, std.dev.: 0.0556)
  MultiSource/Benchmarks/llubenchmark/llu: 16.00% (2.0067 => 2.3278, std.dev.: 0.0780)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.31% (0.2943 => 0.3217, std.dev.: 0.0038)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.07% (39.3837 => 42.5630, std.dev.: 0.0961)
  MultiSource/Applications/sgefa/sgefa: 7.87% (0.8352 => 0.9009, std.dev.: 0.0040)
  MultiSource/Benchmarks/Bullet/bullet: 7.62% (7.2423 => 7.7944, std.dev.: 0.0576)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.69% (0.8406 => 0.8884, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.00% (5.2134 => 5.4741, std.dev.: 0.0153)
  MultiSource/Benchmarks/Olden/bh/bh: 4.42% (2.3799 => 2.4851, std.dev.: 0.0253)
  MultiSource/Applications/siod/siod: 2.51% (3.6032 => 3.6936, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.90% (16.0297 => 16.3343, std.dev.: 0.1167)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.80% (4.2418 => 4.3180, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.30% (5.7899 => 5.8652, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout/methcall: 1.28% (8.5513 => 8.6604, std.dev.: 0.0235)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -21.31% (0.4016 => 0.3160, std.dev.: 0.0045)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -16.02% (0.1311 => 0.1101, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -14.35% (0.0906 => 0.0776, std.dev.: 0.0016)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -9.55% (0.9360 => 0.8466, std.dev.: 0.0240)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Queens: -33.00% (0.0403 => 0.0270, std.dev.: 0.0029)
  MultiSource/Benchmarks/MallocBench/gs/gs: -15.43% (0.0998 => 0.0844, std.dev.: 0.0003)
  SingleSource/Benchmarks/McGill/misr: -3.95% (0.4131 => 0.3968, std.dev.: 0.0057)
  MultiSource/Applications/aha/aha: -3.94% (3.7235 => 3.5767, std.dev.: 0.0239)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.09% (5.6146 => 5.4970, std.dev.: 0.0351)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.87% (3.5593 => 3.4927, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.52% (6.9714 => 6.8653, std.dev.: 0.0359)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.49% (1.2116 => 1.1935, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.17% (6.6536 => 6.5756, std.dev.: 0.0180)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.59% (0.1350 => 0.1288, std.dev.: 0.0089)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 76.87% (0.1219 => 0.2156, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 73.12% (0.0770 => 0.1333, std.dev.: 0.0059)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 66.42% (0.0819 => 0.1363, std.dev.: 0.0065)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.89% (0.2686 => 0.3435, std.dev.: 0.0129)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 25.42% (0.0472 => 0.0592, std.dev.: 0.0034)
  MultiSource/Benchmarks/Olden/power/power: 24.75% (0.1398 => 0.1744, std.dev.: 0.0115)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 21.22% (0.0740 => 0.0897, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 17.95% (1.2523 => 1.4771, std.dev.: 0.0277)
  MultiSource/Applications/JM/ldecod/ldecod: 16.60% (7.4026 => 8.6318, std.dev.: 0.1861)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.72% (0.1387 => 0.1605, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.42% (1.4599 => 1.6704, std.dev.: 0.0747)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.73% (1.2932 => 1.4707, std.dev.: 0.0214)
  MultiSource/Applications/sqlite3/sqlite3: 13.15% (16.2888 => 18.4311, std.dev.: 0.3994)
  MultiSource/Applications/oggenc/oggenc: 12.89% (5.3339 => 6.0214, std.dev.: 0.0496)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.36% (0.8802 => 0.9890, std.dev.: 0.0362)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.61% (1.2553 => 1.4011, std.dev.: 0.0269)
  MultiSource/Applications/lemon/lemon: 11.21% (1.1862 => 1.3192, std.dev.: 0.0311)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.98% (1.3042 => 1.4474, std.dev.: 0.0514)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.48% (1.3278 => 1.4670, std.dev.: 0.0137)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.39% (0.1597 => 0.1763, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 9.81% (0.3263 => 0.3583, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.26% (1.2499 => 1.3657, std.dev.: 0.0407)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.27% (1.2550 => 1.3588, std.dev.: 0.0258)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.22% (0.2847 => 0.3081, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.90% (0.2956 => 0.3160, std.dev.: 0.0045)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 73.20% (0.1377 => 0.2385, std.dev.: 0.0349)
  SingleSource/Benchmarks/Shootout-C++/methcall: 62.81% (7.6426 => 12.4426, std.dev.: 0.0858)
  MultiSource/Applications/JM/ldecod/ldecod: 51.61% (0.0651 => 0.0987, std.dev.: 0.0071)
  MultiSource/Benchmarks/Olden/bisort/bisort: 51.26% (0.6647 => 1.0054, std.dev.: 0.0109)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.24% (1.4830 => 1.9018, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.32% (0.4673 => 0.5716, std.dev.: 0.0066)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.37% (2.4753 => 3.0042, std.dev.: 0.0559)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.46% (1.3008 => 1.5539, std.dev.: 0.0556)
  MultiSource/Benchmarks/llubenchmark/llu: 17.04% (1.9889 => 2.3278, std.dev.: 0.0780)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 15.92% (60.7119 => 70.3748, std.dev.: 3.0457)
  MultiSource/Applications/oggenc/oggenc: 15.72% (0.1699 => 0.1966, std.dev.: 0.0069)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.19% (0.2842 => 0.3217, std.dev.: 0.0038)
  MultiSource/Benchmarks/Bullet/bullet: 10.82% (7.0333 => 7.7944, std.dev.: 0.0576)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.75% (4.9428 => 5.4741, std.dev.: 0.0153)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.87% (40.5588 => 43.7508, std.dev.: 0.9691)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.39% (0.8273 => 0.8884, std.dev.: 0.0050)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0043)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 6.54% (39.9519 => 42.5630, std.dev.: 0.0961)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.40% (8.1346 => 8.6551, std.dev.: 0.1594)
  SingleSource/Benchmarks/McGill/misr: 5.22% (0.3771 => 0.3968, std.dev.: 0.0057)
  MultiSource/Applications/siod/siod: 4.60% (3.5310 => 3.6936, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout/matrix: 4.13% (1.7809 => 1.8544, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.04% (6.5990 => 6.8653, std.dev.: 0.0359)
  MultiSource/Benchmarks/Olden/bh/bh: 3.72% (2.3959 => 2.4851, std.dev.: 0.0253)
  MultiSource/Applications/lua/lua: 3.47% (29.5202 => 30.5442, std.dev.: 0.2412)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.16% (0.5182 => 0.5346, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.40% (3.1730 => 3.2493, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.86% (4.2391 => 4.3180, std.dev.: 0.0215)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.57% (16.7972 => 17.0603, std.dev.: 0.0256)
  SingleSource/Benchmarks/Shootout/methcall: 1.37% (8.5434 => 8.6604, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.33% (5.7884 => 5.8652, std.dev.: 0.0090)
  SingleSource/Benchmarks/Misc/flops: 1.33% (9.4433 => 9.5685, std.dev.: 0.0285)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.71% (0.5226 => 0.2419, std.dev.: 0.0559)
  MultiSource/Applications/sgefa/sgefa: -42.94% (1.5790 => 0.9009, std.dev.: 0.0040)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.80% (15.9508 => 13.2707, std.dev.: 0.2219)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.42% (20.8247 => 18.4473, std.dev.: 0.1630)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.15% (3.4956 => 3.1409, std.dev.: 0.0045)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.49% (3.0561 => 2.8273, std.dev.: 0.0658)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.18% (50.0284 => 46.4372, std.dev.: 0.3042)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.77% (2.5938 => 2.4959, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.44% (5.2422 => 5.0617, std.dev.: 0.0427)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.73% (2.4471 => 2.3803, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.51% (17.1431 => 16.7124, std.dev.: 0.1339)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.01% (3.5642 => 3.4927, std.dev.: 0.0141)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.18% (89.7126 => 88.6503, std.dev.: 0.0854)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.45% (0.1348 => 0.1288, std.dev.: 0.0089)

Report Time: 1.21s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131007/25f43e50/attachment.html>


More information about the llvm-testresults mailing list