[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 8 14:02:17 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16115?compare_to=16111&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16115, Order: 192213, Start Time: 2013-10-08 19:10:47, End Time: 2013-10-08 21:05:18
      To: 16111, Order: 192185, Start Time: 2013-10-08 16:50:39, End Time: 2013-10-08 18:45:27
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 38 (67 on baseline)
Performance Improvements: 17 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1052 (1024 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/div: 58.22% (0.0359 => 0.0568, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/sumarray-dbl: 58.11% (0.0222 => 0.0351, std.dev.: 0.0041)
  MultiSource/Applications/viterbi/viterbi: 48.60% (0.2109 => 0.3134, std.dev.: 0.0254)
  MultiSource/Applications/spiff/spiff: 39.47% (0.9267 => 1.2925, std.dev.: 0.0579)
  SingleSource/UnitTests/Vector/constpool: 29.16% (9.7353 => 12.5740, std.dev.: 0.9849)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 25.73% (0.0517 => 0.0650, std.dev.: 0.0021)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 19.47% (1.3104 => 1.5655, std.dev.: 0.0456)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 13.92% (1.2567 => 1.4316, std.dev.: 0.0359)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.84% (1.3840 => 1.5756, std.dev.: 0.0615)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 13.59% (1.3621 => 1.5472, std.dev.: 0.0275)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.66% (1.2895 => 1.4528, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.63% (1.3439 => 1.5137, std.dev.: 0.0358)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.43% (1.6648 => 1.8385, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.17% (1.3148 => 1.4485, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.01% (1.3153 => 1.4470, std.dev.: 0.0417)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.35% (0.1773 => 0.1921, std.dev.: 0.0051)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 8.27% (0.5333 => 0.5774, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.80% (1.3854 => 1.4935, std.dev.: 0.0178)
  SingleSource/Benchmarks/Shootout-C++/sieve: 7.78% (0.2880 => 0.3104, std.dev.: 0.0066)
  MultiSource/Applications/SPASS/SPASS: 4.89% (19.3556 => 20.3024, std.dev.: 0.2246)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.55% (0.3610 => 0.3738, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.62% (1.4122 => 1.4351, std.dev.: 0.0064)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: 91.01% (23.7165 => 45.3010, std.dev.: 2.8284)
  MultiSource/Applications/SPASS/SPASS: 35.64% (8.4203 => 11.4209, std.dev.: 0.4280)
  MultiSource/Benchmarks/Olden/mst/mst: 29.37% (0.2298 => 0.2973, std.dev.: 0.0253)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.45% (1.4839 => 1.8912, std.dev.: 0.0235)
  MultiSource/Applications/JM/ldecod/ldecod: 27.06% (0.0765 => 0.0972, std.dev.: 0.0057)
  MultiSource/Benchmarks/nbench/nbench: 10.34% (20.1824 => 22.2693, std.dev.: 0.5389)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 7.12% (2.5489 => 2.7304, std.dev.: 0.0175)
  MultiSource/Applications/sgefa/sgefa: 6.68% (0.8424 => 0.8987, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.96% (3.5628 => 3.7753, std.dev.: 0.0221)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.80% (5.9172 => 6.2011, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.75% (4.5808 => 4.7984, std.dev.: 0.0683)
  SingleSource/Benchmarks/McGill/chomp: 3.49% (1.0707 => 1.1081, std.dev.: 0.0145)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.94% (3.1270 => 3.2188, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.6250 => 3.6876, std.dev.: 0.0032)
  MultiSource/Applications/siod/siod: 1.34% (3.6441 => 3.6929, std.dev.: 0.0074)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.33% (3.8838 => 3.9353, std.dev.: 0.0054)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/ConstructorDestructorAttributes: -47.62% (0.0294 => 0.0154, std.dev.: 0.0051)
  SingleSource/Regression/C++/BuiltinTypeInfo: -45.29% (0.0382 => 0.0209, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc/mandel: -39.78% (0.0812 => 0.0489, std.dev.: 0.0042)
  SingleSource/Regression/C/PR1386: -39.13% (0.0276 => 0.0168, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -29.61% (0.0993 => 0.0699, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -16.28% (0.3962 => 0.3317, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -16.07% (0.0915 => 0.0768, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/ary2: -13.80% (0.3217 => 0.2773, std.dev.: 0.0051)
  MultiSource/Applications/hexxagon/hexxagon: -13.73% (1.2028 => 1.0376, std.dev.: 0.0235)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -12.54% (0.1428 => 0.1249, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -11.26% (0.3385 => 0.3004, std.dev.: 0.0109)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.66% (11.2807 => 10.4161, std.dev.: 0.2499)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.60% (28.1282 => 26.5534, std.dev.: 0.5870)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -19.32% (0.0533 => 0.0430, std.dev.: 0.0015)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -8.99% (45.6690 => 41.5622, std.dev.: 1.0192)
  SingleSource/Benchmarks/Misc/flops-8: -4.00% (2.6279 => 2.5227, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.84% (3.2623 => 3.2024, std.dev.: 0.0105)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 18.76% (0.1359 => 0.1614, std.dev.: 0.0266)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/div: 63.22% (0.0348 => 0.0568, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/sumarray-dbl: 61.75% (0.0217 => 0.0351, std.dev.: 0.0041)
  MultiSource/Applications/viterbi/viterbi: 58.60% (0.1976 => 0.3134, std.dev.: 0.0254)
  MultiSource/Applications/spiff/spiff: 45.05% (0.8911 => 1.2925, std.dev.: 0.0579)
  SingleSource/UnitTests/Vector/constpool: 41.41% (8.8921 => 12.5740, std.dev.: 0.9849)
  MultiSource/Applications/sgefa/sgefa: 33.29% (0.3848 => 0.5129, std.dev.: 0.0478)
  MultiSource/Applications/JM/ldecod/ldecod: 30.68% (7.4026 => 9.6740, std.dev.: 0.4346)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 28.97% (0.0504 => 0.0650, std.dev.: 0.0021)
  MultiSource/Applications/SPASS/SPASS: 25.60% (16.1646 => 20.3024, std.dev.: 0.2246)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 23.00% (1.2728 => 1.5655, std.dev.: 0.0456)
  MultiSource/Applications/siod/siod: 20.76% (2.4480 => 2.9561, std.dev.: 0.1828)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.52% (1.2007 => 1.4351, std.dev.: 0.0064)
  MultiSource/Benchmarks/MallocBench/gs/gs: 17.99% (4.5883 => 5.4138, std.dev.: 0.2843)
  MultiSource/Applications/JM/lencod/lencod: 17.35% (16.5902 => 19.4685, std.dev.: 0.8631)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 16.72% (1.3499 => 1.5756, std.dev.: 0.0615)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 16.30% (1.3303 => 1.5472, std.dev.: 0.0275)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.95% (1.2639 => 1.4528, std.dev.: 0.0193)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.57% (1.6047 => 1.8385, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 14.57% (1.3036 => 1.4935, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.25% (1.3249 => 1.5137, std.dev.: 0.0358)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 14.14% (0.7461 => 0.8516, std.dev.: 0.0397)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 13.98% (1.4304 => 1.6304, std.dev.: 0.0615)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.88% (9.7354 => 11.0864, std.dev.: 0.1261)
  MultiSource/Applications/oggenc/oggenc: 13.66% (5.3339 => 6.0626, std.dev.: 0.1491)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 13.35% (1.2630 => 1.4316, std.dev.: 0.0359)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.11% (1.2201 => 1.3678, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.80% (1.2468 => 1.3939, std.dev.: 0.0429)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.79% (1.2152 => 1.3585, std.dev.: 0.0541)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.47% (1.2981 => 1.4470, std.dev.: 0.0417)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.84% (1.3068 => 1.4485, std.dev.: 0.0026)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 10.66% (0.1736 => 0.1921, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.54% (1.2235 => 1.3525, std.dev.: 0.0105)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 10.17% (0.5241 => 0.5774, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.55% (0.6617 => 0.7249, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.45% (1.3123 => 1.4363, std.dev.: 0.0340)
  SingleSource/Benchmarks/Shootout-C++/sieve: 9.30% (0.2840 => 0.3104, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.24% (1.2499 => 1.3654, std.dev.: 0.0373)
  SingleSource/Benchmarks/Shootout-C++/ary2: 8.11% (0.2565 => 0.2773, std.dev.: 0.0051)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.88% (24.6139 => 26.5534, std.dev.: 0.5870)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 7.70% (0.3934 => 0.4237, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.60% (6.0284 => 6.3660, std.dev.: 0.0059)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.85% (0.3565 => 0.3738, std.dev.: 0.0046)
  MultiSource/Applications/lemon/lemon: 4.05% (1.1862 => 1.2342, std.dev.: 0.0156)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 115.90% (0.1377 => 0.2973, std.dev.: 0.0253)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.82% (7.6426 => 12.5201, std.dev.: 0.0492)
  MultiSource/Applications/JM/ldecod/ldecod: 49.31% (0.0651 => 0.0972, std.dev.: 0.0057)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 45.89% (1.7197 => 2.5089, std.dev.: 0.0863)
  MultiSource/Applications/SPASS/SPASS: 38.75% (8.2311 => 11.4209, std.dev.: 0.4280)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.53% (1.4830 => 1.8912, std.dev.: 0.0235)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 27.28% (4.1004 => 5.2188, std.dev.: 0.1173)
  SingleSource/Benchmarks/McGill/chomp: 9.05% (1.0161 => 1.1081, std.dev.: 0.0145)
  MultiSource/Applications/lemon/lemon: 8.21% (0.8526 => 0.9226, std.dev.: 0.0047)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 7.63% (2.5368 => 2.7304, std.dev.: 0.0175)
  SingleSource/UnitTests/Vector/multiplies: 7.53% (0.5561 => 0.5980, std.dev.: 0.0006)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.25% (8.1346 => 8.6433, std.dev.: 0.0465)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.07% (3.5592 => 3.7753, std.dev.: 0.0221)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.56% (4.1011 => 4.3291, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.99% (5.9061 => 6.2011, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.90% (4.5744 => 4.7984, std.dev.: 0.0683)
  MultiSource/Applications/siod/siod: 4.59% (3.5310 => 3.6929, std.dev.: 0.0074)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.03% (0.5182 => 0.5339, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/power/power: 2.57% (1.2170 => 1.2483, std.dev.: 0.0118)
  MultiSource/Applications/hexxagon/hexxagon: 2.48% (14.7810 => 15.1478, std.dev.: 0.1136)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.00% (3.8582 => 3.9353, std.dev.: 0.0054)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.68% (16.7972 => 17.0797, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.57% (6.4425 => 6.5438, std.dev.: 0.0342)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.49% (3.9691 => 4.0284, std.dev.: 0.0212)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -52.05% (0.5226 => 0.2506, std.dev.: 0.0080)
  MultiSource/Applications/sgefa/sgefa: -43.08% (1.5790 => 0.8987, std.dev.: 0.0075)
  SingleSource/Benchmarks/Linpack/linpack-pc: -20.85% (57.2347 => 45.3010, std.dev.: 2.8284)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.69% (15.9508 => 13.4476, std.dev.: 0.2117)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.50% (20.8247 => 18.4301, std.dev.: 0.0884)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.92% (3.4956 => 3.2188, std.dev.: 0.0012)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.49% (50.0284 => 46.7791, std.dev.: 0.1202)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.23% (3.0561 => 2.8962, std.dev.: 0.0123)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.09% (4.3592 => 4.1810, std.dev.: 0.0640)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.99% (3.7437 => 3.5944, std.dev.: 0.0520)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.75% (2.5938 => 2.4966, std.dev.: 0.0211)
  MultiSource/Applications/JM/lencod/lencod: -2.69% (8.1785 => 7.9582, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.60% (17.1431 => 16.6972, std.dev.: 0.1153)
  SingleSource/Benchmarks/Shootout/sieve: -2.30% (7.2254 => 7.0594, std.dev.: 0.0254)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.80% (1.8519 => 1.8185, std.dev.: 0.0103)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.05% (89.7126 => 88.7672, std.dev.: 0.2645)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 19.73% (0.1348 => 0.1614, std.dev.: 0.0266)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131008/2a1c4e10/attachment.html>


More information about the llvm-testresults mailing list