[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue May 28 06:01:08 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11802?compare_to=11798&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11802, Order: 182763, Start Time: 2013-05-28 11:05:21, End Time: 2013-05-28 13:01:39
      To: 11798, Order: 182755, Start Time: 2013-05-28 08:51:38, End Time: 2013-05-28 10:41:05
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 37 (41 on baseline)
Performance Improvements: 10 (12 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1060 (1054 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/shr: 53.74% (0.0348 => 0.0535, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/RealMM: 44.27% (0.0445 => 0.0642, std.dev.: 0.0037)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 43.61% (0.9451 => 1.3573, std.dev.: 0.0523)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 40.00% (0.1040 => 0.1456, std.dev.: 0.0136)
  SingleSource/Benchmarks/Stanford/IntMM: 38.24% (0.0442 => 0.0611, std.dev.: 0.0057)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 34.24% (0.2880 => 0.3866, std.dev.: 0.0202)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 30.88% (0.1020 => 0.1335, std.dev.: 0.0056)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 27.69% (0.2633 => 0.3362, std.dev.: 0.0073)
  SingleSource/Benchmarks/Shootout/hash: 17.79% (0.0607 => 0.0715, std.dev.: 0.0017)
  SingleSource/Benchmarks/McGill/chomp: 16.65% (0.1856 => 0.2165, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.37% (0.2915 => 0.3363, std.dev.: 0.0128)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.17% (0.9648 => 1.0629, std.dev.: 0.0142)
  MultiSource/Applications/minisat/minisat: 10.03% (0.7750 => 0.8527, std.dev.: 0.0271)
  MultiSource/Applications/kimwitu++/kc: 7.99% (19.1710 => 20.7034, std.dev.: 0.4078)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.39% (2.6133 => 2.8065, std.dev.: 0.0166)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.30% (0.2656 => 0.2850, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/sieve: 5.25% (0.3064 => 0.3225, std.dev.: 0.0029)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.05% (0.6280 => 0.6597, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.93% (0.5215 => 0.5472, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/ary2: 4.34% (0.2878 => 0.3003, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3145 => 0.3275, std.dev.: 0.0025)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 84.38% (0.1344 => 0.2478, std.dev.: 0.0142)
  SingleSource/Benchmarks/Shootout/ary3: 70.84% (5.7864 => 9.8854, std.dev.: 0.3672)
  SingleSource/Benchmarks/Shootout/heapsort: 55.58% (2.9030 => 4.5166, std.dev.: 0.0595)
  SingleSource/Benchmarks/Stanford/Towers: 55.31% (0.0226 => 0.0351, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/bisort/bisort: 39.87% (0.6742 => 0.9430, std.dev.: 0.0238)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.76% (4.5590 => 5.9158, std.dev.: 0.0444)
  MultiSource/Applications/minisat/minisat: 27.25% (6.2477 => 7.9504, std.dev.: 0.2013)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.47% (1.4871 => 1.8807, std.dev.: 0.0500)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.55% (0.0876 => 0.1056, std.dev.: 0.0026)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.90% (0.4915 => 0.5156, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.74% (20.8025 => 21.7892, std.dev.: 0.2115)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (41.1319 => 42.5700, std.dev.: 0.4559)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.42% (3.1132 => 3.2197, std.dev.: 0.0101)
  MultiSource/Benchmarks/Olden/em3d/em3d: 3.19% (5.0103 => 5.1701, std.dev.: 0.0281)
  MultiSource/Benchmarks/Olden/bh/bh: 3.06% (2.4226 => 2.4967, std.dev.: 0.0067)
  SingleSource/Benchmarks/McGill/chomp: 2.90% (1.0110 => 1.0403, std.dev.: 0.0068)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2005-11-29-LongSwitch: -37.69% (0.0268 => 0.0167, std.dev.: 0.0022)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -34.12% (0.0381 => 0.0251, std.dev.: 0.0008)
  SingleSource/UnitTests/2003-05-26-Shorts: -29.74% (0.0343 => 0.0241, std.dev.: 0.0029)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -25.42% (0.1888 => 0.1408, std.dev.: 0.0037)
  SingleSource/Regression/C++/ofstream_ctor: -16.79% (0.2806 => 0.2335, std.dev.: 0.0056)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -11.25% (0.1289 => 0.1144, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.03% (1.7642 => 1.6931, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.32% (1.6651 => 1.6099, std.dev.: 0.0147)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/methcall: -2.40% (8.5505 => 8.3450, std.dev.: 0.0781)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.82% (1.6979 => 1.6670, std.dev.: 0.0050)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.22% (0.1461 => 0.1414, std.dev.: 0.0277)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/conditional-gnu-ext-cxx: 59.78% (0.0179 => 0.0286, std.dev.: 0.0006)
  SingleSource/UnitTests/SignlessTypes/shr: 52.86% (0.0350 => 0.0535, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/RealMM: 40.17% (0.0458 => 0.0642, std.dev.: 0.0037)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 36.71% (0.1065 => 0.1456, std.dev.: 0.0136)
  SingleSource/Benchmarks/Stanford/IntMM: 34.29% (0.0455 => 0.0611, std.dev.: 0.0057)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 31.60% (1.0314 => 1.3573, std.dev.: 0.0523)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.56% (0.2961 => 0.3866, std.dev.: 0.0202)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.50% (0.1081 => 0.1335, std.dev.: 0.0056)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.12% (0.2753 => 0.3362, std.dev.: 0.0073)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.73% (0.2881 => 0.3363, std.dev.: 0.0128)
  SingleSource/Benchmarks/McGill/chomp: 15.41% (0.1876 => 0.2165, std.dev.: 0.0014)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.63% (2.6076 => 2.8065, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 7.27% (1.5735 => 1.6879, std.dev.: 0.0131)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.75% (0.9957 => 1.0629, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 6.59% (1.5612 => 1.6641, std.dev.: 0.0361)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.48% (0.6254 => 0.6597, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.31% (0.5196 => 0.5472, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.20% (0.3113 => 0.3275, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/sieve: 4.44% (0.3088 => 0.3225, std.dev.: 0.0029)
  SingleSource/Benchmarks/Linpack/linpack-pc: 4.09% (0.2738 => 0.2850, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.01% (1.5478 => 1.6099, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.92% (1.6881 => 1.7543, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.88% (1.6299 => 1.6931, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.20% (1.8435 => 1.9025, std.dev.: 0.0194)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: 76.38% (0.0199 => 0.0351, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout/ary3: 64.42% (6.0122 => 9.8854, std.dev.: 0.3672)
  SingleSource/Benchmarks/Shootout/heapsort: 50.61% (2.9988 => 4.5166, std.dev.: 0.0595)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 27.35% (4.6452 => 5.9158, std.dev.: 0.0444)
  MultiSource/Benchmarks/Olden/mst/mst: 18.06% (0.2099 => 0.2478, std.dev.: 0.0142)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.78% (0.0920 => 0.1056, std.dev.: 0.0026)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.11% (0.9806 => 1.1092, std.dev.: 0.0383)
  MultiSource/Benchmarks/Olden/bisort/bisort: 9.57% (0.8606 => 0.9430, std.dev.: 0.0238)
  MultiSource/Applications/minisat/minisat: 7.87% (7.3703 => 7.9504, std.dev.: 0.2013)
  MultiSource/Applications/lua/lua: 7.18% (28.2496 => 30.2787, std.dev.: 0.3684)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.80% (40.6198 => 42.5700, std.dev.: 0.4559)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.37% (0.4988 => 0.5156, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.96% (6.1372 => 6.3189, std.dev.: 0.0695)
  SingleSource/Benchmarks/McGill/chomp: 2.35% (1.0164 => 1.0403, std.dev.: 0.0068)
  MultiSource/Benchmarks/Olden/bh/bh: 2.18% (2.4435 => 2.4967, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.21% (11.4990 => 11.6377, std.dev.: 0.0299)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.21% (4.5935 => 4.6489, std.dev.: 0.0204)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.31% (0.0803 => 0.0672, std.dev.: 0.0034)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -9.92% (0.1563 => 0.1408, std.dev.: 0.0037)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.43% (1.2911 => 0.7304, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.40% (4.4050 => 3.2423, std.dev.: 0.0343)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.68% (6.2328 => 5.0685, std.dev.: 0.0273)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.93% (25.3677 => 21.3268, std.dev.: 0.0375)
  SingleSource/Benchmarks/Misc/salsa20: -13.24% (10.3398 => 8.9709, std.dev.: 0.0149)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.86% (3.5327 => 3.2197, std.dev.: 0.0101)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.97% (48.3307 => 44.4792, std.dev.: 0.0246)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.44% (0.6548 => 0.6323, std.dev.: 0.0080)
  SingleSource/Benchmarks/Misc/flops: -3.39% (10.2170 => 9.8706, std.dev.: 0.0169)
  MultiSource/Applications/JM/lencod/lencod: -2.50% (7.0353 => 6.8591, std.dev.: 0.0576)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.87% (0.1441 => 0.1414, std.dev.: 0.0277)

Report Time: 1.19s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130528/ab438687/attachment.html>


More information about the llvm-testresults mailing list