[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 27 22:14:20 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14864?compare_to=14861&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14864, Order: 189435, Start Time: 2013-08-28 03:27:20, End Time: 2013-08-28 05:16:35
      To: 14861, Order: 189429, Start Time: 2013-08-28 01:10:02, End Time: 2013-08-28 03:02:25
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 3 (36 on baseline)
Performance Improvements: 45 (31 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1059 (1040 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.88% (1.4868 => 1.8865, std.dev.: 0.0043)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 2.72% (8.9868 => 9.2309, std.dev.: 0.0820)
  MultiSource/Applications/spiff/spiff: 2.37% (2.8359 => 2.9030, std.dev.: 0.0246)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/mandel: -40.70% (0.0823 => 0.0488, std.dev.: 0.0017)
  SingleSource/Benchmarks/Stanford/RealMM: -40.10% (0.0763 => 0.0457, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/flops-7: -37.27% (0.0483 => 0.0303, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/flops-3: -36.18% (0.0503 => 0.0321, std.dev.: 0.0026)
  SingleSource/Benchmarks/McGill/exptree: -35.34% (0.1508 => 0.0975, std.dev.: 0.0060)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -34.32% (0.0440 => 0.0289, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/ffbench: -34.17% (0.1229 => 0.0809, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/dt: -29.07% (0.0547 => 0.0388, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/mandel-2: -23.97% (0.0459 => 0.0349, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/constpool: -17.68% (10.5200 => 8.6602, std.dev.: 0.1719)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -15.47% (0.4299 => 0.3634, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/ReedSolomon: -14.62% (0.2750 => 0.2348, std.dev.: 0.0107)
  SingleSource/Benchmarks/Shootout-C++/methcall: -12.61% (0.2633 => 0.2301, std.dev.: 0.0052)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -10.66% (0.1257 => 0.1123, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -10.16% (0.2598 => 0.2334, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/strcat: -10.16% (0.2569 => 0.2308, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -9.36% (0.4818 => 0.4367, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc/flops: -9.19% (0.1208 => 0.1097, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/hello: -8.92% (0.2264 => 0.2062, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.56% (0.5024 => 0.4594, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout-C++/ary: -8.45% (0.3125 => 0.2861, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/hash2: -8.41% (0.5389 => 0.4936, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/ary2: -8.21% (0.3264 => 0.2996, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/lists1: -8.16% (0.3773 => 0.3465, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -7.79% (0.2374 => 0.2189, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/objinst: -7.22% (0.2619 => 0.2430, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -7.13% (0.2286 => 0.2123, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.42% (0.2399 => 0.2245, std.dev.: 0.0026)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: -40.87% (4.9629 => 2.9348, std.dev.: 0.1199)
  SingleSource/Benchmarks/Stanford/Bubblesort: -38.30% (0.0577 => 0.0356, std.dev.: 0.0031)
  SingleSource/Benchmarks/Stanford/Perm: -24.04% (0.0445 => 0.0338, std.dev.: 0.0033)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -13.70% (4.6120 => 3.9801, std.dev.: 0.1586)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -12.41% (1.2330 => 1.0800, std.dev.: 0.0495)
  SingleSource/Benchmarks/McGill/chomp: -11.04% (1.1283 => 1.0037, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -9.71% (3.7380 => 3.3752, std.dev.: 0.0724)
  SingleSource/Benchmarks/Shootout-C++/lists1: -9.71% (0.6656 => 0.6010, std.dev.: 0.0103)
  SingleSource/Benchmarks/Misc/flops-4: -8.27% (1.6708 => 1.5327, std.dev.: 0.0516)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.20% (31.8980 => 29.2835, std.dev.: 0.6635)
  SingleSource/Benchmarks/Shootout-C++/hash: -6.64% (0.8048 => 0.7514, std.dev.: 0.0105)
  SingleSource/Benchmarks/Misc/mandel: -6.49% (1.1009 => 1.0294, std.dev.: 0.0164)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -3.92% (1.5643 => 1.5030, std.dev.: 0.0056)
  SingleSource/Benchmarks/Dhrystone/dry: -3.19% (0.5265 => 0.5097, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/mandel-2: -3.15% (0.8582 => 0.8312, std.dev.: 0.0039)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.43% (0.7149 => 0.7047, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/flops-8: -1.14% (2.5798 => 2.5505, std.dev.: 0.0057)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.33% (0.1290 => 0.1320, std.dev.: 0.0211)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 46.35% (0.0466 => 0.0682, std.dev.: 0.0004)
  MultiSource/Benchmarks/FreeBench/neural/neural: 23.76% (0.2071 => 0.2563, std.dev.: 0.0092)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 77.43% (3.7285 => 6.6155, std.dev.: 0.0626)
  MultiSource/Benchmarks/FreeBench/neural/neural: 31.82% (0.3171 => 0.4180, std.dev.: 0.0325)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.52% (1.5030 => 1.8865, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout/hash: 22.98% (4.1846 => 5.1464, std.dev.: 0.2695)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.38% (9.6817 => 11.7520, std.dev.: 0.0239)
  SingleSource/Benchmarks/Shootout-C++/hash: 19.36% (0.6295 => 0.7514, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.54% (3.0680 => 3.5754, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 14.69% (2.9428 => 3.3752, std.dev.: 0.0724)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.10% (4.6576 => 5.3142, std.dev.: 0.0616)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.57% (4.9231 => 5.4925, std.dev.: 0.0024)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (7.0762 => 7.8491, std.dev.: 0.1556)
  SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1711 => 0.1882, std.dev.: 0.0031)
  SingleSource/Benchmarks/Linpack/linpack-pc: 9.34% (48.3256 => 52.8400, std.dev.: 0.2456)
  SingleSource/Benchmarks/Shootout/ary3: 8.86% (5.8158 => 6.3312, std.dev.: 0.0569)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.43% (2.9467 => 3.1952, std.dev.: 0.0126)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.30% (5.4910 => 5.9465, std.dev.: 0.0423)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.29% (3.7593 => 3.9957, std.dev.: 0.0263)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.87% (5.3042 => 5.6157, std.dev.: 0.0358)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.80% (3.3464 => 3.5406, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.50% (4.9040 => 5.1736, std.dev.: 0.0250)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.49% (3.4085 => 3.5957, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.45% (5.5008 => 5.8004, std.dev.: 0.0226)
  MultiSource/Applications/siod/siod: 5.20% (3.3761 => 3.5515, std.dev.: 0.0558)
  MultiSource/Applications/spiff/spiff: 5.15% (2.7609 => 2.9030, std.dev.: 0.0246)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 4.39% (1.4398 => 1.5030, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3657, std.dev.: 0.0181)
  SingleSource/Benchmarks/McGill/queens: 4.13% (1.6536 => 1.7219, std.dev.: 0.0077)
  SingleSource/Benchmarks/Misc/whetstone: 4.07% (3.4559 => 3.5966, std.dev.: 0.0537)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.38% (6.1245 => 6.3314, std.dev.: 0.0426)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.23% (25.0200 => 25.8275, std.dev.: 0.0419)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.97% (3.3877 => 3.4883, std.dev.: 0.0251)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.74% (1.3104 => 1.3463, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.72% (12.8625 => 13.0832, std.dev.: 0.0725)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.19% (0.1518 => 0.1257, std.dev.: 0.0089)
  MultiSource/Applications/obsequi/Obsequi: -16.22% (1.4685 => 1.2303, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -7.20% (1.6226 => 1.5058, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.86% (1.5815 => 1.4888, std.dev.: 0.0093)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.39% (2.1022 => 1.4212, std.dev.: 0.0080)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.43% (0.1189 => 0.0851, std.dev.: 0.0024)
  MultiSource/Applications/obsequi/Obsequi: -18.76% (2.6081 => 2.1189, std.dev.: 0.0791)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -15.27% (5.3098 => 4.4988, std.dev.: 0.0811)
  SingleSource/Benchmarks/Misc/mandel: -14.19% (1.1996 => 1.0294, std.dev.: 0.0164)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.23% (0.3557 => 0.3122, std.dev.: 0.0069)
  SingleSource/Benchmarks/Shootout/strcat: -11.05% (0.1593 => 0.1417, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.37% (6.9552 => 6.2336, std.dev.: 0.1983)
  SingleSource/Benchmarks/Misc/fp-convert: -6.12% (8.0730 => 7.5787, std.dev.: 0.0537)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.18% (1.7207 => 1.6316, std.dev.: 0.0130)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.93% (21.6864 => 20.6179, std.dev.: 0.2125)
  SingleSource/Benchmarks/Misc/fbench: -4.48% (4.9602 => 4.7381, std.dev.: 0.0100)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.45% (1.1024 => 1.0533, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.26% (3.8119 => 3.6496, std.dev.: 0.0162)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.19% (0.7355 => 0.7047, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.85% (1.1032 => 1.0607, std.dev.: 0.0049)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.35% (0.4783 => 0.4623, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9619, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.91% (5.0417 => 4.8951, std.dev.: 0.0212)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.66% (0.7806 => 0.7598, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.56% (5.2218 => 5.0879, std.dev.: 0.0293)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.41% (8.6172 => 8.4091, std.dev.: 0.0262)
  SingleSource/Benchmarks/Misc/oourafft: -2.20% (3.7891 => 3.7058, std.dev.: 0.0274)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.03% (34.8438 => 34.1379, std.dev.: 0.0617)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.94% (47.2250 => 46.3086, std.dev.: 0.2041)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.80% (1.8144 => 1.7817, std.dev.: 0.0044)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.18% (2.1343 => 2.1091, std.dev.: 0.0063)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.21% (0.1378 => 0.1320, std.dev.: 0.0211)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130828/7ebf74ea/attachment.html>


More information about the llvm-testresults mailing list