[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Sep 27 18:17:15 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15743?compare_to=15740&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15743, Order: 191579, Start Time: 2013-09-27 23:25:38, End Time: 2013-09-28 01:20:04
      To: 15740, Order: 191551, Start Time: 2013-09-27 20:58:53, End Time: 2013-09-27 22:57:16
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 29 (56 on baseline)
Performance Improvements: 20 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1058 (1038 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: 74.65% (0.0856 => 0.1495, std.dev.: 0.0057)
  SingleSource/Benchmarks/Stanford/Perm: 66.09% (0.0348 => 0.0578, std.dev.: 0.0055)
  SingleSource/Benchmarks/Stanford/RealMM: 62.55% (0.0462 => 0.0751, std.dev.: 0.0034)
  SingleSource/Benchmarks/Stanford/Towers: 62.52% (0.0531 => 0.0863, std.dev.: 0.0015)
  SingleSource/Benchmarks/Stanford/Treesort: 62.14% (0.0486 => 0.0788, std.dev.: 0.0048)
  SingleSource/Benchmarks/Stanford/Bubblesort: 52.09% (0.0407 => 0.0619, std.dev.: 0.0048)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 9.87% (0.1865 => 0.2049, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.47% (1.2592 => 1.3658, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.09% (1.2220 => 1.3086, std.dev.: 0.0205)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.93% (0.2020 => 0.2160, std.dev.: 0.0029)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.98% (2.9296 => 3.0754, std.dev.: 0.0032)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Queens: 62.35% (0.0255 => 0.0414, std.dev.: 0.0021)
  SingleSource/Benchmarks/Stanford/Quicksort: 47.41% (0.0270 => 0.0398, std.dev.: 0.0010)
  SingleSource/Benchmarks/Stanford/Treesort: 43.39% (0.0726 => 0.1041, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 30.68% (0.0577 => 0.0754, std.dev.: 0.0006)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.90% (0.4553 => 0.5550, std.dev.: 0.0319)
  MultiSource/Applications/obsequi/Obsequi: 16.89% (2.3206 => 2.7126, std.dev.: 0.0194)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.06% (1.3279 => 1.4880, std.dev.: 0.0557)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 11.84% (1.5005 => 1.6782, std.dev.: 0.0645)
  SingleSource/Benchmarks/Shootout/ary3: 10.67% (5.5219 => 6.1113, std.dev.: 0.2136)
  SingleSource/Benchmarks/Dhrystone/dry: 8.07% (0.5055 => 0.5463, std.dev.: 0.0105)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.99% (2.8603 => 3.0603, std.dev.: 0.0750)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 5.79% (1.4537 => 1.5379, std.dev.: 0.0165)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 5.66% (3.7265 => 3.9373, std.dev.: 0.0266)
  MultiSource/Applications/lua/lua: 3.33% (29.8190 => 30.8131, std.dev.: 0.2625)
  SingleSource/Benchmarks/Shootout-C++/fibo: 2.55% (5.3445 => 5.4808, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.31% (6.5335 => 6.6843, std.dev.: 0.0112)
  SingleSource/Benchmarks/Shootout-C++/ary3: 2.26% (4.9281 => 5.0393, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.04% (4.2808 => 4.3680, std.dev.: 0.0133)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2003-05-23-TransparentUnion: -44.68% (0.0282 => 0.0156, std.dev.: 0.0044)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -43.73% (0.3947 => 0.2221, std.dev.: 0.0306)
  SingleSource/Regression/C/casts: -43.30% (0.0642 => 0.0364, std.dev.: 0.0031)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -38.97% (0.1786 => 0.1090, std.dev.: 0.0093)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -20.00% (0.6640 => 0.5312, std.dev.: 0.0327)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -19.28% (1.6428 => 1.3260, std.dev.: 0.0973)
  MultiSource/Benchmarks/MallocBench/gs/gs: -19.28% (5.7685 => 4.6566, std.dev.: 0.0506)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -16.91% (0.5103 => 0.4240, std.dev.: 0.0230)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -13.68% (0.1316 => 0.1136, std.dev.: 0.0018)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.12% (11.3088 => 10.2769, std.dev.: 0.0816)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -8.93% (1.5661 => 1.4263, std.dev.: 0.0312)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.75% (1.3043 => 1.2162, std.dev.: 0.0192)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -18.74% (0.1019 => 0.0828, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -18.02% (26.4536 => 21.6856, std.dev.: 1.7849)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -13.31% (11.1428 => 9.6592, std.dev.: 0.1226)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.14% (6.4581 => 5.9967, std.dev.: 0.1724)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.36% (3.7149 => 3.5159, std.dev.: 0.0393)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.71% (3.9993 => 3.8909, std.dev.: 0.0280)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.35% (2.5618 => 2.5016, std.dev.: 0.0193)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.64% (4.6093 => 4.5339, std.dev.: 0.0256)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.45% (0.1378 => 0.1358, std.dev.: 0.0260)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/Perm: 78.95% (0.0323 => 0.0578, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout/matrix: 78.40% (0.0838 => 0.1495, std.dev.: 0.0057)
  SingleSource/Benchmarks/Stanford/Towers: 74.34% (0.0495 => 0.0863, std.dev.: 0.0015)
  SingleSource/Benchmarks/Stanford/Treesort: 73.57% (0.0454 => 0.0788, std.dev.: 0.0048)
  SingleSource/Benchmarks/Stanford/RealMM: 66.89% (0.0450 => 0.0751, std.dev.: 0.0034)
  SingleSource/Benchmarks/Stanford/Bubblesort: 65.95% (0.0373 => 0.0619, std.dev.: 0.0048)
  SingleSource/Regression/C/badidx: 64.26% (0.0263 => 0.0432, std.dev.: 0.0018)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 23.66% (0.1657 => 0.2049, std.dev.: 0.0048)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.92% (4.6423 => 5.6137, std.dev.: 0.3218)
  SingleSource/Regression/C/bigstack: 16.91% (0.0615 => 0.0719, std.dev.: 0.0030)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.09% (2.6492 => 3.0754, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.38% (1.2086 => 1.3945, std.dev.: 0.0159)
  MultiSource/Applications/sgefa/sgefa: 13.12% (0.3848 => 0.4353, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.39% (1.2152 => 1.3658, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.28% (1.3514 => 1.5174, std.dev.: 0.0156)
  MultiSource/Applications/siod/siod: 11.53% (2.4480 => 2.7303, std.dev.: 0.0675)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.30% (1.2695 => 1.4129, std.dev.: 0.0517)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.77% (0.1950 => 0.2160, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.71% (1.3365 => 1.4663, std.dev.: 0.0317)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.99% (1.2007 => 1.3086, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.70% (1.3123 => 1.4265, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.93% (1.3498 => 1.4164, std.dev.: 0.0248)
  MultiSource/Applications/minisat/minisat: 3.56% (0.7439 => 0.7704, std.dev.: 0.0094)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.87% (9.9903 => 10.2769, std.dev.: 0.0816)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Queens: 71.78% (0.0241 => 0.0414, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.29% (7.6426 => 12.4799, std.dev.: 0.0792)
  SingleSource/Benchmarks/Stanford/Quicksort: 46.86% (0.0271 => 0.0398, std.dev.: 0.0010)
  SingleSource/Benchmarks/Stanford/Treesort: 44.38% (0.0721 => 0.1041, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/bisort/bisort: 43.69% (0.6647 => 0.9551, std.dev.: 0.0517)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 40.12% (1.7197 => 2.4096, std.dev.: 0.1014)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 38.72% (0.1374 => 0.1906, std.dev.: 0.0133)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 30.90% (0.0576 => 0.0754, std.dev.: 0.0006)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.34% (0.4258 => 0.5550, std.dev.: 0.0319)
  SingleSource/Benchmarks/Shootout/ary3: 30.11% (4.6972 => 6.1113, std.dev.: 0.2136)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 27.69% (1.3143 => 1.6782, std.dev.: 0.0645)
  MultiSource/Applications/obsequi/Obsequi: 23.95% (2.1884 => 2.7126, std.dev.: 0.0194)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 23.63% (2.4753 => 3.0603, std.dev.: 0.0750)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.39% (1.3008 => 1.4880, std.dev.: 0.0557)
  SingleSource/Benchmarks/Dhrystone/dry: 12.11% (0.4873 => 0.5463, std.dev.: 0.0105)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.88% (4.9428 => 5.4808, std.dev.: 0.0109)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 8.16% (3.6401 => 3.9373, std.dev.: 0.0266)
  SingleSource/UnitTests/Vector/multiplies: 7.80% (0.5561 => 0.5995, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.51% (4.1011 => 4.3680, std.dev.: 0.0133)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.33% (8.1346 => 8.6492, std.dev.: 0.0761)
  SingleSource/Benchmarks/Misc/salsa20: 5.03% (7.7964 => 8.1889, std.dev.: 0.0554)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.89% (5.9061 => 6.1947, std.dev.: 0.0255)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.68% (6.5990 => 6.9076, std.dev.: 0.0302)
  MultiSource/Applications/lua/lua: 4.38% (29.5202 => 30.8131, std.dev.: 0.2625)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.23% (1.4898 => 1.5379, std.dev.: 0.0165)
  SingleSource/Benchmarks/Misc/ffbench: 2.89% (1.4030 => 1.4436, std.dev.: 0.0147)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.86% (3.1730 => 3.2636, std.dev.: 0.0219)
  MultiSource/Benchmarks/Olden/power/power: 2.34% (1.2170 => 1.2455, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.20% (5.6951 => 5.8204, std.dev.: 0.0175)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.51% (16.7972 => 17.0500, std.dev.: 0.0651)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.23% (6.6028 => 6.6843, std.dev.: 0.0112)
  SingleSource/Benchmarks/Misc/dt: 1.07% (0.9773 => 0.9878, std.dev.: 0.0007)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -49.98% (0.5226 => 0.2614, std.dev.: 0.0083)
  MultiSource/Applications/sgefa/sgefa: -46.80% (1.5790 => 0.8400, std.dev.: 0.0370)
  SingleSource/Benchmarks/Linpack/linpack-pc: -18.69% (57.2347 => 46.5349, std.dev.: 2.4731)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.64% (15.9508 => 13.1371, std.dev.: 0.3830)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.77% (20.8247 => 18.3728, std.dev.: 0.0401)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.82% (50.0284 => 46.1137, std.dev.: 0.5269)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.93% (4.3592 => 4.1878, std.dev.: 0.0326)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.55% (2.5938 => 2.5016, std.dev.: 0.0193)
  SingleSource/Benchmarks/Misc/fp-convert: -3.41% (7.5877 => 7.3290, std.dev.: 0.1002)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.85% (5.4473 => 5.2919, std.dev.: 0.0538)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.88% (17.1431 => 16.8202, std.dev.: 0.0603)
  SingleSource/Regression/C/uint64_to_float: -1.59% (1.4528 => 1.4297, std.dev.: 0.0035)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.16% (89.7126 => 88.6728, std.dev.: 0.2235)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.74% (0.1348 => 0.1358, std.dev.: 0.0260)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130927/9931eefa/attachment.html>


More information about the llvm-testresults mailing list