[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Sep 13 21:45:29 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15282?compare_to=15278&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15282, Order: 190738, Start Time: 2013-09-14 03:04:48, End Time: 2013-09-14 04:48:04
      To: 15278, Order: 190730, Start Time: 2013-09-14 00:53:25, End Time: 2013-09-14 02:41:50
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 36 (50 on baseline)
Performance Improvements: 12 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1059 (1041 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.61% (10.3885 => 11.9064, std.dev.: 0.1100)
  MultiSource/Applications/sgefa/sgefa: 12.20% (1.7218 => 1.9319, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/ReedSolomon: 10.27% (8.5247 => 9.3998, std.dev.: 0.1859)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.11% (6.5795 => 7.2446, std.dev.: 0.0688)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.74% (2.8367 => 3.0564, std.dev.: 0.0007)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.05% (0.8350 => 0.8939, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.84% (3.6478 => 3.8607, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.73% (3.5191 => 3.7206, std.dev.: 0.0007)
  MultiSource/Benchmarks/mafft/pairlocalalign: 4.75% (47.4573 => 49.7121, std.dev.: 0.7105)
  MultiSource/Applications/aha/aha: 4.66% (3.6098 => 3.7779, std.dev.: 0.0056)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.63% (0.6970 => 0.7293, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.56% (1.2926 => 1.3515, std.dev.: 0.0010)
  MultiSource/Applications/hexxagon/hexxagon: 4.33% (14.5649 => 15.1956, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.28% (5.0339 => 5.2491, std.dev.: 0.0029)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.16% (2.1248 => 2.2131, std.dev.: 0.0002)
  SingleSource/Regression/C/uint64_to_float: 4.02% (1.4237 => 1.4810, std.dev.: 0.0033)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.55% (1.8323 => 1.8973, std.dev.: 0.0029)
  MultiSource/Applications/obsequi/Obsequi: 3.54% (2.2822 => 2.3629, std.dev.: 0.0013)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.2577 => 1.3021, std.dev.: 0.0045)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.10% (2.4589 => 2.5351, std.dev.: 0.0041)
  MultiSource/Benchmarks/sim/sim: 2.98% (3.9427 => 4.0603, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.81% (5.8331 => 5.9971, std.dev.: 0.0109)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.73% (1.6500 => 1.6950, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.44% (4.0332 => 4.1315, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.14% (3.1534 => 3.2210, std.dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (1.0492 => 1.0689, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.77% (6.5775 => 6.6942, std.dev.: 0.0335)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.70% (2.3780 => 2.4184, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.60% (5.5356 => 5.6243, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.58% (11.7954 => 11.9816, std.dev.: 0.0486)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.45% (3.7909 => 3.8458, std.dev.: 0.0087)
  MultiSource/Applications/siod/siod: 1.44% (3.5797 => 3.6313, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.39% (1.0507 => 1.0653, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.38% (5.3636 => 5.4375, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.12% (5.9451 => 6.0116, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.09% (1.2796 => 1.2935, std.dev.: 0.0018)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.40% (0.3446 => 0.3329, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.43% (1.3606 => 1.3276, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.27% (1.6175 => 1.5808, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.97% (0.6788 => 0.6654, std.dev.: 0.0025)
  MultiSource/Benchmarks/nbench/nbench: -1.83% (1.2755 => 1.2522, std.dev.: 0.0046)
  MultiSource/Applications/minisat/minisat: -1.73% (0.7638 => 0.7506, std.dev.: 0.0010)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.49% (0.9372 => 0.9232, std.dev.: 0.0054)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -1.47% (1.1709 => 1.1537, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.27% (1.3265 => 1.3096, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.14% (1.4914 => 1.4744, std.dev.: 0.0058)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.3061 => 1.2409, std.dev.: 0.0234)
  MultiSource/Applications/lemon/lemon: -2.13% (0.8687 => 0.8502, std.dev.: 0.0038)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 5.89% (0.1274 => 0.1349, std.dev.: 0.0152)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.72% (0.4624 => 0.4796, std.dev.: 0.0002)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.71% (0.8014 => 0.8231, std.dev.: 0.0068)
  MultiSource/Applications/siod/siod: 2.49% (2.4480 => 2.5089, std.dev.: 0.0080)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.94% (0.9828 => 1.0019, std.dev.: 0.0064)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.88% (1.1393 => 1.1607, std.dev.: 0.0055)
  MultiSource/Applications/lemon/lemon: 1.80% (1.1862 => 1.2076, std.dev.: 0.0012)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.52% (1.0756 => 1.0919, std.dev.: 0.0016)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.43% (24.6139 => 24.9667, std.dev.: 0.0647)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.34% (9.9903 => 10.1241, std.dev.: 0.0241)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (14.4764 => 14.6697, std.dev.: 0.0314)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.31% (7.2661 => 7.3613, std.dev.: 0.0207)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.08% (1.0952 => 1.1070, std.dev.: 0.0010)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 22.35% (1.5790 => 1.9319, std.dev.: 0.0007)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.41% (0.1374 => 0.1627, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.45% (6.4425 => 7.2446, std.dev.: 0.0688)
  SingleSource/Benchmarks/Misc/ReedSolomon: 10.25% (8.5256 => 9.3998, std.dev.: 0.1859)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.60% (3.5550 => 3.8607, std.dev.: 0.0034)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.05% (0.8273 => 0.8939, std.dev.: 0.0086)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.98% (1.2516 => 1.3515, std.dev.: 0.0010)
  MultiSource/Applications/obsequi/Obsequi: 7.97% (2.1884 => 2.3629, std.dev.: 0.0013)
  MultiSource/Benchmarks/sim/sim: 5.98% (3.8312 => 4.0603, std.dev.: 0.0040)
  MultiSource/Applications/aha/aha: 5.73% (3.5731 => 3.7779, std.dev.: 0.0056)
  SingleSource/UnitTests/Vector/multiplies: 5.72% (0.5561 => 0.5879, std.dev.: 0.0109)
  SingleSource/Benchmarks/McGill/misr: 5.09% (0.3771 => 0.3963, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 4.84% (20.8247 => 21.8324, std.dev.: 0.1405)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.39% (3.5642 => 3.7206, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.83% (5.7757 => 5.9971, std.dev.: 0.0109)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.07% (2.1472 => 2.2131, std.dev.: 0.0002)
  MultiSource/Applications/siod/siod: 2.84% (3.5310 => 3.6313, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.82% (4.0181 => 4.1315, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.82% (0.3836 => 0.3944, std.dev.: 0.0029)
  MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.7810 => 15.1956, std.dev.: 0.0088)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.66% (1.7652 => 1.8121, std.dev.: 0.0017)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.49% (0.5182 => 0.5311, std.dev.: 0.0003)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.45% (1.8519 => 1.8973, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.40% (5.4925 => 5.6243, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.20% (3.5683 => 3.6468, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.03% (3.1569 => 3.2210, std.dev.: 0.0000)
  MultiSource/Benchmarks/Olden/power/power: 2.03% (1.2170 => 1.2417, std.dev.: 0.0023)
  SingleSource/Regression/C/uint64_to_float: 1.94% (1.4528 => 1.4810, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.93% (5.3022 => 5.4046, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.91% (1.5940 => 1.6245, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.84% (11.7654 => 11.9816, std.dev.: 0.0486)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (2.4920 => 2.5351, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653, std.dev.: 0.0007)
  MultiSource/Applications/sqlite3/sqlite3: 1.65% (4.2733 => 4.3439, std.dev.: 0.0041)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.54% (3.7874 => 3.8458, std.dev.: 0.0087)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6950, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.38% (6.6028 => 6.6942, std.dev.: 0.0335)
  SingleSource/Benchmarks/Shootout/fib2: 1.10% (3.5966 => 3.6361, std.dev.: 0.0091)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: -8.62% (0.1195 => 0.1092, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -3.12% (0.6868 => 0.6654, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.06% (0.7461 => 0.7233, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.88% (1.2622 => 1.2259, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.94% (1.2499 => 1.2256, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.77% (1.3068 => 1.2837, std.dev.: 0.0013)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.60% (0.7184 => 0.7069, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.49% (1.6047 => 1.5808, std.dev.: 0.0040)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.46% (57.2347 => 47.2428, std.dev.: 1.3139)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.93% (0.3304 => 0.2976, std.dev.: 0.0001)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.41% (3.7437 => 3.4663, std.dev.: 0.0406)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.39% (17.1431 => 16.5612, std.dev.: 0.1364)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.67% (89.7126 => 88.2133, std.dev.: 0.4700)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.53% (3.8582 => 3.7990, std.dev.: 0.0060)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.40% (39.9519 => 39.3943, std.dev.: 0.0560)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.4471 => 2.4184, std.dev.: 0.0035)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1348 => 0.1349, std.dev.: 0.0152)

Report Time: 0.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130913/7195c613/attachment.html>


More information about the llvm-testresults mailing list