[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri May 31 16:40:39 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11934?compare_to=11930&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11934, Order: 183043, Start Time: 2013-05-31 21:51:23, End Time: 2013-05-31 23:41:14
      To: 11930, Order: 183028, Start Time: 2013-05-31 19:36:56, End Time: 2013-05-31 21:27:57
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 27 (31 on baseline)
Performance Improvements: 17 (29 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1063 (1047 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 74.01% (0.0558 => 0.0971, std.dev.: 0.0034)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 44.55% (0.0532 => 0.0769, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 36.51% (0.7565 => 1.0327, std.dev.: 0.0351)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 36.44% (0.7198 => 0.9821, std.dev.: 0.0277)
  MultiSource/Benchmarks/Olden/tsp/tsp: 36.01% (0.1447 => 0.1968, std.dev.: 0.0175)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 35.23% (0.1127 => 0.1524, std.dev.: 0.0153)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.56% (0.0881 => 0.1159, std.dev.: 0.0020)
  MultiSource/Benchmarks/MallocBench/gs/gs: 30.35% (4.7276 => 6.1623, std.dev.: 0.4500)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 29.74% (0.2293 => 0.2975, std.dev.: 0.0146)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 29.21% (0.6004 => 0.7758, std.dev.: 0.0656)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.53% (0.7714 => 0.9529, std.dev.: 0.0399)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.48% (5.3653 => 6.5713, std.dev.: 0.2894)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.59% (0.2904 => 0.3531, std.dev.: 0.0148)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.20% (0.7020 => 0.8508, std.dev.: 0.0356)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.75% (10.1514 => 12.0545, std.dev.: 0.7220)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 16.25% (1.3183 => 1.5325, std.dev.: 0.0744)
  MultiSource/Applications/sqlite3/sqlite3: 4.19% (17.0472 => 17.7612, std.dev.: 0.1012)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 86.68% (0.1456 => 0.2718, std.dev.: 0.0094)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 42.81% (0.0563 => 0.0804, std.dev.: 0.0050)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 33.42% (0.9153 => 1.2212, std.dev.: 0.0908)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 23.71% (1.3046 => 1.6139, std.dev.: 0.1171)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.98% (2.1112 => 2.4063, std.dev.: 0.0128)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.31% (0.1413 => 0.1601, std.dev.: 0.0038)
  MultiSource/Benchmarks/FreeBench/neural/neural: 8.72% (0.3497 => 0.3802, std.dev.: 0.0068)
  MultiSource/Applications/obsequi/Obsequi: 5.37% (2.2713 => 2.3933, std.dev.: 0.0438)
  MultiSource/Benchmarks/Olden/power/power: 1.96% (1.2452 => 1.2696, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout/methcall: 1.06% (8.4512 => 8.5410, std.dev.: 0.0247)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/PR491: -45.91% (0.0220 => 0.0119, std.dev.: 0.0017)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: -45.35% (0.0344 => 0.0188, std.dev.: 0.0024)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -39.35% (0.0432 => 0.0262, std.dev.: 0.0011)
  SingleSource/UnitTests/2008-04-20-LoopBug2: -39.23% (0.0260 => 0.0158, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -36.58% (0.1539 => 0.0976, std.dev.: 0.0176)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -34.36% (0.2267 => 0.1488, std.dev.: 0.0017)
  SingleSource/Regression/C/test_indvars: -31.85% (0.0471 => 0.0321, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/random: -27.09% (0.0454 => 0.0331, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -23.85% (0.4453 => 0.3391, std.dev.: 0.0410)
  MultiSource/Applications/d/make_dparser: -9.68% (4.0661 => 3.6726, std.dev.: 0.0330)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -8.27% (0.1414 => 0.1297, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.86% (1.4753 => 1.4479, std.dev.: 0.0060)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -12.67% (2.1169 => 1.8486, std.dev.: 0.0865)
  SingleSource/Benchmarks/Dhrystone/dry: -4.48% (0.5360 => 0.5120, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.56% (1.6637 => 1.6377, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.48% (2.9471 => 2.9036, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.46% (9.9770 => 9.8309, std.dev.: 0.0291)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.11% (0.1412 => 0.1470, std.dev.: 0.0203)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 67.13% (0.0581 => 0.0971, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 53.95% (0.2734 => 0.4209, std.dev.: 0.0109)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 47.32% (0.0522 => 0.0769, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 40.38% (0.6788 => 0.9529, std.dev.: 0.0399)
  MultiSource/Benchmarks/Olden/tsp/tsp: 38.11% (0.1425 => 0.1968, std.dev.: 0.0175)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 37.91% (0.1617 => 0.2230, std.dev.: 0.0134)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.31% (1.4253 => 1.9571, std.dev.: 0.0669)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 36.57% (0.7191 => 0.9821, std.dev.: 0.0277)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 35.95% (0.1121 => 0.1524, std.dev.: 0.0153)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 31.78% (0.5887 => 0.7758, std.dev.: 0.0656)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 31.64% (4.9917 => 6.5713, std.dev.: 0.2894)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.11% (0.0884 => 0.1159, std.dev.: 0.0020)
  MultiSource/Benchmarks/MallocBench/gs/gs: 30.86% (4.7091 => 6.1623, std.dev.: 0.4500)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 29.74% (0.2293 => 0.2975, std.dev.: 0.0146)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 28.69% (0.8025 => 1.0327, std.dev.: 0.0351)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.56% (0.2881 => 0.3531, std.dev.: 0.0148)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.64% (10.1602 => 12.0545, std.dev.: 0.7220)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.32% (1.3833 => 1.4846, std.dev.: 0.0087)
  MultiSource/Applications/sqlite3/sqlite3: 4.65% (16.9719 => 17.7612, std.dev.: 0.1012)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 36.60% (0.1172 => 0.1601, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/mst/mst: 29.49% (0.2099 => 0.2718, std.dev.: 0.0094)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 28.85% (0.0624 => 0.0804, std.dev.: 0.0050)
  SingleSource/Benchmarks/Stanford/Puzzle: 17.73% (0.1455 => 0.1713, std.dev.: 0.0027)
  MultiSource/Applications/sgefa/sgefa: 17.42% (1.1695 => 1.3732, std.dev.: 0.0031)
  MultiSource/Benchmarks/FreeBench/neural/neural: 8.23% (0.3513 => 0.3802, std.dev.: 0.0068)
  MultiSource/Applications/obsequi/Obsequi: 6.85% (2.2398 => 2.3933, std.dev.: 0.0438)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.57% (1.0571 => 1.1054, std.dev.: 0.0014)
  MultiSource/Applications/lua/lua: 2.97% (28.2496 => 29.0890, std.dev.: 0.2827)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (4.3727 => 4.4816, std.dev.: 0.0391)
  SingleSource/Benchmarks/Shootout/methcall: 2.38% (8.3425 => 8.5410, std.dev.: 0.0247)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.63% (39.9248 => 40.5741, std.dev.: 0.1492)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -24.27% (0.2431 => 0.1841, std.dev.: 0.0089)
  SingleSource/Benchmarks/Misc/whetstone: -15.41% (0.1097 => 0.0928, std.dev.: 0.0010)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -13.84% (0.1322 => 0.1139, std.dev.: 0.0030)
  MultiSource/Applications/JM/lencod/lencod: -10.19% (18.9387 => 17.0092, std.dev.: 0.6147)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.72% (0.2006 => 0.1811, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.60% (0.1646 => 0.1488, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.12% (1.5932 => 1.4479, std.dev.: 0.0060)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.49% (0.1563 => 0.1446, std.dev.: 0.0020)
  MultiSource/Applications/lemon/lemon: -5.47% (1.3155 => 1.2436, std.dev.: 0.0159)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.78% (0.7381 => 0.7028, std.dev.: 0.0127)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.44% (1.6793 => 1.6216, std.dev.: 0.0068)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.40% (1.2911 => 0.7307, std.dev.: 0.0114)
  MultiSource/Applications/lemon/lemon: -30.91% (1.3499 => 0.9326, std.dev.: 0.0646)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.66% (4.4050 => 3.2305, std.dev.: 0.0623)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.66% (6.2328 => 5.0076, std.dev.: 0.0212)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.33% (25.3677 => 21.2250, std.dev.: 0.1036)
  SingleSource/Benchmarks/Misc/salsa20: -13.01% (10.3398 => 8.9948, std.dev.: 0.0140)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.99% (48.3307 => 43.5043, std.dev.: 0.0738)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.45% (4.5717 => 4.3224, std.dev.: 0.0164)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.25% (0.2777 => 0.2659, std.dev.: 0.0035)
  MultiSource/Applications/sqlite3/sqlite3: -4.11% (4.6358 => 4.4454, std.dev.: 0.0073)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.72% (9.1099 => 8.7711, std.dev.: 0.0126)
  SingleSource/Benchmarks/Misc/flops: -3.56% (10.2170 => 9.8537, std.dev.: 0.0290)
  MultiSource/Benchmarks/BitBench/five11/five11: -3.31% (5.7342 => 5.5445, std.dev.: 0.0325)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.76% (1.6679 => 1.6219, std.dev.: 0.0076)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.72% (3.8665 => 3.7612, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.79% (8.5243 => 8.3716, std.dev.: 0.0501)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.37% (2.8573 => 2.8182, std.dev.: 0.0071)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.29% (12.1841 => 12.0269, std.dev.: 0.0216)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.01% (0.1441 => 0.1470, std.dev.: 0.0203)

Report Time: 0.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130531/d136f734/attachment.html>


More information about the llvm-testresults mailing list