[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Sep 22 09:37:21 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15558?compare_to=15555&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15558, Order: 191176, Start Time: 2013-09-22 14:56:59, End Time: 2013-09-22 16:40:05
      To: 15555, Order: 191172, Start Time: 2013-09-22 12:47:05, End Time: 2013-09-22 14:33:48
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 20 (37 on baseline)
Performance Improvements: 9 (28 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1078 (1042 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.50% (0.5540 => 0.5734, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.83% (0.8811 => 0.8972, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.31% (9.7824 => 9.9105, std.dev.: 0.0188)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 39.37% (2.8321 => 3.9472, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.92% (8.5120 => 9.7822, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.51% (6.3909 => 7.0623, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.28% (0.1131 => 0.1236, std.dev.: 0.0010)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.56% (2.9224 => 3.0558, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/fp-convert: 4.22% (7.5438 => 7.8624, std.dev.: 0.0126)
  MultiSource/Benchmarks/sim/sim: 3.97% (3.8767 => 4.0307, std.dev.: 0.0242)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.93% (4.1845 => 4.3073, std.dev.: 0.0090)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (3.1349 => 3.2175, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/methcall: 2.42% (8.3868 => 8.5895, std.dev.: 0.0654)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.11% (15.8238 => 16.1578, std.dev.: 0.0460)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.79% (23.3848 => 23.8025, std.dev.: 0.0105)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (2.4995 => 2.5422, std.dev.: 0.0013)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.57% (6.7155 => 6.8212, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.19% (3.7840 => 3.8289, std.dev.: 0.0008)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.14% (88.7453 => 89.7549, std.dev.: 0.0575)
  SingleSource/Benchmarks/Misc/mandel: 1.02% (1.0560 => 1.0668, std.dev.: 0.0002)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.80% (2.7988 => 2.7204, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.70% (1.3690 => 1.3321, std.dev.: 0.0050)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.02% (0.5236 => 0.5130, std.dev.: 0.0006)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: -19.29% (3.5087 => 2.8320, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout/heapsort: -8.62% (3.1417 => 2.8709, std.dev.: 0.0380)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -8.14% (1.5877 => 1.4585, std.dev.: 0.0344)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.12% (0.3459 => 0.3351, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (3.9899 => 3.9092, std.dev.: 0.0297)
  SingleSource/Benchmarks/McGill/chomp: -1.21% (1.0315 => 1.0190, std.dev.: 0.0036)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: - (0.1354 => 0.1354, std.dev.: 0.0045)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.58% (0.4624 => 0.4836, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.8667 => 0.8972, std.dev.: 0.0022)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.26% (4.0397 => 4.1713, std.dev.: 0.0025)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.21% (0.3707 => 0.3826, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.83% (0.3822 => 0.3930, std.dev.: 0.0022)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.70% (1.9476 => 2.0002, std.dev.: 0.0014)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.69% (2.6492 => 2.7204, std.dev.: 0.0079)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.5883 => 4.7076, std.dev.: 0.0318)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.56% (9.9903 => 10.2465, std.dev.: 0.0403)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.9828 => 1.0065, std.dev.: 0.0029)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.27% (24.6139 => 25.1729, std.dev.: 0.1482)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.08% (0.6296 => 0.6427, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.96% (6.0284 => 6.1464, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.92% (0.6297 => 0.6418, std.dev.: 0.0003)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.80% (9.7354 => 9.9105, std.dev.: 0.0188)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.46% (1.4746 => 1.4961, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.24% (2.8554 => 3.9472, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.61% (6.1088 => 7.0623, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.74% (8.5256 => 9.7822, std.dev.: 0.0031)
  SingleSource/UnitTests/Vector/multiplies: 6.62% (0.5561 => 0.5929, std.dev.: 0.0000)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.51% (0.1871 => 0.1974, std.dev.: 0.0012)
  MultiSource/Benchmarks/sim/sim: 5.21% (3.8312 => 4.0307, std.dev.: 0.0242)
  SingleSource/Benchmarks/McGill/misr: 5.12% (0.3771 => 0.3964, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.17% (0.3836 => 0.3996, std.dev.: 0.0007)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.87% (5.3716 => 5.5796, std.dev.: 0.0612)
  SingleSource/Benchmarks/Misc/fp-convert: 3.62% (7.5877 => 7.8624, std.dev.: 0.0126)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5182 => 0.5300, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.20% (1.5940 => 1.6291, std.dev.: 0.0045)
  SingleSource/Regression/C/uint64_to_float: 2.16% (1.4528 => 1.4842, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.94% (3.5683 => 3.6376, std.dev.: 0.0021)
  MultiSource/Benchmarks/Olden/power/power: 1.91% (1.2170 => 1.2402, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout/fib2: 1.53% (3.5966 => 3.6517, std.dev.: 0.0038)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.41% (23.4704 => 23.8025, std.dev.: 0.0105)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.16% (6.7429 => 6.8212, std.dev.: 0.0007)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (16.7972 => 16.9831, std.dev.: 0.0268)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (3.7874 => 3.8289, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.04% (5.0196 => 5.0718, std.dev.: 0.0048)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.50% (0.1483 => 0.1179, std.dev.: 0.0002)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.04% (0.1195 => 0.1087, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.51% (0.2571 => 0.2378, std.dev.: 0.0004)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.11% (0.5226 => 0.2346, std.dev.: 0.0426)
  MultiSource/Applications/sgefa/sgefa: -47.04% (1.5790 => 0.8363, std.dev.: 0.0358)
  SingleSource/Benchmarks/Linpack/linpack-pc: -22.94% (57.2347 => 44.1033, std.dev.: 1.5501)
  SingleSource/Benchmarks/Shootout/heapsort: -20.03% (3.5900 => 2.8709, std.dev.: 0.0380)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.80% (15.9508 => 12.7920, std.dev.: 0.3864)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -15.19% (1.7197 => 1.4585, std.dev.: 0.0344)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.32% (0.3304 => 0.2897, std.dev.: 0.0032)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.07% (20.8247 => 18.5187, std.dev.: 0.1288)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -9.87% (4.0006 => 3.6058, std.dev.: 0.0502)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.96% (3.4956 => 3.2175, std.dev.: 0.0003)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.34% (50.0284 => 46.3584, std.dev.: 0.3539)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.15% (3.7437 => 3.4760, std.dev.: 0.0685)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -5.95% (3.0111 => 2.8320, std.dev.: 0.0051)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.62% (30.1838 => 28.4870, std.dev.: 0.0537)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.10% (0.7474 => 0.7093, std.dev.: 0.0113)
  SingleSource/Benchmarks/Misc/salsa20: -3.69% (7.7964 => 7.5085, std.dev.: 0.0500)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.32% (36.8417 => 35.6186, std.dev.: 0.3927)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.21% (0.3462 => 0.3351, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.20% (17.1431 => 16.5952, std.dev.: 0.0849)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.99% (2.5938 => 2.5422, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout/hash: -1.41% (5.2009 => 5.1275, std.dev.: 0.0120)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.21% (3.8582 => 3.8116, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.19% (4.3592 => 4.3073, std.dev.: 0.0090)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -1.14% (4.1004 => 4.0535, std.dev.: 0.0087)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.10% (4.9022 => 4.8481, std.dev.: 0.0104)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.45% (0.1348 => 0.1354, std.dev.: 0.0045)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130922/d6b1a32c/attachment.html>


More information about the llvm-testresults mailing list