[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Dec 12 18:15:48 PST 2013


http://llvm.org/perf/db_default/v4/nts/18341?compare_to=18336&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18341, Order: 197187, Start Time: 2013-12-13 00:30:21, End Time: 2013-12-13 02:20:03
      To: 18336, Order: 197181, Start Time: 2013-12-12 22:21:45, End Time: 2013-12-13 00:05:05
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 68 (65 on baseline)
Performance Improvements: 5 (3 on baseline)
Unchanged Tests: 1037 (1042 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-02-CastTest3: 100.98% (0.0102 => 0.0205, std.dev.: 0.0008)
  SingleSource/UnitTests/2002-08-02-CastTest2: 94.55% (0.0110 => 0.0214, std.dev.: 0.0007)
  SingleSource/UnitTests/conditional-gnu-ext: 91.20% (0.0125 => 0.0239, std.dev.: 0.0012)
  SingleSource/UnitTests/2008-04-20-LoopBug2: 90.00% (0.0160 => 0.0304, std.dev.: 0.0006)
  SingleSource/UnitTests/byval-alignment: 81.25% (0.0176 => 0.0319, std.dev.: 0.0004)
  SingleSource/UnitTests/2002-10-09-ArrayResolution: 77.71% (0.0166 => 0.0295, std.dev.: 0.0018)
  SingleSource/UnitTests/2003-04-22-Switch: 77.27% (0.0176 => 0.0312, std.dev.: 0.0018)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 77.11% (0.0166 => 0.0294, std.dev.: 0.0014)
  SingleSource/UnitTests/2003-05-26-Shorts: 73.64% (0.0220 => 0.0382, std.dev.: 0.0009)
  SingleSource/Regression/C/2008-01-07-LongDouble: 71.03% (0.0145 => 0.0248, std.dev.: 0.0015)
  SingleSource/Regression/C/PR1386: 70.89% (0.0158 => 0.0270, std.dev.: 0.0007)
  SingleSource/Regression/C++/short_circuit_dtor: 66.84% (0.0196 => 0.0327, std.dev.: 0.0010)
  SingleSource/UnitTests/stmtexpr: 65.17% (0.0178 => 0.0294, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 61.52% (0.0499 => 0.0806, std.dev.: 0.0098)
  SingleSource/UnitTests/member-function-pointers: 60.26% (0.0229 => 0.0367, std.dev.: 0.0034)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 57.09% (0.0501 => 0.0787, std.dev.: 0.0035)
  SingleSource/UnitTests/2003-05-31-CastToBool: 55.17% (0.0261 => 0.0405, std.dev.: 0.0031)
  SingleSource/Regression/C/PR10189: 53.39% (0.0251 => 0.0385, std.dev.: 0.0031)
  SingleSource/UnitTests/2003-05-07-VarArgs: 48.25% (0.0257 => 0.0381, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 46.54% (0.1603 => 0.2349, std.dev.: 0.0111)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 46.46% (0.2234 => 0.3272, std.dev.: 0.0190)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 33.49% (0.0851 => 0.1136, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 32.23% (0.2659 => 0.3516, std.dev.: 0.0237)
  MultiSource/Applications/spiff/spiff: 22.09% (0.8874 => 1.0834, std.dev.: 0.0579)
  MultiSource/Applications/treecc/treecc: 21.96% (2.2547 => 2.7499, std.dev.: 0.0657)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.46% (4.9003 => 5.8538, std.dev.: 0.3013)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.68% (7.3210 => 8.5424, std.dev.: 0.1573)
  MultiSource/Applications/siod/siod: 16.15% (2.5472 => 2.9586, std.dev.: 0.1350)
  MultiSource/Applications/Burg/burg: 16.13% (1.4071 => 1.6341, std.dev.: 0.0788)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.87% (0.1408 => 0.1547, std.dev.: 0.0031)
  SingleSource/Benchmarks/SmallPT/smallpt: 9.47% (0.1425 => 0.1560, std.dev.: 0.0027)
  MultiSource/Applications/SPASS/SPASS: 8.90% (16.3252 => 17.7776, std.dev.: 0.2581)
  MultiSource/Benchmarks/Olden/em3d/em3d: 8.00% (0.1962 => 0.2119, std.dev.: 0.0040)
  MultiSource/Applications/d/make_dparser: 7.97% (3.5431 => 3.8256, std.dev.: 0.0802)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.79% (0.6685 => 0.7139, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.92% (1.3577 => 1.4381, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.89% (1.3383 => 1.4171, std.dev.: 0.0122)
  MultiSource/Applications/JM/lencod/lencod: 5.88% (17.2741 => 18.2898, std.dev.: 0.2829)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.80% (1.6818 => 1.7794, std.dev.: 0.0266)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.53% (1.4458 => 1.5113, std.dev.: 0.0107)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.28% (9.7476 => 10.1652, std.dev.: 0.0704)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.20% (1.3245 => 1.3801, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.49% (1.2395 => 1.2827, std.dev.: 0.0146)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/08-main/main: 32.06% (0.0708 => 0.0935, std.dev.: 0.0019)
  MultiSource/Applications/minisat/minisat: 29.92% (6.3401 => 8.2368, std.dev.: 0.1782)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.84% (1.2373 => 1.4828, std.dev.: 0.0645)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.91% (0.0810 => 0.0947, std.dev.: 0.0045)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.35% (2.1027 => 2.3835, std.dev.: 0.0175)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.32% (4.5665 => 5.1749, std.dev.: 0.0482)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.90% (28.9398 => 32.3836, std.dev.: 0.8407)
  MultiSource/Applications/lemon/lemon: 11.66% (0.8490 => 0.9480, std.dev.: 0.0199)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.62% (0.8298 => 0.8847, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/fibo: 6.40% (5.0310 => 5.3530, std.dev.: 0.0516)
  SingleSource/Benchmarks/Shootout-C++/ary3: 6.01% (4.8650 => 5.1574, std.dev.: 0.0978)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.89% (4.5761 => 4.8456, std.dev.: 0.0844)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.87% (4.1011 => 4.3007, std.dev.: 0.0405)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.62% (5.9003 => 6.1729, std.dev.: 0.0197)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.93% (15.1089 => 15.7030, std.dev.: 0.1867)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.78% (0.5108 => 0.5301, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.43% (5.0712 => 5.2450, std.dev.: 0.0260)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 3.13% (10.0212 => 10.3353, std.dev.: 0.0660)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.73% (3.8914 => 3.9978, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.36% (5.4996 => 5.6295, std.dev.: 0.0227)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.17% (5.0830 => 5.1935, std.dev.: 0.0158)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.06% (0.6399 => 0.6531, std.dev.: 0.0016)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.92% (5.4476 => 5.5524, std.dev.: 0.0351)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.49% (35.2524 => 35.7760, std.dev.: 0.0190)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.12% (1.5920 => 1.6098, std.dev.: 0.0067)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -5.76% (0.3979 => 0.3750, std.dev.: 0.0075)
  MultiSource/Applications/sgefa/sgefa: -2.03% (0.9149 => 0.8963, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.84% (6.0109 => 5.9004, std.dev.: 0.0242)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.83% (1.2778 => 1.2544, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.62% (16.0189 => 15.7596, std.dev.: 0.0996)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-02-CastTest3: 100.98% (0.0102 => 0.0205, std.dev.: 0.0008)
  SingleSource/UnitTests/2008-04-20-LoopBug2: 98.69% (0.0153 => 0.0304, std.dev.: 0.0006)
  SingleSource/UnitTests/2002-08-02-CastTest2: 96.33% (0.0109 => 0.0214, std.dev.: 0.0007)
  SingleSource/UnitTests/conditional-gnu-ext: 88.19% (0.0127 => 0.0239, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-04-22-Switch: 76.27% (0.0177 => 0.0312, std.dev.: 0.0018)
  SingleSource/Regression/C/PR1386: 75.32% (0.0154 => 0.0270, std.dev.: 0.0007)
  SingleSource/Regression/C++/short_circuit_dtor: 73.02% (0.0189 => 0.0327, std.dev.: 0.0010)
  SingleSource/UnitTests/member-function-pointers: 72.30% (0.0213 => 0.0367, std.dev.: 0.0034)
  SingleSource/UnitTests/stmtexpr: 69.94% (0.0173 => 0.0294, std.dev.: 0.0014)
  SingleSource/UnitTests/byval-alignment: 69.68% (0.0188 => 0.0319, std.dev.: 0.0004)
  SingleSource/UnitTests/2002-10-09-ArrayResolution: 69.54% (0.0174 => 0.0295, std.dev.: 0.0018)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 65.17% (0.0178 => 0.0294, std.dev.: 0.0014)
  SingleSource/UnitTests/2003-05-26-Shorts: 59.17% (0.0240 => 0.0382, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 56.81% (0.0514 => 0.0806, std.dev.: 0.0098)
  SingleSource/UnitTests/2003-05-31-CastToBool: 54.58% (0.0262 => 0.0405, std.dev.: 0.0031)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 54.01% (0.0511 => 0.0787, std.dev.: 0.0035)
  SingleSource/Regression/C/PR10189: 48.08% (0.0260 => 0.0385, std.dev.: 0.0031)
  SingleSource/UnitTests/2003-05-07-VarArgs: 47.10% (0.0259 => 0.0381, std.dev.: 0.0026)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 45.36% (0.2251 => 0.3272, std.dev.: 0.0190)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 40.41% (0.1673 => 0.2349, std.dev.: 0.0111)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 32.56% (0.0857 => 0.1136, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.12% (0.2810 => 0.3516, std.dev.: 0.0237)
  MultiSource/Applications/treecc/treecc: 20.71% (2.2781 => 2.7499, std.dev.: 0.0657)
  MultiSource/Applications/spiff/spiff: 20.14% (0.9018 => 1.0834, std.dev.: 0.0579)
  MultiSource/Applications/siod/siod: 16.06% (2.5491 => 2.9586, std.dev.: 0.1350)
  MultiSource/Applications/Burg/burg: 14.55% (1.4265 => 1.6341, std.dev.: 0.0788)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.71% (7.5124 => 8.5424, std.dev.: 0.1573)
  SingleSource/Benchmarks/SmallPT/smallpt: 10.33% (0.1414 => 0.1560, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.72% (0.1410 => 0.1547, std.dev.: 0.0031)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.69% (44.9186 => 48.3750, std.dev.: 1.2853)
  MultiSource/Applications/SPASS/SPASS: 6.34% (16.7177 => 17.7776, std.dev.: 0.2581)
  MultiSource/Applications/JM/lencod/lencod: 5.74% (17.2968 => 18.2898, std.dev.: 0.2829)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.47% (0.6769 => 0.7139, std.dev.: 0.0142)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.7054 => 1.7794, std.dev.: 0.0266)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.31% (1.4629 => 1.5113, std.dev.: 0.0107)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (9.8425 => 10.1652, std.dev.: 0.0704)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.18% (1.4074 => 1.4381, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.42% (1.3608 => 1.3801, std.dev.: 0.0060)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/08-main/main: 33.19% (0.0702 => 0.0935, std.dev.: 0.0019)
  MultiSource/Applications/minisat/minisat: 28.94% (6.3881 => 8.2368, std.dev.: 0.1782)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (1.2278 => 1.4828, std.dev.: 0.0645)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.06% (0.0809 => 0.0947, std.dev.: 0.0045)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.39% (2.1020 => 2.3835, std.dev.: 0.0175)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.07% (4.5769 => 5.1749, std.dev.: 0.0482)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.98% (28.6638 => 32.3836, std.dev.: 0.8407)
  SingleSource/Benchmarks/Shootout-C++/ary3: 10.21% (4.6797 => 5.1574, std.dev.: 0.0978)
  MultiSource/Applications/lemon/lemon: 9.82% (0.8632 => 0.9480, std.dev.: 0.0199)
  MultiSource/Benchmarks/McCat/09-vor/vor: 9.79% (0.1164 => 0.1278, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout-C++/fibo: 6.38% (5.0320 => 5.3530, std.dev.: 0.0516)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.61% (4.5883 => 4.8456, std.dev.: 0.0844)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.03% (3.8062 => 3.9978, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.39% (5.9133 => 6.1729, std.dev.: 0.0197)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.73% (4.1462 => 4.3007, std.dev.: 0.0405)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.70% (0.5112 => 0.5301, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.65% (5.0601 => 5.2450, std.dev.: 0.0260)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 3.13% (10.0217 => 10.3353, std.dev.: 0.0660)
  MultiSource/Applications/sgefa/sgefa: 2.49% (0.8745 => 0.8963, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.48% (5.2486 => 5.3788, std.dev.: 0.0327)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.44% (0.8636 => 0.8847, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.30% (5.5032 => 5.6295, std.dev.: 0.0227)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.24% (0.6388 => 0.6531, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.91% (1.5797 => 1.6098, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.80% (5.9126 => 6.0190, std.dev.: 0.0355)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.55% (35.2286 => 35.7760, std.dev.: 0.0190)
  SingleSource/Benchmarks/Misc/flops-8: 1.02% (2.5116 => 2.5373, std.dev.: 0.0011)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -5.54% (0.3970 => 0.3750, std.dev.: 0.0075)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.31% (6.0535 => 5.8531, std.dev.: 0.0673)
  MultiSource/Benchmarks/Olden/em3d/em3d: -1.58% (4.6123 => 4.5394, std.dev.: 0.0151)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131212/fdee7bd7/attachment.html>


More information about the llvm-testresults mailing list