[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 28 23:33:03 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16791?compare_to=16788&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16791, Order: 193583, Start Time: 2013-10-29 04:51:25, End Time: 2013-10-29 06:36:29
      To: 16788, Order: 193576, Start Time: 2013-10-29 02:33:02, End Time: 2013-10-29 04:29:54
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 28 (46 on baseline)
Performance Improvements: 38 (23 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1041 (1038 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.72% (1.2807 => 1.3027, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: 19.46% (1.7693 => 2.1136, std.dev.: 0.0617)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 10.90% (0.4567 => 0.5065, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/em3d/em3d: 10.83% (4.6046 => 5.1032, std.dev.: 0.1634)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.19% (3.5711 => 3.8634, std.dev.: 0.0026)
  SingleSource/Benchmarks/McGill/misr: 6.13% (0.3833 => 0.4068, std.dev.: 0.0042)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.40% (2.8882 => 3.0442, std.dev.: 0.0048)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.91% (2.1293 => 2.2125, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.60% (3.5915 => 3.7207, std.dev.: 0.0036)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.53% (0.4500 => 0.4659, std.dev.: 0.0003)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.51% (5.4850 => 5.6776, std.dev.: 0.0062)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.44% (1.8365 => 1.8996, std.dev.: 0.0016)
  MultiSource/Applications/aha/aha: 2.90% (3.6598 => 3.7660, std.dev.: 0.0055)
  MultiSource/Applications/siod/siod: 2.75% (3.4664 => 3.5617, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.32% (4.5197 => 4.6246, std.dev.: 0.0042)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.04% (1.0552 => 1.0767, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.91% (11.7851 => 12.0102, std.dev.: 0.0138)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.88% (3.1281 => 3.1870, std.dev.: 0.0205)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.79% (23.4166 => 23.8349, std.dev.: 0.0632)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.75% (45.3171 => 46.1086, std.dev.: 0.1225)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.74% (1.6657 => 1.6946, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (2.4883 => 2.5305, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.64% (11.9418 => 12.1372, std.dev.: 0.0006)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.58% (2.3863 => 2.4241, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.49% (4.0794 => 4.1401, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout/fib2: 1.34% (3.6069 => 3.6552, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc/oourafft: 1.30% (3.6599 => 3.7076, std.dev.: 0.0102)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.05% (18.5296 => 18.7250, std.dev.: 0.0294)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -13.92% (1.5506 => 1.3348, std.dev.: 0.0102)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -10.59% (0.1058 => 0.0946, std.dev.: 0.0020)
  MultiSource/Benchmarks/Bullet/bullet: -9.99% (37.1576 => 33.4454, std.dev.: 0.0289)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -8.44% (48.6330 => 44.5282, std.dev.: 0.2972)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -8.43% (1.1933 => 1.0927, std.dev.: 0.0076)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.68% (27.1804 => 25.0937, std.dev.: 0.1081)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.22% (1.3815 => 1.2817, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.50% (1.3979 => 1.3070, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.56% (1.2738 => 1.2030, std.dev.: 0.0102)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -4.62% (1.5704 => 1.4979, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.18% (1.3206 => 1.2654, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.01% (1.3926 => 1.3367, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.80% (1.3883 => 1.3356, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.57% (1.2675 => 1.2222, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.38% (1.2975 => 1.2537, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.35% (1.2806 => 1.2377, std.dev.: 0.0107)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.26% (0.3463 => 0.3350, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.14% (1.3106 => 1.2694, std.dev.: 0.0018)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.44% (0.5944 => 0.5799, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.42% (0.4917 => 0.4798, std.dev.: 0.0014)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.37% (2.6168 => 2.5548, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -2.25% (1.2329 => 1.2051, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.15% (1.2344 => 1.2078, std.dev.: 0.0098)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.04% (0.6802 => 0.6663, std.dev.: 0.0022)
  MultiSource/Applications/siod/siod: -1.77% (2.5698 => 2.5244, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.72% (1.2757 => 1.2537, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.70% (1.2311 => 1.2102, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.46% (1.2439 => 1.2258, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.12% (1.3230 => 1.3082, std.dev.: 0.0029)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -16.92% (72.6123 => 60.3238, std.dev.: 1.3063)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -11.36% (24.2802 => 21.5210, std.dev.: 0.9932)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -8.98% (0.2015 => 0.1834, std.dev.: 0.0013)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -7.23% (0.8909 => 0.8265, std.dev.: 0.0050)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -4.23% (9.8842 => 9.4659, std.dev.: 0.0147)
  SingleSource/Benchmarks/Misc/flops-7: -2.41% (1.7606 => 1.7181, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.89% (2.9970 => 2.9405, std.dev.: 0.0143)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.5446 => 2.5061, std.dev.: 0.0010)
  MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.1646 => 7.0796, std.dev.: 0.0068)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.00% (0.1351 => 0.1378, std.dev.: 0.0027)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.30% (1.6047 => 1.7058, std.dev.: 0.0185)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.21% (0.3822 => 0.3983, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.76% (0.4624 => 0.4798, std.dev.: 0.0014)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.38% (0.9494 => 0.9815, std.dev.: 0.0059)
  MultiSource/Applications/siod/siod: 3.12% (2.4480 => 2.5244, std.dev.: 0.0145)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.88% (0.8667 => 0.8917, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.83% (0.5609 => 0.5768, std.dev.: 0.0015)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.70% (0.9212 => 0.9461, std.dev.: 0.0030)
  MultiSource/Benchmarks/Bullet/bullet: 2.11% (32.7552 => 33.4454, std.dev.: 0.0289)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (24.6139 => 25.0937, std.dev.: 0.1081)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.4033 => 1.4263, std.dev.: 0.0084)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (9.9903 => 10.1355, std.dev.: 0.0477)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.44% (0.7037 => 0.7138, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.16% (1.2932 => 1.3082, std.dev.: 0.0029)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 61.24% (7.6426 => 12.3227, std.dev.: 0.0395)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.54% (2.8554 => 4.2701, std.dev.: 0.0106)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 24.33% (1.1431 => 1.4212, std.dev.: 0.0409)
  SingleSource/Benchmarks/Shootout/matrix: 18.68% (1.7809 => 2.1136, std.dev.: 0.0617)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.68% (6.4425 => 7.3883, std.dev.: 0.3116)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.68% (3.5550 => 3.8634, std.dev.: 0.0026)
  SingleSource/Benchmarks/McGill/misr: 7.88% (0.3771 => 0.4068, std.dev.: 0.0042)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.43% (3.1730 => 3.3771, std.dev.: 0.0132)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.70% (5.3716 => 5.6776, std.dev.: 0.0062)
  MultiSource/Applications/aha/aha: 5.40% (3.5731 => 3.7660, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.39% (3.5642 => 3.7207, std.dev.: 0.0036)
  MultiSource/Applications/hexxagon/hexxagon: 4.16% (14.7810 => 15.3956, std.dev.: 0.1718)
  MultiSource/Applications/lemon/lemon: 3.94% (0.8526 => 0.8862, std.dev.: 0.0118)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.73% (0.3836 => 0.3979, std.dev.: 0.0011)
  MultiSource/Benchmarks/sim/sim: 3.69% (3.8312 => 3.9725, std.dev.: 0.0476)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.47% (4.4696 => 4.6246, std.dev.: 0.0042)
  MultiSource/Applications/sqlite3/sqlite3: 3.17% (4.2733 => 4.4089, std.dev.: 0.0276)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.08% (89.7126 => 92.4714, std.dev.: 0.2580)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.04% (2.1472 => 2.2125, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.04% (4.0181 => 4.1401, std.dev.: 0.0058)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.58% (1.8519 => 1.8996, std.dev.: 0.0016)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.45% (1.7652 => 1.8084, std.dev.: 0.0019)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.42% (0.4549 => 0.4659, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.42% (5.4925 => 5.6252, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.08% (11.7654 => 12.0102, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.00% (3.1569 => 3.2199, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.75% (11.9288 => 12.1372, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/fib2: 1.63% (3.5966 => 3.6552, std.dev.: 0.0086)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.55% (23.4704 => 23.8349, std.dev.: 0.0632)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (1.6707 => 1.6946, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.03% (5.0196 => 5.0712, std.dev.: 0.0053)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: -14.66% (0.1194 => 0.1019, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.17% (1.2622 => 1.2222, std.dev.: 0.0085)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.33% (0.7461 => 0.7287, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.77% (1.2499 => 1.2278, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.60% (1.3068 => 1.2859, std.dev.: 0.0016)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.73% (0.5226 => 0.2366, std.dev.: 0.0108)
  MultiSource/Applications/sgefa/sgefa: -42.22% (1.5790 => 0.9124, std.dev.: 0.0013)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.71% (57.2347 => 43.6647, std.dev.: 4.3675)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.28% (15.9508 => 12.8758, std.dev.: 0.1319)
  MultiSource/Benchmarks/FreeBench/mason/mason: -19.07% (0.3304 => 0.2674, std.dev.: 0.0018)
  MultiSource/Applications/SIBsim4/SIBsim4: -12.36% (3.7437 => 3.2810, std.dev.: 0.0832)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.08% (20.8247 => 18.7250, std.dev.: 0.0294)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.83% (3.4956 => 3.1870, std.dev.: 0.0205)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.84% (50.0284 => 46.1086, std.dev.: 0.1225)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.61% (8.1346 => 7.5969, std.dev.: 0.0961)
  SingleSource/Benchmarks/Shootout-C++/ary3: -5.49% (5.0002 => 4.7255, std.dev.: 0.0918)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.11% (3.7874 => 3.6696, std.dev.: 0.0099)
  MultiSource/Benchmarks/Olden/power/power: -2.68% (1.2170 => 1.1844, std.dev.: 0.0110)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.44% (2.5938 => 2.5305, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.09% (17.1431 => 16.7853, std.dev.: 0.0037)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.30% (4.3592 => 4.3027, std.dev.: 0.0028)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.19% (2.4010 => 2.3724, std.dev.: 0.0102)
  SingleSource/Benchmarks/Misc/oourafft: -1.09% (3.7484 => 3.7076, std.dev.: 0.0102)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1348 => 0.1378, std.dev.: 0.0027)

Report Time: 1.16s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131029/03e4fec1/attachment.html>


More information about the llvm-testresults mailing list