[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Wed Dec 4 08:39:23 PST 2013
http://llvm.org/perf/db_default/v4/nts/17957?compare_to=17954&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20
Comparing:
Run: 17957, Order: 196386, Start Time: 2013-12-04 15:22:13, End Time: 2013-12-04 16:43:30
To: 17954, Order: 196378, Start Time: 2013-12-04 13:44:04, End Time: 2013-12-04 15:05:20
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00
===============
Tests Summary
===============
New Passes: 0 (1 on baseline)
Performance Regressions: 50 (39 on baseline)
Performance Improvements: 10 (11 on baseline)
Unchanged Tests: 1050 (1059 on baseline)
Total Tests: 1110
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/UnitTests/2004-02-02-NegativeZero: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033)
SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038)
SingleSource/UnitTests/2003-10-13-SwitchTest: 133.33% (0.0120 => 0.0280, std.dev.: 0.0019)
SingleSource/Regression/C++/fixups: 100.00% (0.0160 => 0.0320, std.dev.: 0.0019)
SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
SingleSource/Regression/C++/EH/ConditionalExpr: 80.00% (0.0200 => 0.0360)
SingleSource/Regression/C++/EH/exception_spec_test: 71.43% (0.0280 => 0.0480, std.dev.: 0.0000)
SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038)
SingleSource/UnitTests/2006-01-23-UnionInit: 60.00% (0.0200 => 0.0320, std.dev.: 0.0033)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033)
SingleSource/Regression/C++/EH/function_try_block: 42.86% (0.0280 => 0.0400, std.dev.: 0.0019)
SingleSource/Regression/C/casts: 33.33% (0.0360 => 0.0480, std.dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0019)
MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.00% (0.0600 => 0.0720, std.dev.: 0.0019)
SingleSource/UnitTests/SignlessTypes/Large/cast: 20.00% (0.0600 => 0.0720, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0050)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.52% (0.2320 => 0.2680)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.0840 => 0.0960, std.dev.: 0.0038)
MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.00% (0.1000 => 0.1120, std.dev.: 0.0019)
MultiSource/Benchmarks/Olden/power/power: 10.53% (0.1520 => 0.1680, std.dev.: 0.0038)
MultiSource/Benchmarks/Olden/em3d/em3d: 9.26% (0.2160 => 0.2360, std.dev.: 0.0019)
MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0019)
MultiSource/Benchmarks/Olden/tsp/tsp: 8.57% (0.1400 => 0.1520, std.dev.: 0.0019)
MultiSource/Applications/viterbi/viterbi: 7.55% (0.2120 => 0.2280, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0057)
MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.23% (0.3320 => 0.3560, std.dev.: 0.0038)
MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.3360 => 0.3560, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.47% (1.0960 => 1.1560, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.00% (0.3200 => 0.3360, std.dev.: 0.0019)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.08% (0.5200 => 0.5360, std.dev.: 0.0019)
MultiSource/Applications/hbd/hbd: 2.88% (1.6680 => 1.7160, std.dev.: 0.0068)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.56% (0.4680 => 0.4800, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.69% (1.1841 => 1.2041, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.35% (1.1841 => 1.2001, std.dev.: 0.0033)
MultiSource/Benchmarks/MallocBench/gs/gs: 1.31% (4.8960 => 4.9600, std.dev.: 0.0105)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.29% (1.2441 => 1.2601, std.dev.: 0.0038)
MultiSource/Applications/ClamAV/clamscan: 1.07% (17.1802 => 17.3642, std.dev.: 0.0283)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 28.95% (0.1520 => 0.1960, std.dev.: 0.0105)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 27.27% (0.0440 => 0.0560)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 13.79% (0.2320 => 0.2640, std.dev.: 0.0019)
MultiSource/Benchmarks/Olden/health/health: 6.25% (0.3840 => 0.4080, std.dev.: 0.0050)
MultiSource/Applications/viterbi/viterbi: 3.99% (2.7042 => 2.8122, std.dev.: 0.0330)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.87% (4.0403 => 4.1563, std.dev.: 0.0446)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.56% (0.4680 => 0.4800, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/sieve: 1.36% (2.3601 => 2.3921, std.dev.: 0.0019)
MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0761 => 1.0881, std.dev.: 0.0033)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Misc-C++/mandel-text: -37.50% (0.0320 => 0.0200, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -12.90% (0.1240 => 0.1080, std.dev.: 0.0038)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.24% (0.3400 => 0.3120, std.dev.: 0.0098)
SingleSource/Benchmarks/Shootout-C++/hash: -4.27% (0.4680 => 0.4480, std.dev.: 0.0068)
SingleSource/Benchmarks/Shootout-C++/lists1: -3.30% (0.3640 => 0.3520, std.dev.: 0.0033)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.72% (1.1640 => 1.1440, std.dev.: 0.0065)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.67% (1.2001 => 1.1801, std.dev.: 0.0068)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.58% (1.2681 => 1.2481, std.dev.: 0.0019)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.23% (1.2241 => 1.1601, std.dev.: 0.0210)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -3.22% (4.0963 => 3.9642, std.dev.: 0.0507)
================================
Run-Over-Baseline Changes Detail
================================
New Passes - Execution Time
---------------------------
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.2720 => 0.2720, std.dev.: 0.0147)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C++/short_circuit_dtor: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033)
SingleSource/UnitTests/block-copied-in-cxxobj: 300.00% (0.0040 => 0.0160)
SingleSource/UnitTests/2003-10-13-SwitchTest: 250.00% (0.0080 => 0.0280, std.dev.: 0.0019)
SingleSource/Regression/C++/pointer_member: 200.00% (0.0080 => 0.0240, std.dev.: 0.0033)
SingleSource/UnitTests/Vector/sumarray: 133.33% (0.0120 => 0.0280, std.dev.: 0.0038)
SingleSource/Regression/C/2003-05-23-TransparentUnion: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
SingleSource/Regression/C++/EH/ConditionalExpr: 50.00% (0.0240 => 0.0360)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc/salsa20: 36.36% (0.0440 => 0.0600, std.dev.: 0.0033)
SingleSource/Regression/C++/EH/exception_spec_test: 33.33% (0.0360 => 0.0480, std.dev.: 0.0000)
MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 21.74% (0.0920 => 0.1120, std.dev.: 0.0019)
SingleSource/UnitTests/SignlessTypes/Large/cast: 20.00% (0.0600 => 0.0720, std.dev.: 0.0019)
MultiSource/Applications/viterbi/viterbi: 14.00% (0.2000 => 0.2280, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.49% (0.3480 => 0.3880, std.dev.: 0.0082)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 10.71% (0.1120 => 0.1240, std.dev.: 0.0019)
MultiSource/Benchmarks/Olden/power/power: 10.53% (0.1520 => 0.1680, std.dev.: 0.0038)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.00% (0.2800 => 0.3080, std.dev.: 0.0050)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0057)
SingleSource/Benchmarks/Shootout-C++/strcat: 7.27% (0.2200 => 0.2360, std.dev.: 0.0050)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.35% (0.2520 => 0.2680)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.33% (0.3160 => 0.3360, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/fibo: 5.66% (0.2120 => 0.2240, std.dev.: 0.0019)
MultiSource/Applications/hbd/hbd: 4.13% (1.6480 => 1.7160, std.dev.: 0.0068)
MultiSource/Benchmarks/Olden/bh/bh: 3.49% (0.3440 => 0.3560, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.45% (0.4640 => 0.4800, std.dev.: 0.0019)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.62% (1.3720 => 1.4080, std.dev.: 0.0105)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.37% (0.6760 => 0.6920, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.19% (1.2761 => 1.3041, std.dev.: 0.0050)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.29% (1.2441 => 1.2601, std.dev.: 0.0038)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 19.05% (0.1680 => 0.2000, std.dev.: 0.0094)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.00% (0.2400 => 0.2640, std.dev.: 0.0019)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.86% (0.3160 => 0.3440, std.dev.: 0.0086)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.88% (1.2481 => 1.2841, std.dev.: 0.0086)
MultiSource/Applications/obsequi/Obsequi: 2.12% (2.0721 => 2.1161, std.dev.: 0.0113)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.32% (2.4282 => 2.4602, std.dev.: 0.0019)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/2003-05-02-DependentPHI: -57.14% (0.0280 => 0.0120, std.dev.: 0.0057)
MultiSource/Benchmarks/Prolangs-C++/NP/np: -37.50% (0.0320 => 0.0200, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -17.39% (0.0920 => 0.0760, std.dev.: 0.0057)
SingleSource/Benchmarks/Polybench/stencils/adi/adi: -9.68% (0.1240 => 0.1120, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.95% (1.4560 => 1.3840, std.dev.: 0.0182)
SingleSource/Benchmarks/Shootout-C++/hash: -4.27% (0.4680 => 0.4480, std.dev.: 0.0068)
SingleSource/Benchmarks/Misc-C++/Large/ray: -4.21% (0.3800 => 0.3640, std.dev.: 0.0050)
MultiSource/Benchmarks/McCat/18-imp/imp: -2.78% (0.4320 => 0.4200, std.dev.: 0.0019)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.60% (5.4960 => 5.4080, std.dev.: 0.0214)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -27.27% (0.0440 => 0.0320, std.dev.: 0.0033)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.98% (1.0081 => 0.9881, std.dev.: 0.0068)
Report Time: 0.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131204/634782a5/attachment.html>
More information about the llvm-testresults
mailing list