From llvm-testresults at cs.uiuc.edu Sat Oct 1 00:41:12 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Oct 2011 02:41:12 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111001074112.CE34B2A6C12C@llvm.org> http://llvm.org/perf/db_default/simple/nts/321/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 321, Order: 0, Start Time: 2011-10-01 06:59:02, End Time: 2011-10-01 07:41:42 To: 320, Order: 0, Start Time: 2011-09-30 06:58:57, End Time: 2011-09-30 07:41:36 =============== Tests Summary =============== Performance Improvements: 2 Unchanged Tests: 959 Total Tests: 961 ============== Changes Detail ============== Performance Improvements ------------------------ MultiSource/Applications/sgefa/sgefa.exec: -8.69%(0.6482 => 0.5919, std. dev.: 0.0007) External/SPEC/CINT2006/401_bzip2/401_bzip2.compile: -6.24%(2.0293 => 1.9026, std. dev.: 0.0223) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 2 00:42:01 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 2 Oct 2011 02:42:01 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111002074201.1CA72312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/322/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 322, Order: 0, Start Time: 2011-10-02 06:59:02, End Time: 2011-10-02 07:41:43 To: 321, Order: 0, Start Time: 2011-10-01 06:59:02, End Time: 2011-10-01 07:41:42 =============== Tests Summary =============== Unchanged Tests: 961 Total Tests: 961 -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 3 00:41:04 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 3 Oct 2011 02:41:04 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111003074104.D5421312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/323/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 323, Order: 0, Start Time: 2011-10-03 06:59:08, End Time: 2011-10-03 07:41:53 To: 322, Order: 0, Start Time: 2011-10-02 06:59:02, End Time: 2011-10-02 07:41:43 =============== Tests Summary =============== Unchanged Tests: 961 Total Tests: 961 -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 4 00:40:44 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 4 Oct 2011 02:40:44 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111004074044.982CD312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/324/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 324, Order: 0, Start Time: 2011-10-04 06:59:20, End Time: 2011-10-04 07:42:08 To: 323, Order: 0, Start Time: 2011-10-03 06:59:08, End Time: 2011-10-03 07:41:53 =============== Tests Summary =============== Performance Improvements: 1 Unchanged Tests: 960 Total Tests: 961 ============== Changes Detail ============== Performance Improvements ------------------------ MultiSource/Applications/SPASS/SPASS.exec: -1.10%(9.0743 => 8.9745, std. dev.: 0.0014) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 5 00:41:34 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 5 Oct 2011 02:41:34 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111005074134.B3D7C2A6C12C@llvm.org> http://llvm.org/perf/db_default/simple/nts/325/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 325, Order: 0, Start Time: 2011-10-05 06:59:17, End Time: 2011-10-05 07:42:09 To: 324, Order: 0, Start Time: 2011-10-04 06:59:20, End Time: 2011-10-04 07:42:08 =============== Tests Summary =============== Unchanged Tests: 961 Total Tests: 961 -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 6 00:40:30 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 6 Oct 2011 02:40:30 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111006074030.0A9702A6C12C@llvm.org> http://llvm.org/perf/db_default/simple/nts/326/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 326, Order: 0, Start Time: 2011-10-06 06:58:54, End Time: 2011-10-06 07:41:21 To: 325, Order: 0, Start Time: 2011-10-05 06:59:17, End Time: 2011-10-05 07:42:09 =============== Tests Summary =============== Performance Regressions: 9 Performance Improvements: 11 Unchanged Tests: 941 Total Tests: 961 ============== Changes Detail ============== Performance Regressions ----------------------- SingleSource/Benchmarks/Shootout/lists.exec: 2.51%(5.8850 => 6.0327, std. dev.: 0.0124) MultiSource/Applications/lambda-0_1_3/lambda.exec: 2.06%(6.4905 => 6.6241, std. dev.: 0.0009) External/SPEC/CINT2000/255_vortex/255_vortex.exec: 1.74%(5.0136 => 5.1006, std. dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3.compile: 1.72%(14.4004 => 14.6474, std. dev.: 0.0278) External/SPEC/CINT2000/164_gzip/164_gzip.exec: 1.50%(13.4354 => 13.6374, std. dev.: 0.0706) External/SPEC/CFP2000/177_mesa/177_mesa.compile: 1.34%(14.4195 => 14.6126, std. dev.: 0.0745) External/SPEC/CINT95/134_perl/134_perl.compile: 1.18%(6.3511 => 6.4260, std. dev.: 0.0068) External/SPEC/CINT2006/400_perlbench/400_perlbench.exec: 1.15%(9.4049 => 9.5126, std. dev.: 0.0133) MultiSource/Applications/JM/lencod/lencod.compile: 1.05%(15.3322 => 15.4932, std. dev.: 0.0164) Performance Improvements ------------------------ MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl.compile: -21.57%(0.4330 => 0.3396, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp.exec: -12.39%(1.0600 => 0.9287, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2.exec: -7.56%(0.9076 => 0.8390, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon.exec: -7.41%(14.5195 => 13.4433, std. dev.: 0.0010) External/SPEC/CINT2000/175_vpr/175_vpr.exec: -2.18%(4.6212 => 4.5205, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container.exec: -1.90%(3.9476 => 3.8725, std. dev.: 0.0224) MultiSource/Applications/aha/aha.exec: -1.48%(3.5966 => 3.5435, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS.exec: -1.42%(9.0720 => 8.9430, std. dev.: 0.0394) SingleSource/Benchmarks/Misc-C++-EH/spirit.compile: -1.23%(8.6357 => 8.5294, std. dev.: 0.0290) External/SPEC/CFP2000/188_ammp/188_ammp.exec: -1.21%(17.6696 => 17.4552, std. dev.: 0.0304) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4.compile: -1.06%(25.2611 => 24.9937, std. dev.: 0.0950) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 7 00:39:22 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 7 Oct 2011 02:39:22 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111007073922.CFC2C312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/327/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 327, Order: 0, Start Time: 2011-10-07 06:58:39, End Time: 2011-10-07 07:41:06 To: 326, Order: 0, Start Time: 2011-10-06 06:58:54, End Time: 2011-10-06 07:41:21 =============== Tests Summary =============== Performance Regressions: 2 Unchanged Tests: 959 Total Tests: 961 ============== Changes Detail ============== Performance Regressions ----------------------- SingleSource/Benchmarks/Shootout-C++/methcall.exec: 3.36%(7.4662 => 7.7168, std. dev.: 0.0745) SingleSource/Benchmarks/Shootout/lists.exec: 2.85%(6.0327 => 6.2049, std. dev.: 0.0545) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 8 00:39:50 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 8 Oct 2011 02:39:50 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111008073950.CA7A93128018@llvm.org> http://llvm.org/perf/db_default/simple/nts/328/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 328, Order: 0, Start Time: 2011-10-08 06:59:19, End Time: 2011-10-08 07:41:39 To: 327, Order: 0, Start Time: 2011-10-07 06:58:39, End Time: 2011-10-07 07:41:06 =============== Tests Summary =============== Performance Regressions: 2 Performance Improvements: 1 Unchanged Tests: 958 Total Tests: 961 ============== Changes Detail ============== Performance Regressions ----------------------- SingleSource/Benchmarks/Shootout-C++/ackermann.exec: 6.96%(1.8127 => 1.9389, std. dev.: 0.0014) External/Povray/povray.exec: 1.61%(4.3096 => 4.3790, std. dev.: 0.0095) Performance Improvements ------------------------ MultiSource/Benchmarks/Bullet/bullet.exec: -3.89%(6.4586 => 6.2076, std. dev.: 0.0084) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 9 00:38:48 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 9 Oct 2011 02:38:48 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111009073848.156042A6C12C@llvm.org> http://llvm.org/perf/db_default/simple/nts/329/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 329, Order: 0, Start Time: 2011-10-09 06:58:15, End Time: 2011-10-09 07:40:39 To: 328, Order: 0, Start Time: 2011-10-08 06:59:19, End Time: 2011-10-08 07:41:39 =============== Tests Summary =============== Performance Regressions: 1 Performance Improvements: 1 Unchanged Tests: 959 Total Tests: 961 ============== Changes Detail ============== Performance Regressions ----------------------- SingleSource/Benchmarks/Shootout/lists.exec: 6.48%(6.1502 => 6.5485, std. dev.: 0.1270) Performance Improvements ------------------------ External/SPEC/CFP2000/177_mesa/177_mesa.compile: -2.43%(14.7275 => 14.3692, std. dev.: 0.1100) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 10 00:39:09 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 10 Oct 2011 02:39:09 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111010073909.3E611312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/330/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 330, Order: 0, Start Time: 2011-10-10 06:58:30, End Time: 2011-10-10 07:41:01 To: 329, Order: 0, Start Time: 2011-10-09 06:58:15, End Time: 2011-10-09 07:40:39 =============== Tests Summary =============== Performance Improvements: 1 Unchanged Tests: 960 Total Tests: 961 ============== Changes Detail ============== Performance Improvements ------------------------ SingleSource/Benchmarks/Shootout-C++/methcall.exec: -4.08%(7.6926 => 7.3789, std. dev.: 0.0938) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 11 00:39:52 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 11 Oct 2011 02:39:52 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111011073952.A1C10312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/331/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 331, Order: 0, Start Time: 2011-10-11 06:59:18, End Time: 2011-10-11 07:41:45 To: 330, Order: 0, Start Time: 2011-10-10 06:58:30, End Time: 2011-10-10 07:41:01 =============== Tests Summary =============== Unchanged Tests: 961 Total Tests: 961 -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 12 00:40:12 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 12 Oct 2011 02:40:12 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111012074012.4A6922A6C12C@llvm.org> http://llvm.org/perf/db_default/simple/nts/332/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 332, Order: 0, Start Time: 2011-10-12 06:59:18, End Time: 2011-10-12 07:42:03 To: 331, Order: 0, Start Time: 2011-10-11 06:59:18, End Time: 2011-10-11 07:41:45 =============== Tests Summary =============== Performance Regressions: 17 Performance Improvements: 6 Added Tests: 2 Unchanged Tests: 938 Total Tests: 963 ============== Changes Detail ============== Performance Regressions ----------------------- MultiSource/Applications/aha/aha.exec: 12.07%(3.5424 => 3.9698, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm.exec: 11.38%(2.2970 => 2.5585, std. dev.: 0.0007) External/SPEC/CFP2000/179_art/179_art.exec: 10.95%(1.4190 => 1.5744, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod.exec: 6.81%(11.8149 => 12.6195, std. dev.: 0.0267) External/SPEC/CINT2006/458_sjeng/458_sjeng.exec: 5.72%(6.0263 => 6.3711, std. dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign.exec: 3.98%(29.8022 => 30.9869, std. dev.: 0.0810) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1.exec: 3.88%(2.0729 => 2.1534, std. dev.: 0.0010) External/SPEC/CINT2000/256_bzip2/256_bzip2.exec: 2.68%(10.3792 => 10.6571, std. dev.: 0.0138) External/SPEC/CINT2000/164_gzip/164_gzip.exec: 2.64%(13.4866 => 13.8424, std. dev.: 0.0737) External/SPEC/CINT2000/175_vpr/175_vpr.exec: 2.61%(4.5220 => 4.6399, std. dev.: 0.0007) External/SPEC/CINT2000/197_parser/197_parser.compile: 2.21%(3.1692 => 3.2392, std. dev.: 0.0075) MultiSource/Benchmarks/sim/sim.exec: 1.97%(6.1997 => 6.3219, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3.exec: 1.30%(4.6635 => 4.7241, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet.compile: 1.26%(45.2907 => 45.8608, std. dev.: 0.0695) External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile: 1.25%(223.7703 => 226.5641, std. dev.: 0.1639) External/SPEC/CFP2006/450_soplex/450_soplex.compile: 1.04%(30.5935 => 30.9124, std. dev.: 0.0283) SingleSource/Benchmarks/CoyoteBench/almabench.exec: 1.00%(12.0546 => 12.1754, std. dev.: 0.0049) Performance Improvements ------------------------ SingleSource/Benchmarks/Misc/fbench.exec: -8.84%(2.0834 => 1.8992, std. dev.: 0.0050) External/SPEC/CINT2006/400_perlbench/400_perlbench.exec: -5.17%(9.5375 => 9.0445, std. dev.: 0.0241) External/SPEC/CINT2006/456_hmmer/456_hmmer.exec: -2.78%(5.3663 => 5.2169, std. dev.: 0.0008) MultiSource/Applications/lua/lua.exec: -2.50%(28.8779 => 28.1550, std. dev.: 0.0036) External/Povray/povray.exec: -1.73%(4.3798 => 4.3040, std. dev.: 0.0271) MultiSource/Applications/lambda-0_1_3/lambda.exec: -1.56%(6.6249 => 6.5214, std. dev.: 0.0019) Added Tests ----------- SingleSource/Benchmarks/Stanford/FloatMM.compile SingleSource/Benchmarks/Stanford/FloatMM.exec -------------- next part -------------- An HTML attachment was scrubbed... URL: From baldrick at free.fr Wed Oct 12 01:24:04 2011 From: baldrick at free.fr (Duncan Sands) Date: Wed, 12 Oct 2011 10:24:04 +0200 Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: <20111012074012.4A6922A6C12C@llvm.org> References: <20111012074012.4A6922A6C12C@llvm.org> Message-ID: <4E954EA4.3050104@free.fr> Hi Bob, are these performance regressions real? They look pretty serious. Ciao, Duncan. On 10/12/11 09:40, llvm-testresults at cs.uiuc.edu wrote: > > bwilson__llvm-gcc_PROD__i386 nightly tester results > > URL http://llvm.org/perf/db_default/simple/nts/332/ > Nickname bwilson__llvm-gcc_PROD__i386:4 > Name curlew.apple.com > > Run ID Order Start Time End Time > Current 332 0 2011-10-12 06:59:18 2011-10-12 07:42:03 > Previous 331 0 2011-10-11 06:59:18 2011-10-11 07:41:45 > > > Tests Summary > > Status Group # > Performance Regressions 17 > Performance Improvements 6 > Added Tests 2 > Unchanged Tests 938 > *Total Tests* *963* > > > Changes Detail > > Performance Regressions Δ Previous Current σ > MultiSource/Applications/aha/aha.exec 12.07% 3.5424 3.9698 0.0002 > MultiSource/Benchmarks/VersaBench/bmm/bmm.exec 11.38% 2.2970 2.5585 0.0007 > External/SPEC/CFP2000/179_art/179_art.exec 10.95% 1.4190 1.5744 0.0013 > MultiSource/Applications/JM/lencod/lencod.exec 6.81% 11.8149 12.6195 0.0267 > External/SPEC/CINT2006/458_sjeng/458_sjeng.exec 5.72% 6.0263 6.3711 0.0076 > MultiSource/Benchmarks/mafft/pairlocalalign.exec 3.98% 29.8022 30.9869 0.0810 > MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1.exec 3.88% 2.0729 2.1534 > 0.0010 > External/SPEC/CINT2000/256_bzip2/256_bzip2.exec 2.68% 10.3792 10.6571 0.0138 > External/SPEC/CINT2000/164_gzip/164_gzip.exec 2.64% 13.4866 13.8424 0.0737 > External/SPEC/CINT2000/175_vpr/175_vpr.exec 2.61% 4.5220 4.6399 0.0007 > External/SPEC/CINT2000/197_parser/197_parser.compile 2.21% 3.1692 3.2392 0.0075 > MultiSource/Benchmarks/sim/sim.exec 1.97% 6.1997 6.3219 0.0004 > MultiSource/Applications/sqlite3/sqlite3.exec 1.30% 4.6635 4.7241 0.0028 > MultiSource/Benchmarks/Bullet/bullet.compile 1.26% 45.2907 45.8608 0.0695 > External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile 1.25% 223.7703 > 226.5641 0.1639 > External/SPEC/CFP2006/450_soplex/450_soplex.compile 1.04% 30.5935 30.9124 0.0283 > SingleSource/Benchmarks/CoyoteBench/almabench.exec 1.00% 12.0546 12.1754 0.0049 > > Performance Improvements Δ Previous Current σ > SingleSource/Benchmarks/Misc/fbench.exec -8.84% 2.0834 1.8992 0.0050 > External/SPEC/CINT2006/400_perlbench/400_perlbench.exec -5.17% 9.5375 9.0445 0.0241 > External/SPEC/CINT2006/456_hmmer/456_hmmer.exec -2.78% 5.3663 5.2169 0.0008 > MultiSource/Applications/lua/lua.exec -2.50% 28.8779 28.1550 0.0036 > External/Povray/povray.exec -1.73% 4.3798 4.3040 0.0271 > MultiSource/Applications/lambda-0_1_3/lambda.exec -1.56% 6.6249 6.5214 0.0019 > > Added Tests > SingleSource/Benchmarks/Stanford/FloatMM.compile > SingleSource/Benchmarks/Stanford/FloatMM.exec > > > > _______________________________________________ > llvm-testresults mailing list > llvm-testresults at cs.uiuc.edu > http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults From bob.wilson at apple.com Wed Oct 12 09:03:40 2011 From: bob.wilson at apple.com (Bob Wilson) Date: Wed, 12 Oct 2011 09:03:40 -0700 Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: <4E954EA4.3050104@free.fr> References: <20111012074012.4A6922A6C12C@llvm.org> <4E954EA4.3050104@free.fr> Message-ID: Yes, they are real. I re-ran the two tests with the biggest execution time regressions, and the results were completely reproducible. On Oct 12, 2011, at 1:24 AM, Duncan Sands wrote: > Hi Bob, are these performance regressions real? They look pretty serious. > > Ciao, Duncan. > > On 10/12/11 09:40, llvm-testresults at cs.uiuc.edu wrote: >> >> bwilson__llvm-gcc_PROD__i386 nightly tester results >> >> URL http://llvm.org/perf/db_default/simple/nts/332/ >> Nickname bwilson__llvm-gcc_PROD__i386:4 >> Name curlew.apple.com >> >> Run ID Order Start Time End Time >> Current 332 0 2011-10-12 06:59:18 2011-10-12 07:42:03 >> Previous 331 0 2011-10-11 06:59:18 2011-10-11 07:41:45 >> >> >> Tests Summary >> >> Status Group # >> Performance Regressions 17 >> Performance Improvements 6 >> Added Tests 2 >> Unchanged Tests 938 >> *Total Tests* *963* >> >> >> Changes Detail >> >> Performance Regressions Δ Previous Current σ >> MultiSource/Applications/aha/aha.exec 12.07% 3.5424 3.9698 0.0002 >> MultiSource/Benchmarks/VersaBench/bmm/bmm.exec 11.38% 2.2970 2.5585 0.0007 >> External/SPEC/CFP2000/179_art/179_art.exec 10.95% 1.4190 1.5744 0.0013 >> MultiSource/Applications/JM/lencod/lencod.exec 6.81% 11.8149 12.6195 0.0267 >> External/SPEC/CINT2006/458_sjeng/458_sjeng.exec 5.72% 6.0263 6.3711 0.0076 >> MultiSource/Benchmarks/mafft/pairlocalalign.exec 3.98% 29.8022 30.9869 0.0810 >> MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1.exec 3.88% 2.0729 2.1534 >> 0.0010 >> External/SPEC/CINT2000/256_bzip2/256_bzip2.exec 2.68% 10.3792 10.6571 0.0138 >> External/SPEC/CINT2000/164_gzip/164_gzip.exec 2.64% 13.4866 13.8424 0.0737 >> External/SPEC/CINT2000/175_vpr/175_vpr.exec 2.61% 4.5220 4.6399 0.0007 >> External/SPEC/CINT2000/197_parser/197_parser.compile 2.21% 3.1692 3.2392 0.0075 >> MultiSource/Benchmarks/sim/sim.exec 1.97% 6.1997 6.3219 0.0004 >> MultiSource/Applications/sqlite3/sqlite3.exec 1.30% 4.6635 4.7241 0.0028 >> MultiSource/Benchmarks/Bullet/bullet.compile 1.26% 45.2907 45.8608 0.0695 >> External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile 1.25% 223.7703 >> 226.5641 0.1639 >> External/SPEC/CFP2006/450_soplex/450_soplex.compile 1.04% 30.5935 30.9124 0.0283 >> SingleSource/Benchmarks/CoyoteBench/almabench.exec 1.00% 12.0546 12.1754 0.0049 >> >> Performance Improvements Δ Previous Current σ >> SingleSource/Benchmarks/Misc/fbench.exec -8.84% 2.0834 1.8992 0.0050 >> External/SPEC/CINT2006/400_perlbench/400_perlbench.exec -5.17% 9.5375 9.0445 0.0241 >> External/SPEC/CINT2006/456_hmmer/456_hmmer.exec -2.78% 5.3663 5.2169 0.0008 >> MultiSource/Applications/lua/lua.exec -2.50% 28.8779 28.1550 0.0036 >> External/Povray/povray.exec -1.73% 4.3798 4.3040 0.0271 >> MultiSource/Applications/lambda-0_1_3/lambda.exec -1.56% 6.6249 6.5214 0.0019 >> >> Added Tests >> SingleSource/Benchmarks/Stanford/FloatMM.compile >> SingleSource/Benchmarks/Stanford/FloatMM.exec >> >> >> >> _______________________________________________ >> llvm-testresults mailing list >> llvm-testresults at cs.uiuc.edu >> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults > From llvm-testresults at cs.uiuc.edu Thu Oct 13 00:40:21 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 13 Oct 2011 02:40:21 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111013074021.3992C312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/333/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 333, Order: 0, Start Time: 2011-10-13 06:59:23, End Time: 2011-10-13 07:42:15 To: 332, Order: 0, Start Time: 2011-10-12 06:59:18, End Time: 2011-10-12 07:42:03 =============== Tests Summary =============== New Failures: 2 Performance Regressions: 5 Performance Improvements: 2 Unchanged Tests: 954 Total Tests: 963 ============== Changes Detail ============== New Failures ------------ External/SPEC/CINT2000/176_gcc/176_gcc.compile External/SPEC/CINT2000/176_gcc/176_gcc.exec Performance Regressions ----------------------- SingleSource/Benchmarks/McGill/chomp.exec: 14.19%(0.9291 => 1.0609, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks.exec: 7.21%(1.7387 => 1.8641, std. dev.: 0.0139) MultiSource/Benchmarks/PAQ8p/paq8p.exec: 6.35%(93.1898 => 99.1114, std. dev.: 0.2146) MultiSource/Applications/hexxagon/hexxagon.exec: 3.50%(13.3153 => 13.7818, std. dev.: 0.0512) MultiSource/Applications/lambda-0_1_3/lambda.exec: 2.11%(6.5214 => 6.6592, std. dev.: 0.0412) Performance Improvements ------------------------ External/SPEC/CINT2000/255_vortex/255_vortex.exec: -1.47%(5.0624 => 4.9878, std. dev.: 0.0038) External/SPEC/CFP2000/188_ammp/188_ammp.exec: -1.06%(17.5276 => 17.3419, std. dev.: 0.0278) -------------- next part -------------- An HTML attachment was scrubbed... URL: From evan.cheng at apple.com Thu Oct 13 11:30:02 2011 From: evan.cheng at apple.com (Evan Cheng) Date: Thu, 13 Oct 2011 11:30:02 -0700 Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: <20111012074012.4A6922A6C12C@llvm.org> References: <20111012074012.4A6922A6C12C@llvm.org> Message-ID: <1EAD1554-F04D-42F2-A6AF-9FAAA88E8B50@apple.com> No one is paying much attention to i386 performance these days. We did not see the same kind of regressions on the Clang testers. Evan On Oct 12, 2011, at 12:40 AM, llvm-testresults at cs.uiuc.edu wrote: > bwilson__llvm-gcc_PROD__i386 nightly tester results > > URL http://llvm.org/perf/db_default/simple/nts/332/ > Nickname bwilson__llvm-gcc_PROD__i386:4 > Name curlew.apple.com > Run ID Order Start Time End Time > Current 332 0 2011-10-12 06:59:18 2011-10-12 07:42:03 > Previous 331 0 2011-10-11 06:59:18 2011-10-11 07:41:45 > > Tests Summary > > Status Group # > Performance Regressions 17 > Performance Improvements 6 > Added Tests 2 > Unchanged Tests 938 > Total Tests 963 > > Changes Detail > > Performance Regressions Δ Previous Current σ > MultiSource/Applications/aha/aha.exec 12.07% 3.5424 3.9698 0.0002 > MultiSource/Benchmarks/VersaBench/bmm/bmm.exec 11.38% 2.2970 2.5585 0.0007 > External/SPEC/CFP2000/179_art/179_art.exec 10.95% 1.4190 1.5744 0.0013 > MultiSource/Applications/JM/lencod/lencod.exec 6.81% 11.8149 12.6195 0.0267 > External/SPEC/CINT2006/458_sjeng/458_sjeng.exec 5.72% 6.0263 6.3711 0.0076 > MultiSource/Benchmarks/mafft/pairlocalalign.exec 3.98% 29.8022 30.9869 0.0810 > MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1.exec 3.88% 2.0729 2.1534 0.0010 > External/SPEC/CINT2000/256_bzip2/256_bzip2.exec 2.68% 10.3792 10.6571 0.0138 > External/SPEC/CINT2000/164_gzip/164_gzip.exec 2.64% 13.4866 13.8424 0.0737 > External/SPEC/CINT2000/175_vpr/175_vpr.exec 2.61% 4.5220 4.6399 0.0007 > External/SPEC/CINT2000/197_parser/197_parser.compile 2.21% 3.1692 3.2392 0.0075 > MultiSource/Benchmarks/sim/sim.exec 1.97% 6.1997 6.3219 0.0004 > MultiSource/Applications/sqlite3/sqlite3.exec 1.30% 4.6635 4.7241 0.0028 > MultiSource/Benchmarks/Bullet/bullet.compile 1.26% 45.2907 45.8608 0.0695 > External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile 1.25% 223.7703 226.5641 0.1639 > External/SPEC/CFP2006/450_soplex/450_soplex.compile 1.04% 30.5935 30.9124 0.0283 > SingleSource/Benchmarks/CoyoteBench/almabench.exec 1.00% 12.0546 12.1754 0.0049 > > Performance Improvements Δ Previous Current σ > SingleSource/Benchmarks/Misc/fbench.exec -8.84% 2.0834 1.8992 0.0050 > External/SPEC/CINT2006/400_perlbench/400_perlbench.exec -5.17% 9.5375 9.0445 0.0241 > External/SPEC/CINT2006/456_hmmer/456_hmmer.exec -2.78% 5.3663 5.2169 0.0008 > MultiSource/Applications/lua/lua.exec -2.50% 28.8779 28.1550 0.0036 > External/Povray/povray.exec -1.73% 4.3798 4.3040 0.0271 > MultiSource/Applications/lambda-0_1_3/lambda.exec -1.56% 6.6249 6.5214 0.0019 > > Added Tests > SingleSource/Benchmarks/Stanford/FloatMM.compile > SingleSource/Benchmarks/Stanford/FloatMM.exec > _______________________________________________ > llvm-testresults mailing list > llvm-testresults at cs.uiuc.edu > http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults > -------------- next part -------------- An HTML attachment was scrubbed... URL: From evan.cheng at apple.com Thu Oct 13 11:48:43 2011 From: evan.cheng at apple.com (Evan Cheng) Date: Thu, 13 Oct 2011 11:48:43 -0700 Subject: [llvm-testresults] [LLVMdev] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: References: <20111012074012.4A6922A6C12C@llvm.org> <4E954EA4.3050104@free.fr> Message-ID: <4B8C34A6-4B39-4D36-B518-B2F627AB2A71@apple.com> If I were to guess, I would say it's due to machine LICM changes. Although I can't understand why the regressions are not showing up on Clang testers. Evan On Oct 12, 2011, at 9:03 AM, Bob Wilson wrote: > Yes, they are real. I re-ran the two tests with the biggest execution time regressions, and the results were completely reproducible. > > On Oct 12, 2011, at 1:24 AM, Duncan Sands wrote: > >> Hi Bob, are these performance regressions real? They look pretty serious. >> >> Ciao, Duncan. >> >> On 10/12/11 09:40, llvm-testresults at cs.uiuc.edu wrote: >>> >>> bwilson__llvm-gcc_PROD__i386 nightly tester results >>> >>> URL http://llvm.org/perf/db_default/simple/nts/332/ >>> Nickname bwilson__llvm-gcc_PROD__i386:4 >>> Name curlew.apple.com >>> >>> Run ID Order Start Time End Time >>> Current 332 0 2011-10-12 06:59:18 2011-10-12 07:42:03 >>> Previous 331 0 2011-10-11 06:59:18 2011-10-11 07:41:45 >>> >>> >>> Tests Summary >>> >>> Status Group # >>> Performance Regressions 17 >>> Performance Improvements 6 >>> Added Tests 2 >>> Unchanged Tests 938 >>> *Total Tests* *963* >>> >>> >>> Changes Detail >>> >>> Performance Regressions Δ Previous Current σ >>> MultiSource/Applications/aha/aha.exec 12.07% 3.5424 3.9698 0.0002 >>> MultiSource/Benchmarks/VersaBench/bmm/bmm.exec 11.38% 2.2970 2.5585 0.0007 >>> External/SPEC/CFP2000/179_art/179_art.exec 10.95% 1.4190 1.5744 0.0013 >>> MultiSource/Applications/JM/lencod/lencod.exec 6.81% 11.8149 12.6195 0.0267 >>> External/SPEC/CINT2006/458_sjeng/458_sjeng.exec 5.72% 6.0263 6.3711 0.0076 >>> MultiSource/Benchmarks/mafft/pairlocalalign.exec 3.98% 29.8022 30.9869 0.0810 >>> MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1.exec 3.88% 2.0729 2.1534 >>> 0.0010 >>> External/SPEC/CINT2000/256_bzip2/256_bzip2.exec 2.68% 10.3792 10.6571 0.0138 >>> External/SPEC/CINT2000/164_gzip/164_gzip.exec 2.64% 13.4866 13.8424 0.0737 >>> External/SPEC/CINT2000/175_vpr/175_vpr.exec 2.61% 4.5220 4.6399 0.0007 >>> External/SPEC/CINT2000/197_parser/197_parser.compile 2.21% 3.1692 3.2392 0.0075 >>> MultiSource/Benchmarks/sim/sim.exec 1.97% 6.1997 6.3219 0.0004 >>> MultiSource/Applications/sqlite3/sqlite3.exec 1.30% 4.6635 4.7241 0.0028 >>> MultiSource/Benchmarks/Bullet/bullet.compile 1.26% 45.2907 45.8608 0.0695 >>> External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile 1.25% 223.7703 >>> 226.5641 0.1639 >>> External/SPEC/CFP2006/450_soplex/450_soplex.compile 1.04% 30.5935 30.9124 0.0283 >>> SingleSource/Benchmarks/CoyoteBench/almabench.exec 1.00% 12.0546 12.1754 0.0049 >>> >>> Performance Improvements Δ Previous Current σ >>> SingleSource/Benchmarks/Misc/fbench.exec -8.84% 2.0834 1.8992 0.0050 >>> External/SPEC/CINT2006/400_perlbench/400_perlbench.exec -5.17% 9.5375 9.0445 0.0241 >>> External/SPEC/CINT2006/456_hmmer/456_hmmer.exec -2.78% 5.3663 5.2169 0.0008 >>> MultiSource/Applications/lua/lua.exec -2.50% 28.8779 28.1550 0.0036 >>> External/Povray/povray.exec -1.73% 4.3798 4.3040 0.0271 >>> MultiSource/Applications/lambda-0_1_3/lambda.exec -1.56% 6.6249 6.5214 0.0019 >>> >>> Added Tests >>> SingleSource/Benchmarks/Stanford/FloatMM.compile >>> SingleSource/Benchmarks/Stanford/FloatMM.exec >>> >>> >>> >>> _______________________________________________ >>> llvm-testresults mailing list >>> llvm-testresults at cs.uiuc.edu >>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults >> > > > _______________________________________________ > LLVM Developers mailing list > LLVMdev at cs.uiuc.edu http://llvm.cs.uiuc.edu > http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev From llvm-testresults at cs.uiuc.edu Fri Oct 14 00:40:24 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 14 Oct 2011 02:40:24 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111014074024.AAE95312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/334/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 334, Order: 0, Start Time: 2011-10-14 06:59:32, End Time: 2011-10-14 07:42:21 To: 333, Order: 0, Start Time: 2011-10-13 06:59:23, End Time: 2011-10-13 07:42:15 =============== Tests Summary =============== New Passes: 2 Unchanged Tests: 961 Total Tests: 963 ============== Changes Detail ============== New Passes ---------- External/SPEC/CINT2000/176_gcc/176_gcc.compile External/SPEC/CINT2000/176_gcc/176_gcc.exec -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 15 00:40:33 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 15 Oct 2011 02:40:33 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111015074033.6193F312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/335/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 335, Order: 0, Start Time: 2011-10-15 06:59:31, End Time: 2011-10-15 07:42:31 To: 334, Order: 0, Start Time: 2011-10-14 06:59:32, End Time: 2011-10-14 07:42:21 =============== Tests Summary =============== Performance Regressions: 3 Unchanged Tests: 960 Total Tests: 963 ============== Changes Detail ============== Performance Regressions ----------------------- MultiSource/Benchmarks/PAQ8p/paq8p.exec: 8.95%(93.2505 => 101.6002, std. dev.: 2.3378) SingleSource/Benchmarks/Shootout-C++/ackermann.exec: 6.92%(1.8106 => 1.9359, std. dev.: 0.0017) External/SPEC/CFP2000/177_mesa/177_mesa.compile: 1.34%(14.5505 => 14.7455, std. dev.: 0.0406) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 16 00:39:38 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 16 Oct 2011 02:39:38 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111016073938.23F0D2A6C12C@llvm.org> http://llvm.org/perf/db_default/simple/nts/336/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 336, Order: 0, Start Time: 2011-10-16 06:59:07, End Time: 2011-10-16 07:41:35 To: 335, Order: 0, Start Time: 2011-10-15 06:59:31, End Time: 2011-10-15 07:42:31 =============== Tests Summary =============== Unchanged Tests: 963 Total Tests: 963 -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 17 00:39:29 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 17 Oct 2011 02:39:29 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111017073929.0632A3128018@llvm.org> http://llvm.org/perf/db_default/simple/nts/337/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 337, Order: 0, Start Time: 2011-10-17 06:58:56, End Time: 2011-10-17 07:41:27 To: 336, Order: 0, Start Time: 2011-10-16 06:59:07, End Time: 2011-10-16 07:41:35 =============== Tests Summary =============== Performance Improvements: 2 Unchanged Tests: 961 Total Tests: 963 ============== Changes Detail ============== Performance Improvements ------------------------ SingleSource/Benchmarks/Shootout/lists.exec: -3.91%(6.2962 => 6.0503, std. dev.: 0.0883) MultiSource/Applications/SPASS/SPASS.exec: -1.04%(9.0193 => 8.9256, std. dev.: 0.0035) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 18 00:39:49 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 18 Oct 2011 02:39:49 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111018073949.BF581312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/338/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 338, Order: 0, Start Time: 2011-10-18 06:59:25, End Time: 2011-10-18 07:41:48 To: 337, Order: 0, Start Time: 2011-10-17 06:58:56, End Time: 2011-10-17 07:41:27 =============== Tests Summary =============== New Failures: 1 Performance Regressions: 5 Performance Improvements: 15 Unchanged Tests: 942 Total Tests: 963 ============== Changes Detail ============== New Failures ------------ SingleSource/UnitTests/2008-07-13-InlineSetjmp.exec Performance Regressions ----------------------- External/SPEC/CINT2000/255_vortex/255_vortex.exec: 1.91%(4.9826 => 5.0779, std. dev.: 0.0071) External/SPEC/CFP2000/188_ammp/188_ammp.exec: 1.90%(17.3019 => 17.6312, std. dev.: 0.0203) MultiSource/Applications/lua/lua.exec: 1.60%(28.7460 => 29.2059, std. dev.: 0.0202) External/Povray/povray.exec: 1.58%(4.2664 => 4.3338, std. dev.: 0.0008) External/SPEC/CINT2000/253_perlbmk/253_perlbmk.exec: 1.31%(8.3525 => 8.4616, std. dev.: 0.0039) Performance Improvements ------------------------ SingleSource/Benchmarks/McGill/chomp.exec: -12.49%(1.0622 => 0.9295, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm.exec: -10.23%(2.5584 => 2.2966, std. dev.: 0.0010) MultiSource/Applications/aha/aha.exec: -10.20%(3.9442 => 3.5417, std. dev.: 0.0001) External/SPEC/CFP2000/179_art/179_art.exec: -7.65%(1.5368 => 1.4192, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod.exec: -6.44%(12.6135 => 11.8014, std. dev.: 0.0086) External/SPEC/CINT2006/458_sjeng/458_sjeng.exec: -5.02%(6.3028 => 5.9864, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign.exec: -3.16%(30.7908 => 29.8169, std. dev.: 0.0110) External/SPEC/CINT2006/400_perlbench/400_perlbench.exec: -2.94%(9.6070 => 9.3249, std. dev.: 0.0881) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1.exec: -2.62%(2.1306 => 2.0747, std. dev.: 0.0022) External/SPEC/CINT2000/256_bzip2/256_bzip2.exec: -2.55%(10.7081 => 10.4347, std. dev.: 0.0189) MultiSource/Applications/hexxagon/hexxagon.exec: -2.45%(13.7818 => 13.4447, std. dev.: 0.0002) External/SPEC/CINT2006/456_hmmer/456_hmmer.exec: -2.43%(5.3565 => 5.2264, std. dev.: 0.0003) External/SPEC/CINT2000/197_parser/197_parser.compile: -2.21%(3.2458 => 3.1740, std. dev.: 0.0034) External/SPEC/CINT2000/164_gzip/164_gzip.exec: -2.17%(13.9393 => 13.6374, std. dev.: 0.0407) MultiSource/Benchmarks/sim/sim.exec: -1.29%(6.2842 => 6.2033, std. dev.: 0.0001) -------------- next part -------------- An HTML attachment was scrubbed... URL: From wendling at apple.com Tue Oct 18 00:56:10 2011 From: wendling at apple.com (Bill Wendling) Date: Tue, 18 Oct 2011 00:56:10 -0700 Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: <20111018073949.BF581312800A@llvm.org> References: <20111018073949.BF581312800A@llvm.org> Message-ID: <6FCE1A27-FD01-4AAC-83AA-271F63FD2A96@apple.com> On Oct 18, 2011, at 12:39 AM, llvm-testresults at cs.uiuc.edu wrote: > bwilson__llvm-gcc_PROD__i386 nightly tester results > > URL http://llvm.org/perf/db_default/simple/nts/338/ > Nickname bwilson__llvm-gcc_PROD__i386:4 > Name curlew.apple.com > Run ID Order Start Time End Time > Current 338 0 2011-10-18 06:59:25 2011-10-18 07:41:48 > Previous 337 0 2011-10-17 06:58:56 2011-10-17 07:41:27 > > Tests Summary > > Status Group # > New Failures 1 > Performance Regressions 5 > Performance Improvements 15 > Unchanged Tests 942 > Total Tests 963 > > Changes Detail > > New Failures > SingleSource/UnitTests/2008-07-13-InlineSetjmp.exec > This will fail now because we removed the hack that looks at the Function name to determine if something "returns twice". Now we look at the Function attribute, which llvm-gcc isn't going to set. -bw From mcrosier at apple.com Tue Oct 18 00:57:32 2011 From: mcrosier at apple.com (Chad Rosier) Date: Tue, 18 Oct 2011 00:57:32 -0700 Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: <6FCE1A27-FD01-4AAC-83AA-271F63FD2A96@apple.com> References: <20111018073949.BF581312800A@llvm.org> <6FCE1A27-FD01-4AAC-83AA-271F63FD2A96@apple.com> Message-ID: <9EFAB2F2-F694-4B98-9A75-374A29CFF56C@apple.com> Thanks, Bill. I was mid-radar-filing. On Oct 18, 2011, at 12:56 AM, Bill Wendling wrote: > On Oct 18, 2011, at 12:39 AM, llvm-testresults at cs.uiuc.edu wrote: > >> bwilson__llvm-gcc_PROD__i386 nightly tester results >> >> URL http://llvm.org/perf/db_default/simple/nts/338/ >> Nickname bwilson__llvm-gcc_PROD__i386:4 >> Name curlew.apple.com >> Run ID Order Start Time End Time >> Current 338 0 2011-10-18 06:59:25 2011-10-18 07:41:48 >> Previous 337 0 2011-10-17 06:58:56 2011-10-17 07:41:27 >> >> Tests Summary >> >> Status Group # >> New Failures 1 >> Performance Regressions 5 >> Performance Improvements 15 >> Unchanged Tests 942 >> Total Tests 963 >> >> Changes Detail >> >> New Failures >> SingleSource/UnitTests/2008-07-13-InlineSetjmp.exec >> > This will fail now because we removed the hack that looks at the Function name to determine if something "returns twice". Now we look at the Function attribute, which llvm-gcc isn't going to set. > > -bw > > _______________________________________________ > llvm-testresults mailing list > llvm-testresults at cs.uiuc.edu > http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults From baldrick at free.fr Tue Oct 18 02:23:08 2011 From: baldrick at free.fr (Duncan Sands) Date: Tue, 18 Oct 2011 11:23:08 +0200 Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: <6FCE1A27-FD01-4AAC-83AA-271F63FD2A96@apple.com> References: <20111018073949.BF581312800A@llvm.org> <6FCE1A27-FD01-4AAC-83AA-271F63FD2A96@apple.com> Message-ID: <4E9D457C.6040304@free.fr> Hi Bill, >> New Failures >> SingleSource/UnitTests/2008-07-13-InlineSetjmp.exec >> > This will fail now because we removed the hack that looks at the Function name to determine if something "returns twice". Now we look at the Function attribute, which llvm-gcc isn't going to set. I taught llvm-gcc to set it in commit 142347. Ciao, Duncan. From wendling at apple.com Tue Oct 18 02:32:28 2011 From: wendling at apple.com (Bill Wendling) Date: Tue, 18 Oct 2011 02:32:28 -0700 Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: <4E9D457C.6040304@free.fr> References: <20111018073949.BF581312800A@llvm.org> <6FCE1A27-FD01-4AAC-83AA-271F63FD2A96@apple.com> <4E9D457C.6040304@free.fr> Message-ID: <621D0872-8410-442C-B89A-695A4E14774A@apple.com> On Oct 18, 2011, at 2:23 AM, Duncan Sands wrote: > Hi Bill, > >>> New Failures >>> SingleSource/UnitTests/2008-07-13-InlineSetjmp.exec >>> >> This will fail now because we removed the hack that looks at the Function name to determine if something "returns twice". Now we look at the Function attribute, which llvm-gcc isn't going to set. > > I taught llvm-gcc to set it in commit 142347. > You rock! \m/ -bw From llvm-testresults at cs.uiuc.edu Wed Oct 19 00:40:05 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 19 Oct 2011 02:40:05 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111019074005.A73462A6C124@llvm.org> http://llvm.org/perf/db_default/simple/nts/339/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 339, Order: 0, Start Time: 2011-10-19 06:59:39, End Time: 2011-10-19 07:42:07 To: 338, Order: 0, Start Time: 2011-10-18 06:59:25, End Time: 2011-10-18 07:41:48 =============== Tests Summary =============== New Passes: 1 Performance Regressions: 1 Performance Improvements: 1 Unchanged Tests: 960 Total Tests: 963 ============== Changes Detail ============== New Passes ---------- SingleSource/UnitTests/2008-07-13-InlineSetjmp.exec Performance Regressions ----------------------- SingleSource/Benchmarks/Shootout-C++/methcall.exec: 4.34%(7.3414 => 7.6601, std. dev.: 0.1184) Performance Improvements ------------------------ MultiSource/Applications/sgefa/sgefa.exec: -8.74%(0.6477 => 0.5911, std. dev.: 0.0001) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 20 00:40:37 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 20 Oct 2011 02:40:37 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111020074037.73EF12A6C12C@llvm.org> http://llvm.org/perf/db_default/simple/nts/340/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 340, Order: 0, Start Time: 2011-10-20 06:59:57, End Time: 2011-10-20 07:42:40 To: 339, Order: 0, Start Time: 2011-10-19 06:59:39, End Time: 2011-10-19 07:42:07 =============== Tests Summary =============== Performance Regressions: 1 Unchanged Tests: 962 Total Tests: 963 ============== Changes Detail ============== Performance Regressions ----------------------- SingleSource/Benchmarks/Shootout/lists.exec: 5.82%(6.1100 => 6.4655, std. dev.: 0.0882) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 21 00:39:35 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 21 Oct 2011 02:39:35 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111021073935.161392A6C124@llvm.org> http://llvm.org/perf/db_default/simple/nts/341/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 341, Order: 0, Start Time: 2011-10-21 06:59:05, End Time: 2011-10-21 07:41:38 To: 340, Order: 0, Start Time: 2011-10-20 06:59:57, End Time: 2011-10-20 07:42:40 =============== Tests Summary =============== Performance Regressions: 1 Performance Improvements: 3 Unchanged Tests: 959 Total Tests: 963 ============== Changes Detail ============== Performance Regressions ----------------------- MultiSource/Applications/sqlite3/sqlite3.compile: 1.08%(14.6166 => 14.7745, std. dev.: 0.0554) Performance Improvements ------------------------ MultiSource/Benchmarks/Ptrdist/ks/ks.exec: -7.09%(1.8338 => 1.7038, std. dev.: 0.0149) External/SPEC/CFP2000/177_mesa/177_mesa.exec: -2.14%(3.7348 => 3.6550, std. dev.: 0.0006) External/SPEC/CINT2000/175_vpr/175_vpr.exec: -1.84%(4.6054 => 4.5207, std. dev.: 0.0054) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 22 00:39:23 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 22 Oct 2011 02:39:23 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111022073923.C857C2A6C12C@llvm.org> http://llvm.org/perf/db_default/simple/nts/342/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 342, Order: 0, Start Time: 2011-10-22 06:58:48, End Time: 2011-10-22 07:41:28 To: 341, Order: 0, Start Time: 2011-10-21 06:59:05, End Time: 2011-10-21 07:41:38 =============== Tests Summary =============== Unchanged Tests: 963 Total Tests: 963 -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 23 00:39:24 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 23 Oct 2011 02:39:24 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111023073924.3EA322A6C12C@llvm.org> http://llvm.org/perf/db_default/simple/nts/343/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 343, Order: 0, Start Time: 2011-10-23 06:58:48, End Time: 2011-10-23 07:41:30 To: 342, Order: 0, Start Time: 2011-10-22 06:58:48, End Time: 2011-10-22 07:41:28 =============== Tests Summary =============== Performance Improvements: 1 Unchanged Tests: 962 Total Tests: 963 ============== Changes Detail ============== Performance Improvements ------------------------ External/SPEC/CINT2006/400_perlbench/400_perlbench.exec: -2.63%(9.2980 => 9.0536, std. dev.: 0.0341) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 24 00:39:23 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 24 Oct 2011 02:39:23 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111024073923.6ADE5312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/344/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 344, Order: 0, Start Time: 2011-10-24 06:58:49, End Time: 2011-10-24 07:41:30 To: 343, Order: 0, Start Time: 2011-10-23 06:58:48, End Time: 2011-10-23 07:41:30 =============== Tests Summary =============== Unchanged Tests: 963 Total Tests: 963 -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 25 00:47:59 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 25 Oct 2011 02:47:59 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111025074759.85CA2312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/345/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 345, Order: 0, Start Time: 2011-10-25 06:59:55, End Time: 2011-10-25 07:50:07 To: 344, Order: 0, Start Time: 2011-10-24 06:58:49, End Time: 2011-10-24 07:41:30 =============== Tests Summary =============== New Failures: 18 Performance Improvements: 1 Unchanged Tests: 944 Total Tests: 963 ============== Changes Detail ============== New Failures ------------ External/SPEC/CFP2006/444_namd/444_namd.exec External/SPEC/CFP2006/447_dealII/447_dealII.exec External/SPEC/CFP2006/450_soplex/450_soplex.exec External/SPEC/CINT2006/471_omnetpp/471_omnetpp.exec External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.exec MultiSource/Applications/kimwitu++/kc.exec MultiSource/Applications/lambda-0_1_3/lambda.exec MultiSource/Applications/minisat/minisat.exec MultiSource/Benchmarks/Bullet/bullet.exec SingleSource/Benchmarks/CoyoteBench/fftbench.exec SingleSource/Benchmarks/Misc-C++-EH/spirit.exec SingleSource/Benchmarks/Misc-C++/bigfib.exec SingleSource/Benchmarks/Shootout-C++/except.exec SingleSource/Regression/C++/EH/exception_spec_test.exec SingleSource/Regression/C++/EH/function_try_block.exec SingleSource/Regression/C++/EH/simple_rethrow.exec SingleSource/Regression/C++/EH/throw_rethrow_test.exec Performance Improvements ------------------------ SingleSource/Benchmarks/Misc-C++-EH/spirit.compile: -10.40%(8.4789 => 7.5968, std. dev.: 0.0268) -------------- next part -------------- An HTML attachment was scrubbed... URL: From bob.wilson at apple.com Tue Oct 25 08:59:17 2011 From: bob.wilson at apple.com (Bob Wilson) Date: Tue, 25 Oct 2011 08:59:17 -0700 Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: <20111025074759.85CA2312800A@llvm.org> References: <20111025074759.85CA2312800A@llvm.org> Message-ID: <1EFDA27C-E660-44D7-ADDD-D2864D9183DE@apple.com> It sounds like others were seeing similar problems and some patches were reverted. Hopefully the next run will recover! On Oct 25, 2011, at 12:47 AM, llvm-testresults at cs.uiuc.edu wrote: > bwilson__llvm-gcc_PROD__i386 nightly tester results > > URL http://llvm.org/perf/db_default/simple/nts/345/ > Nickname bwilson__llvm-gcc_PROD__i386:4 > Name curlew.apple.com > Run ID Order Start Time End Time > Current 345 0 2011-10-25 06:59:55 2011-10-25 07:50:07 > Previous 344 0 2011-10-24 06:58:49 2011-10-24 07:41:30 > > Tests Summary > > Status Group # > New Failures 18 > Performance Improvements 1 > Unchanged Tests 944 > Total Tests 963 > > Changes Detail > > New Failures > External/SPEC/CFP2006/444_namd/444_namd.exec > External/SPEC/CFP2006/447_dealII/447_dealII.exec > External/SPEC/CFP2006/450_soplex/450_soplex.exec > External/SPEC/CINT2006/471_omnetpp/471_omnetpp.exec > External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile > External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.exec > MultiSource/Applications/kimwitu++/kc.exec > MultiSource/Applications/lambda-0_1_3/lambda.exec > MultiSource/Applications/minisat/minisat.exec > MultiSource/Benchmarks/Bullet/bullet.exec > SingleSource/Benchmarks/CoyoteBench/fftbench.exec > SingleSource/Benchmarks/Misc-C++-EH/spirit.exec > SingleSource/Benchmarks/Misc-C++/bigfib.exec > SingleSource/Benchmarks/Shootout-C++/except.exec > SingleSource/Regression/C++/EH/exception_spec_test.exec > SingleSource/Regression/C++/EH/function_try_block.exec > SingleSource/Regression/C++/EH/simple_rethrow.exec > SingleSource/Regression/C++/EH/throw_rethrow_test.exec > > Performance Improvements Δ Previous Current σ > SingleSource/Benchmarks/Misc-C++-EH/spirit.compile -10.40% 8.4789 7.5968 0.0268 > _______________________________________________ > llvm-testresults mailing list > llvm-testresults at cs.uiuc.edu > http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults > -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 26 00:40:22 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 26 Oct 2011 02:40:22 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111026074022.2E2F0312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/346/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 346, Order: 0, Start Time: 2011-10-26 06:59:38, End Time: 2011-10-26 07:42:31 To: 345, Order: 0, Start Time: 2011-10-25 06:59:55, End Time: 2011-10-25 07:50:07 =============== Tests Summary =============== New Passes: 18 Performance Regressions: 15 Performance Improvements: 5 Unchanged Tests: 925 Total Tests: 963 ============== Changes Detail ============== New Passes ---------- External/SPEC/CFP2006/444_namd/444_namd.exec External/SPEC/CFP2006/447_dealII/447_dealII.exec External/SPEC/CFP2006/450_soplex/450_soplex.exec External/SPEC/CINT2006/471_omnetpp/471_omnetpp.exec External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.exec MultiSource/Applications/kimwitu++/kc.exec MultiSource/Applications/lambda-0_1_3/lambda.exec MultiSource/Applications/minisat/minisat.exec MultiSource/Benchmarks/Bullet/bullet.exec SingleSource/Benchmarks/CoyoteBench/fftbench.exec SingleSource/Benchmarks/Misc-C++-EH/spirit.exec SingleSource/Benchmarks/Misc-C++/bigfib.exec SingleSource/Benchmarks/Shootout-C++/except.exec SingleSource/Regression/C++/EH/exception_spec_test.exec SingleSource/Regression/C++/EH/function_try_block.exec SingleSource/Regression/C++/EH/simple_rethrow.exec SingleSource/Regression/C++/EH/throw_rethrow_test.exec Performance Regressions ----------------------- MultiSource/Applications/aha/aha.exec: 12.10%(3.5414 => 3.9698, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm.exec: 11.37%(2.2973 => 2.5585, std. dev.: 0.0004) External/SPEC/CFP2000/179_art/179_art.exec: 10.96%(1.4191 => 1.5747, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod.exec: 6.86%(11.8003 => 12.6101, std. dev.: 0.0015) External/SPEC/CINT2006/458_sjeng/458_sjeng.exec: 5.75%(6.0318 => 6.3786, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1.exec: 4.03%(2.0748 => 2.1585, std. dev.: 0.0006) External/SPEC/CINT2006/400_perlbench/400_perlbench.exec: 4.03%(9.0790 => 9.4447, std. dev.: 0.1153) External/SPEC/CINT2000/256_bzip2/256_bzip2.exec: 3.80%(10.3699 => 10.7637, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign.exec: 3.21%(29.8374 => 30.7942, std. dev.: 0.0042) External/SPEC/CFP2000/177_mesa/177_mesa.exec: 2.87%(3.6472 => 3.7520, std. dev.: 0.0036) External/SPEC/CINT2000/164_gzip/164_gzip.exec: 2.20%(13.6381 => 13.9388, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim.exec: 1.92%(6.2007 => 6.3198, std. dev.: 0.0003) External/SPEC/CINT2000/175_vpr/175_vpr.exec: 1.69%(4.5206 => 4.5969, std. dev.: 0.0001) External/SPEC/CFP2000/188_ammp/188_ammp.exec: 1.29%(17.4557 => 17.6806, std. dev.: 0.0049) External/SPEC/CINT2000/255_vortex/255_vortex.exec: 1.17%(5.0821 => 5.1417, std. dev.: 0.0014) Performance Improvements ------------------------ SingleSource/Benchmarks/Misc/fbench.exec: -8.82%(2.0820 => 1.8983, std. dev.: 0.0038) MultiSource/Applications/siod/siod.exec: -2.69%(3.3698 => 3.2793, std. dev.: 0.0002) External/Povray/povray.exec: -2.31%(4.3798 => 4.2786, std. dev.: 0.0007) MultiSource/Applications/lua/lua.exec: -2.19%(28.8841 => 28.2527, std. dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon.exec: -1.06%(13.4474 => 13.3051, std. dev.: 0.0020) -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 27 00:39:25 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 27 Oct 2011 02:39:25 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111027073925.2153B312800A@llvm.org> http://llvm.org/perf/db_default/simple/nts/347/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 347, Order: 0, Start Time: 2011-10-27 06:59:02, End Time: 2011-10-27 07:41:35 To: 346, Order: 0, Start Time: 2011-10-26 06:59:38, End Time: 2011-10-26 07:42:31 =============== Tests Summary =============== New Failures: 2 Performance Improvements: 2 Unchanged Tests: 959 Total Tests: 963 ============== Changes Detail ============== New Failures ------------ External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.exec Performance Improvements ------------------------ External/SPEC/CFP2000/188_ammp/188_ammp.exec: -1.34%(17.6806 => 17.4445, std. dev.: 0.0897) External/SPEC/CFP2000/177_mesa/177_mesa.compile: -1.03%(14.6501 => 14.4997, std. dev.: 0.0467) -------------- next part -------------- An HTML attachment was scrubbed... URL: From bob.wilson at apple.com Thu Oct 27 08:45:22 2011 From: bob.wilson at apple.com (Bob Wilson) Date: Thu, 27 Oct 2011 08:45:22 -0700 Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: <20111027073925.2153B312800A@llvm.org> References: <20111027073925.2153B312800A@llvm.org> Message-ID: <074F1984-B043-4827-9FC0-0DF7D11CE5B8@apple.com> Bisection blamed the xalancbmk regression on r143028. I'm going to revert that for now. Chad, can you work with Duncan to get a test case for him? On Oct 27, 2011, at 12:39 AM, llvm-testresults at cs.uiuc.edu wrote: > bwilson__llvm-gcc_PROD__i386 nightly tester results > > URL http://llvm.org/perf/db_default/simple/nts/347/ > Nickname bwilson__llvm-gcc_PROD__i386:4 > Name curlew.apple.com > Run ID Order Start Time End Time > Current 347 0 2011-10-27 06:59:02 2011-10-27 07:41:35 > Previous 346 0 2011-10-26 06:59:38 2011-10-26 07:42:31 > > Tests Summary > > Status Group # > New Failures 2 > Performance Improvements 2 > Unchanged Tests 959 > Total Tests 963 > > Changes Detail > > New Failures > External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile > External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.exec > > Performance Improvements Δ Previous Current σ > External/SPEC/CFP2000/188_ammp/188_ammp.exec -1.34% 17.6806 17.4445 0.0897 > External/SPEC/CFP2000/177_mesa/177_mesa.compile -1.03% 14.6501 14.4997 0.0467 > _______________________________________________ > llvm-testresults mailing list > llvm-testresults at cs.uiuc.edu > http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults > -------------- next part -------------- An HTML attachment was scrubbed... URL: From baldrick at free.fr Thu Oct 27 08:52:44 2011 From: baldrick at free.fr (Duncan Sands) Date: Thu, 27 Oct 2011 17:52:44 +0200 Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: <074F1984-B043-4827-9FC0-0DF7D11CE5B8@apple.com> References: <20111027073925.2153B312800A@llvm.org> <074F1984-B043-4827-9FC0-0DF7D11CE5B8@apple.com> Message-ID: <4EA97E4C.8080800@free.fr> Hi Bob, >> External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile does this mean it failed to compile? Ciao, Duncan. From bob.wilson at apple.com Thu Oct 27 09:03:22 2011 From: bob.wilson at apple.com (Bob Wilson) Date: Thu, 27 Oct 2011 09:03:22 -0700 Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results In-Reply-To: <4EA97E4C.8080800@free.fr> References: <20111027073925.2153B312800A@llvm.org> <074F1984-B043-4827-9FC0-0DF7D11CE5B8@apple.com> <4EA97E4C.8080800@free.fr> Message-ID: On Oct 27, 2011, at 8:52 AM, Duncan Sands wrote: > Hi Bob, > >>> External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile > > does this mean it failed to compile? > > Ciao, Duncan. Yes, there was an assertion failure. Here's the stack trace that Chad provided: Assertion failed: (isa(Val) && "cast() argument of incompatible type!"), function cast, file /Users/mcrosier/llvm-clean/llvm/include/llvm/Support/Casting.h, line 194. 0 clang 0x000000010b459f02 _ZL15PrintStackTracePv + 34 1 clang 0x000000010b45a4f9 _ZL13SignalHandleri + 777 2 libsystem_c.dylib 0x00007fff93725cfa _sigtramp + 26 3 clang 0x000000010b346ea2 llvm::ConstantInt::get(llvm::LLVMContext&, llvm::APInt const&) + 114 4 clang 0x000000010b45a146 abort + 22 5 clang 0x000000010b45a107 __assert_rtn + 55 6 clang 0x000000010b30d4aa llvm::ComputeMaskedBits(llvm::Value*, llvm::APInt const&, llvm::APInt&, llvm::APInt&, llvm::TargetData const*, unsigned int) + 16954 7 clang 0x000000010b30cdf4 llvm::ComputeMaskedBits(llvm::Value*, llvm::APInt const&, llvm::APInt&, llvm::APInt&, llvm::TargetData const*, unsigned int) + 15236 8 clang 0x000000010b30c672 llvm::ComputeMaskedBits(llvm::Value*, llvm::APInt const&, llvm::APInt&, llvm::APInt&, llvm::TargetData const*, unsigned int) + 13314 9 clang 0x000000010b2e6fcc llvm::ScalarEvolution::GetMinTrailingZeros(llvm::SCEV const*) + 1548 10 clang 0x000000010b2dc3c7 llvm::ScalarEvolution::getSignedRange(llvm::SCEV const*) + 583 11 clang 0x000000010b2dc5b6 llvm::ScalarEvolution::getSignedRange(llvm::SCEV const*) + 1078 12 clang 0x000000010b2dd8fb llvm::ScalarEvolution::getSignedRange(llvm::SCEV const*) + 6011 13 clang 0x000000010b2de5e3 llvm::ScalarEvolution::isKnownNonNegative(llvm::SCEV const*) + 35 14 clang 0x000000010b2d5d6f llvm::ScalarEvolution::getMulExpr(llvm::SmallVectorImpl&, llvm::SCEV::NoWrapFlags) + 415 15 clang 0x000000010b2f614c llvm::ScalarEvolution::getMulExpr(llvm::SCEV const*, llvm::SCEV const*, llvm::SCEV::NoWrapFlags) + 108 16 clang 0x000000010b2e684d llvm::ScalarEvolution::createNodeForGEP(llvm::GEPOperator*) + 381 17 clang 0x000000010b2e3f96 llvm::ScalarEvolution::createSCEV(llvm::Value*) + 5974 18 clang 0x000000010b2d7a8e llvm::ScalarEvolution::getSCEV(llvm::Value*) + 398 19 clang 0x000000010b295dd4 llvm::IVUsers::AddUsersIfInteresting(llvm::Instruction*) + 196 20 clang 0x000000010b296163 llvm::IVUsers::AddUsersIfInteresting(llvm::Instruction*) + 1107 21 clang 0x000000010b296163 llvm::IVUsers::AddUsersIfInteresting(llvm::Instruction*) + 1107 22 clang 0x000000010b296b1b llvm::IVUsers::runOnLoop(llvm::Loop*, llvm::LPPassManager&) + 203 23 clang 0x000000010b2b5737 llvm::LPPassManager::runOnFunction(llvm::Function&) + 887 24 clang 0x000000010b3be864 llvm::FPPassManager::runOnFunction(llvm::Function&) + 340 25 clang 0x000000010b3beafb llvm::FPPassManager::runOnModule(llvm::Module&) + 75 26 clang 0x000000010b3bec57 llvm::MPPassManager::runOnModule(llvm::Module&) + 295 27 clang 0x000000010b3bf222 llvm::PassManagerImpl::run(llvm::Module&) + 290 28 clang 0x000000010b3bf75d llvm::PassManager::run(llvm::Module&) + 13 29 clang 0x000000010a29cecc clang::EmitBackendOutput(clang::DiagnosticsEngine&, clang::CodeGenOptions const&, clang::TargetOptions const&, clang::LangOptions const&, llvm::Module*, clang::BackendAction, llvm::raw_ostream*) + 4668 30 clang 0x000000010a372787 clang::BackendConsumer::HandleTranslationUnit(clang::ASTContext&) + 263 31 clang 0x000000010a3a30fe clang::ParseAST(clang::Sema&, bool) + 446 32 clang 0x000000010a371797 clang::CodeGenAction::ExecuteAction() + 1031 33 clang 0x000000010a18051b clang::CompilerInstance::ExecuteAction(clang::FrontendAction&) + 955 34 clang 0x000000010a16a8b8 clang::ExecuteCompilerInvocation(clang::CompilerInstance*) + 2792 35 clang 0x000000010a162ed1 cc1_main(char const**, char const**, char const*, void*) + 5265 36 clang 0x000000010a166c52 main + 706 37 clang 0x000000010a161a34 start + 52 From llvm-testresults at cs.uiuc.edu Sun Oct 30 00:39:10 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 30 Oct 2011 02:39:10 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111030073910.B972E3524001@llvm.org> http://llvm.org/perf/db_default/simple/nts/348/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 348, Order: 0, Start Time: 2011-10-30 06:58:49, End Time: 2011-10-30 07:41:23 To: 347, Order: 0, Start Time: 2011-10-27 06:59:02, End Time: 2011-10-27 07:41:35 =============== Tests Summary =============== New Passes: 2 Unchanged Tests: 961 Total Tests: 963 ============== Changes Detail ============== New Passes ---------- External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.exec -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 31 00:39:09 2011 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 31 Oct 2011 02:39:09 -0500 (CDT) Subject: [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results Message-ID: <20111031073909.DD36A2A6C124@llvm.org> http://llvm.org/perf/db_default/simple/nts/349/ Nickname: bwilson__llvm-gcc_PROD__i386:4 Name: curlew.apple.com Comparing: Run: 349, Order: 0, Start Time: 2011-10-31 06:58:48, End Time: 2011-10-31 07:41:24 To: 348, Order: 0, Start Time: 2011-10-30 06:58:49, End Time: 2011-10-30 07:41:23 =============== Tests Summary =============== Performance Improvements: 1 Unchanged Tests: 962 Total Tests: 963 ============== Changes Detail ============== Performance Improvements ------------------------ SingleSource/Benchmarks/Shootout-C++/methcall.exec: -1.08%(7.4504 => 7.3698, std. dev.: 0.0235) -------------- next part -------------- An HTML attachment was scrubbed... URL: