<HTML><HEAD><TITLE>Samsung Enterprise Portal mySingle</TITLE>
<META content="text/html; charset=euc-kr" http-equiv=Content-Type>
<STYLE id=mysingle_style type=text/css>P {
MARGIN-TOP: 5px; FONT-FAMILY: Verdana, arial; MARGIN-BOTTOM: 5px; FONT-SIZE: 10pt
}
TD {
MARGIN-TOP: 5px; FONT-FAMILY: Verdana, arial; MARGIN-BOTTOM: 5px; FONT-SIZE: 10pt
}
LI {
MARGIN-TOP: 5px; FONT-FAMILY: Verdana, arial; MARGIN-BOTTOM: 5px; FONT-SIZE: 10pt
}
BODY {
LINE-HEIGHT: 1.4; MARGIN: 10px; FONT-FAMILY: Verdana, arial; FONT-SIZE: 10pt
}
</STYLE>
<META name=GENERATOR content="MSHTML 8.00.7601.18913"></HEAD>
<BODY>
<P>Hi James,</P>
<P> </P>
<P>I really appreciate your kind anwser.</P>
<P> </P>
<P>Your comments are very helpful, indeed.</P>
<P> </P>
<P>Chees,</P>
<P>-Min</P>
<P> </P>
<P>------- <B>Original Message</B> -------</P>
<P><B>Sender</B> : James Molloy<james@jamesmolloy.co.uk></P>
<P><B>Date</B> : 2015-12-11 17:47 (GMT+09:00)</P>
<P><B>Title</B> : Re: [llvm-dev] What is the percentage of performance increase for test-suite, which can be considered worth patching?</P>
<P> </P>
<DIV dir=ltr>Hi Min,
<DIV><BR></DIV>
<DIV>Your question assumes that an acceptance criterion for a patch is that the LLVM test-suite improves. That is incorrect; patches do not need to improve the test-suite in order to be accepted.</DIV>
<DIV><BR></DIV>
<DIV>As a community we care about a very diverse range of workloads. Not all of those (and probably not most!) are represented in the test-suite. What the test-suite aims to do is cover a range of publicly available benchmarks and programs to attempt to give a more representative slice of the "real world" than some other benchmark suites do.</DIV>
<DIV><BR></DIV>
<DIV>It is very often the case that workloads (be they real world applications or benchmarks) have a hot, dominating section of code that if it is optimized well, or in a specific way, the workload improves drastically. It is not expected that all these possible optimizations would improve tests in the test-suite. If they do - fantastic, but that's not a blocker.</DIV>
<DIV><BR></DIV>
<DIV>However, the test-suite can give an indication that a patch is *not* good in the general case. It has a more diverse set of workloads than any other suite I've come across, and so can provide a decent indication of how a patch would behave on "more real world" code than whatever workload you're targetting. It can tell you if your patch even triggers in real world code, and can tell you if it regresses.</DIV>
<DIV><BR></DIV>
<DIV>So regressing the test-suite may block your patch, but improving the test-suite is not a requirement.</DIV>
<DIV><BR></DIV>
<DIV>Cheers,</DIV>
<DIV><BR></DIV>
<DIV>James</DIV></DIV><BR>
<DIV class=gmail_quote>
<DIV dir=ltr>On Fri, 11 Dec 2015 at 06:32 ±è¹Î¼º via llvm-dev <<A href="mailto:llvm-dev@lists.llvm.org">llvm-dev@lists.llvm.org</A>> wrote:<BR></DIV>
<BLOCKQUOTE style="BORDER-LEFT: #ccc 1px solid; MARGIN: 0px 0px 0px 0.8ex; PADDING-LEFT: 1ex" class=gmail_quote>
<DIV>
<P>Hi~ Guys,</P>
<P> </P>
<P>Could anyone tell me what is the positive percentage of performance increase from llvm test-suite, which can be considered worth patching ?</P>
<P> </P>
<P>Cheers</P>
<P>--Min</P>
<P> </P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">
<P><SPAN style="FONT-FAMILY: ³ª´®°íµñ; FONT-SIZE: 8pt"><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">------------------------------------------------------</SPAN></SPAN></P>
<P></P></SPAN><STRONG><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">MinSeong KIM</SPAN></STRONG>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">Software Engineer</SPAN></P>
<P><SPAN style="FONT-FAMILY: ³ª´®°íµñ; FONT-SIZE: 8pt"></SPAN><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">S/W Platform Development Team</SPAN></P>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">S.LSI Business</SPAN></P>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt"></SPAN> </P>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">SAMSUNG ELECTRONICS</SPAN></P>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">Mobile: +82-10-5636-7974</SPAN></P>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">E-mail: </SPAN><A href="mailto:min.s.kim@samsung.com" target=_blank><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">min.s.kim@samsung.com</SPAN></A></P><SPAN style="FONT-FAMILY: ³ª´®°íµñ; FONT-SIZE: 8pt">
<P><SPAN style="FONT-FAMILY: ³ª´®°íµñ; FONT-SIZE: 8pt"><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">------------------------------------------------------</SPAN></SPAN></P></SPAN>
<P> </P>
<TABLE>
<TBODY>
<TR>
<TD>
<P><IMG border=0 src="cid:EWXXYKENUIXH@namo.co.kr"></P></TD></TR></TBODY></TABLE></DIV>_______________________________________________<BR>LLVM Developers mailing list<BR><A href="mailto:llvm-dev@lists.llvm.org" target=_blank>llvm-dev@lists.llvm.org</A><BR><A href="http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev" rel=noreferrer target=_blank>http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev</A><BR></BLOCKQUOTE></DIV>
<P> </P><!--SP:min.s.kim--><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">
<P><SPAN style="FONT-FAMILY: ³ª´®°íµñ; FONT-SIZE: 8pt"><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">------------------------------------------------------</SPAN></SPAN></P>
<P></SPAN><STRONG><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">MinSeong KIM</SPAN></STRONG></P>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">Software Engineer</SPAN></P>
<P><SPAN style="FONT-FAMILY: ³ª´®°íµñ; FONT-SIZE: 8pt"></SPAN><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">S/W Platform Development Team</SPAN></P>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">S.LSI Business</SPAN></P>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt"></SPAN> </P>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">SAMSUNG ELECTRONICS</SPAN></P>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">Mobile: +82-10-5636-7974</SPAN></P>
<P><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">E-mail: </SPAN><A href="mailto:min.s.kim@samsung.com"><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">min.s.kim@samsung.com</SPAN></A></P><SPAN style="FONT-FAMILY: ³ª´®°íµñ; FONT-SIZE: 8pt">
<P><SPAN style="FONT-FAMILY: ³ª´®°íµñ; FONT-SIZE: 8pt"><SPAN style="FONT-FAMILY: Calibri; FONT-SIZE: 8pt">------------------------------------------------------</SPAN></SPAN></P></SPAN><!--min.s.kim:EP-->
<P> </P>
<TABLE id=confidentialsignimg>
<TBODY>
<TR>
<TD NAMO_LOCK>
<P><IMG border=0 src="cid:0GAN05W5Y5W7@namo.co.kr"></P></TD></TR></TBODY></TABLE></BODY></HTML><img src='http://ext.samsung.net/mailcheck/SeenTimeChecker?do=b6ee01ef39bdd5c04403ff888389ae00b57872ca3a3a48d9e853daf4dfac91992c11cccbcff58b3932f89054731b278ff4bcdeced46ed5ee08cece8541bc14eacf878f9a26ce15a0' border=0 width=0 height=0 style='display:none'>