<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<br>
<div class="moz-cite-prefix">On 05/25/2018 01:49 PM, Pankaj Kukreja
via llvm-dev wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAOkbG5tSDM-DZz4Mzfj1vboeJv5W0YaGiaT_O47RjsxBjM6ePA@mail.gmail.com">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<div dir="ltr">Hi,
<div>I am adding some benchmarks to the test-suite as a part of
my GSoC project. I am planning to use the google benchmark
library on some benchmarks. <span
style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">I
would like to know your opinion/suggestion on how I should
proceed </span></div>
</div>
</blockquote>
<br>
<p>Hi, Pankaj,</p>
<p>We have a directory in the test suite, MicroBenchmarks, for
things which depend on Google's benchmark library. Your benchmarks
should likely go there. You'll need to post a patch for review for
the particular things that you'd like to add.<br>
</p>
<br>
<blockquote type="cite"
cite="mid:CAOkbG5tSDM-DZz4Mzfj1vboeJv5W0YaGiaT_O47RjsxBjM6ePA@mail.gmail.com">
<div dir="ltr">
<div><span
style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">with
this library and how the design should be(like limiting the
number of times a kernel is executed so that overall runtime
of test-suite can be controlled, multiple inputs sizes,
adding it to small kernels etc.).</span></div>
</div>
</blockquote>
<br>
The benchmark library can dynamically pick the number of iterations,
and we definitely need to keep a handle on the overall runtime of
the test suite. I don't think that we yet have guidelines for
microbenchmark timing, but for full applications, we try to keep the
runtime down to ~1s.<br>
<br>
-Hal<br>
<br>
<blockquote type="cite"
cite="mid:CAOkbG5tSDM-DZz4Mzfj1vboeJv5W0YaGiaT_O47RjsxBjM6ePA@mail.gmail.com">
<div dir="ltr">
<div>I would love to hear any other suggestions that you may
have.<br>
</div>
<div><span
style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br>
</span></div>
<div>Thanks,</div>
<div>Pankaj</div>
<div><br>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
LLVM Developers mailing list
<a class="moz-txt-link-abbreviated" href="mailto:llvm-dev@lists.llvm.org">llvm-dev@lists.llvm.org</a>
<a class="moz-txt-link-freetext" href="http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev">http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev</a>
</pre>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
Hal Finkel
Lead, Compiler Technology and Programming Languages
Leadership Computing Facility
Argonne National Laboratory</pre>
</body>
</html>