[llvm-commits] CVS: llvm-www/pubs/2009-07-ISSTA-BegBunch.html 2009-07-ISSTA-BegBunch.pdf pubs.js

Sun Oct 25 22:18:55 PDT 2009

Changes in directory llvm-www/pubs:

2009-07-ISSTA-BegBunch.html added (r1.1)
2009-07-ISSTA-BegBunch.pdf added (r1.1)
pubs.js updated: 1.52 -> 1.53
---
Log message:

add BegBunch: benchmarking for C bug detection tools


---
Diffs of the changes:  (+76 -0)

 2009-07-ISSTA-BegBunch.html |   68 ++++++++++++++++++++++++++++++++++++++++++++
 2009-07-ISSTA-BegBunch.pdf  |    0 
 pubs.js                     |    8 +++++
 3 files changed, 76 insertions(+)


Index: llvm-www/pubs/2009-07-ISSTA-BegBunch.html
diff -c /dev/null llvm-www/pubs/2009-07-ISSTA-BegBunch.html:1.1
*** /dev/null	Mon Oct 26 00:18:49 2009

--- llvm-www/pubs/2009-07-ISSTA-BegBunch.html	Mon Oct 26 00:18:39 2009
***************
*** 0 ****
--- 1,68 ----
+ <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
+ <html>
+ <head>
+   <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
+   <link rel="stylesheet" href="../llvm.css" type="text/css" media="screen">
+   <title>BegBunch: benchmarking for C bug detection tools</title>
+ </head>
+ <body>
+ 
+ <div class="pub_title">
+   BegBunch: benchmarking for C bug detection tools
+ </div>
+ <div class="pub_author">
+   Cristina Cifuentes, Christian Hoermann, Nathan Keynes, Lian Li, Simon Long, Erica Mealy, Michael Mounteney, Bernhard Scholz
+ </div>
+ 
+ <h2>Abstract:</h2>
+ <blockquote>
+ Benchmarks for bug detection tools are still in their infancy. Though in recent years various tools and techniques were introduced, little effort has been spent on creating a benchmark suite and a harness for a consistent quantitative and qualitative performance measurement. For assessing the performance of a bug detection tool and determining which tool is better than another for the type of code to be looked at, the following questions arise: 1) how many bugs are correctly found, 2) what is the tool's average false positive rate, 3) how many bugs are missed by the tool altogether, and 4) does the tool scale.<p>
+ 
+ In this paper we present our contribution to the C bug detection community: two benchmark suites that allow developers and users to evaluate accuracy and scalability of a given tool. The two suites contain buggy, mature open source code; bugs are representative of "real world" bugs. A harness accompanies each benchmark suite to compute automatically qualitative and quantitative performance of a bug detection tool.<p>
+ 
+ BegBunch has been tested to run on the Solaris, Mac OS X and Linux operating systems. We show the generality of the harness by evaluating it with our own Parfait and three publicly available bug detection tools developed by others.<p>
+ </blockquote>
+ 
+ <h2>Published:</h2>
+ <blockquote>
+   "BegBunch: benchmarking for C bug detection tools"
+   <br>
+   Cristina Cifuentes, Christian Hoermann, Nathan Keynes, Lian Li, Simon Long, Erica Mealy, Michael Mounteney, Bernhard Scholz.
+   <br>
+ <i>
+ Proceedings of the 2nd International Workshop on Defects in Large Software Systems: Held in conjunction with the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2009)
+ </i>, Chicago, Illinois, July 2009.
+ </blockquote>
+ <h2>Download:</h2>
+ <h3>Paper:</h3>
+ <ul>
+   <li><a href="2009-07-ISSTA-BegBunch.pdf">
+   BegBunch: benchmarking for C bug detection tools
+   </a> (PDF)</li>
+ </ul>
+ 
+ <h2>BibTeX Entry:</h2>
+ <pre>
+ @inproceedings{1555866,
+  author = {Cifuentes, Cristina and Hoermann, Christian and Keynes, Nathan and Li, Lian and Long, Simon and Mealy, Erica and Mounteney, Michael and Scholz, Bernhard},
+  title = {BegBunch: benchmarking for C bug detection tools},
+  booktitle = {DEFECTS '09: Proceedings of the 2nd International Workshop on Defects in Large Software Systems},
+  year = {2009},
+  isbn = {978-1-60558-654-0},
+  pages = {16--20},
+  location = {Chicago, Illinois},
+  doi = {http://doi.acm.org/10.1145/1555860.1555866},
+  publisher = {ACM},
+  address = {New York, NY, USA},
+  }
+ </pre>
+ 
+ <!-- *********************************************************************** -->
+ <hr>
+   <a href="http://jigsaw.w3.org/css-validator/check/referer"><img
+   src="http://jigsaw.w3.org/css-validator/images/vcss" alt="Valid CSS!"></a>
+   <a href="http://validator.w3.org/check/referer"><img
+   src="http://www.w3.org/Icons/valid-html401" alt="Valid HTML 4.01!" /></a>
+ 
+ </body>
+ </html>


Index: llvm-www/pubs/2009-07-ISSTA-BegBunch.pdf


Index: llvm-www/pubs/pubs.js
diff -u llvm-www/pubs/pubs.js:1.52 llvm-www/pubs/pubs.js:1.53
--- llvm-www/pubs/pubs.js:1.52	Mon Oct 26 00:00:54 2009
+++ llvm-www/pubs/pubs.js	Mon Oct 26 00:18:39 2009
@@ -9,6 +9,14 @@
    month: 8,
    year: 2009},
 
+  {url: '2009-07-ISSTA-BegBunch.html',
+   title: 'BegBunch: benchmarking for C bug detection tools',
+   author: 'Cristina Cifuentes, Christian Hoermann, Nathan Keynes, Lian Li, Simon Long, Erica Mealy, Michael Mounteney, and Bernhard Scholz',
+   published: 'Proc. of the 2nd International Workshop on Defects in Large Software Systems: Held in conjunction with the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2009)',
+   location: 'Chicago, Illinois',
+   month: 7,
+   year: 2009},
+
   {url: '2009-06-PLDI-LibraryBindings.html',
    title: 'Automatic generation of library bindings using static analysis',
    author: 'Tristan Ravitch, Steve Jackson, Eric Aderhold, and Ben Liblit',




