[compiler-rt] r361313 - [libFuzzer] Reduce flakiness of merge-sigusr.test.

via llvm-commits llvm-commits at lists.llvm.org
Tue May 21 16:02:06 PDT 2019


Hi Matt,

The test is still failing after r361326, but now there seems to be more output, maybe it can help you see what is failing?

Command Output (stderr):
--
/home/siadmin/jenkins/w/opensource/opensource_build/llvm/projects/compiler-rt/test/fuzzer/merge-sigusr.test:38:8: error: CHECK: expected string not found in input
CHECK: INFO: libFuzzer: exiting as requested
       ^
<stdin>:16:1: note: scanning from here
INFO: Seed: 2774593460
^
<stdin>:19:24: note: possible intended match here
INFO: -max_len is not provided; libFuzzer will not generate inputs larger than 1048576 bytes
                       ^

Input file: <stdin>
Check file: /home/siadmin/jenkins/w/opensource/opensource_build/llvm/projects/compiler-rt/test/fuzzer/merge-sigusr.test

-dump-input=help describes the format of the following dump.

Full input was:
<<<<<<
            1: INFO: Seed: 3990588964
            2: INFO: Loaded 1 modules (1 inline 8-bit counters): 1 [0x776e40, 0x776e41),
            3: INFO: Loaded 1 PC tables (1 PCs): 1 [0x550cd8,0x550ce8),
            4: MERGE-OUTER: 7 files, 0 in the initial corpus
            5: MERGE-OUTER: attempt 1
            6: INFO: Seed: 4014854147
            7: INFO: Loaded 1 modules (1 inline 8-bit counters): 1 [0x776e40, 0x776e41),
            8: INFO: Loaded 1 PC tables (1 PCs): 1 [0x550cd8,0x550ce8),
            9: INFO: -max_len is not provided; libFuzzer will not generate inputs larger than 1048576 bytes
           10: MERGE-INNER: using the control file '/home/siadmin/jenkins/w/opensource/opensource_build/build/projects/compiler-rt/test/fuzzer/X86_64DefaultLinuxConfig/Output/merge-sigusr.test.tmp/MCF'
           11: MERGE-INNER: 7 total files; 0 processed earlier; will process 7 files now
           12: #1 pulse cov: 1 exec/s: 1 rss: 27Mb
          13: #2 pulse cov: 1 exec/s: 1 rss: 27Mb
           14: MERGE-OUTER: attempt 2
           15: INFO: signal received, trying to exit gracefully
           16: INFO: Seed: 2774593460
check:38'0     X~~~~~~~~~~~~~~~~~~~~~
           17: INFO: Loaded 1 modules (1 inline 8-bit counters): 1 [0x776e40, 0x776e41),
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           18: INFO: Loaded 1 PC tables (1 PCs): 1 [0x550cd8,0x550ce8),
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           19: INFO: -max_len is not provided; libFuzzer will not generate inputs larger than 1048576 bytes
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
check:38'1                            ?                                                                     possible intended match
           20: MERGE-INNER: using the control file '/home/siadmin/jenkins/w/opensource/opensource_build/build/projects/compiler-rt/test/fuzzer/X86_64DefaultLinuxConfig/Output/merge-sigusr.test.tmp/MCF'
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           21: MERGE-INNER: '/home/siadmin/jenkins/w/opensource/opensource_build/build/projects/compiler-rt/test/fuzzer/X86_64DefaultLinuxConfig/Output/merge-sigusr.test.tmp/C2/d' caused a failure at the previous merge step
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           22: MERGE-INNER: 7 total files; 4 processed earlier; will process 3 files now
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           23: #4 pulse cov: 1 exec/s: 1 rss: 27Mb
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           24: #1 pulse cov: 1 exec/s: 1 rss: 27Mb
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           25: #2 pulse cov: 1 exec/s: 1 rss: 27Mb
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           26: #3 DONE cov: 1 exec/s: 1 rss: 27Mb
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           27: MERGE-OUTER: succesfull in 2 attempt(s)
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           28: MERGE-OUTER: the control file has 1281 bytes
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           29: MERGE: failed to parse the control file (unexpected error)
check:38'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found
>>>>>>

--

Douglas Yung

From: Matt Morehouse <mascasa at google.com>
Sent: Tuesday, May 21, 2019 15:47
To: Yung, Douglas <douglas.yung at sony.com>
Cc: llvm-commits <llvm-commits at lists.llvm.org>
Subject: Re: [compiler-rt] r361313 - [libFuzzer] Reduce flakiness of merge-sigusr.test.

Thanks for the heads up.  I suspect the issue is the $PID process is exiting before wait runs.  I've sent r361326 as a speculative fix.

On Tue, May 21, 2019 at 3:37 PM <douglas.yung at sony.com<mailto:douglas.yung at sony.com>> wrote:
Hi Matt,

This change is causing the test you re-enabled to fail on our internal linux bot. The test output is not terribly informative though and I am seeing if I can figure out where it is failing, but wanted to give you a heads up.

Douglas Yung

-----Original Message-----
From: llvm-commits <llvm-commits-bounces at lists.llvm.org<mailto:llvm-commits-bounces at lists.llvm.org>> On Behalf Of Matt Morehouse via llvm-commits
Sent: Tuesday, May 21, 2019 14:16
To: llvm-commits at lists.llvm.org<mailto:llvm-commits at lists.llvm.org>
Subject: [compiler-rt] r361313 - [libFuzzer] Reduce flakiness of merge-sigusr.test.

Author: morehouse
Date: Tue May 21 14:15:51 2019
New Revision: 361313

URL: http://llvm.org/viewvc/llvm-project?rev=361313&view=rev
Log:
[libFuzzer] Reduce flakiness of merge-sigusr.test.

Double the number of files to merge, and use wait instead of sleep.

Modified:
    compiler-rt/trunk/test/fuzzer/merge-sigusr.test

Modified: compiler-rt/trunk/test/fuzzer/merge-sigusr.test
URL: http://llvm.org/viewvc/llvm-project/compiler-rt/trunk/test/fuzzer/merge-sigusr.test?rev=361313&r1=361312&r2=361313&view=diff
==============================================================================
--- compiler-rt/trunk/test/fuzzer/merge-sigusr.test (original)
+++ compiler-rt/trunk/test/fuzzer/merge-sigusr.test Tue May 21 14:15:51
+++ 2019
@@ -1,8 +1,7 @@
 # Check that libFuzzer honors SIGUSR1/SIGUSR2  # FIXME: Disabled on Windows for now because of reliance on posix only features  # (eg: export, "&", pkill).
-# TODO(morehouse): rethink test and reenable for linux.
-UNSUPPORTED: darwin, windows, linux
+UNSUPPORTED: darwin, windows
 RUN: rm -rf %t
 RUN: mkdir -p %t
 RUN: %cpp_compiler %S/SleepOneSecondTest.cpp -o %t/LFSIGUSR @@ -15,12 +14,20 @@ RUN: echo d > %t/C2/d
 RUN: echo e > %t/C2/e
 RUN: echo f > %t/C2/f
 RUN: echo g > %t/C2/g
+RUN: echo h > %t/C2/g
+RUN: echo i > %t/C2/g
+RUN: echo j > %t/C2/g
+RUN: echo k > %t/C2/g
+RUN: echo l > %t/C2/g
+RUN: echo m > %t/C2/g
+RUN: echo n > %t/C2/g
+RUN: echo o > %t/C2/g

 RUN: %run %t/LFSIGUSR -merge=1 -merge_control_file=%t/MCF %t/C1 %t/C2 2>%t/log & export PID=$!
 RUN: sleep 3
 RUN: pkill -SIGUSR2 -P $PID
 RUN: kill -SIGUSR2 $PID
-RUN: sleep 6
+RUN: wait $PID
 RUN: cat %t/log | FileCheck %s --dump-input=fail
 RUN: grep C2/g %t/MCF
 RUN: grep STARTED %t/MCF


_______________________________________________
llvm-commits mailing list
llvm-commits at lists.llvm.org<mailto:llvm-commits at lists.llvm.org>
https://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-commits
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20190521/5c7d9a4f/attachment.html>


More information about the llvm-commits mailing list