<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hi James,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
I feel it might be confusing to have a CHECK becomes effectively a CHECK-NOT, especially if the RUN line is far from the CHECK line (which is often the case when a single RUN line drives several groups of CHECK directives (e.g. code generation tested for several
functions for a specific feature, like PIC). You also loose control on where the NOT should be: it would have to be at the same location as the CHECK even though for the NOT case you might want to check it somewhere else.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
How about having a concept of regex variables where you give a name to a given directive's pattern which you could reuse as another pattern. Something like (syntax TBD):</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
CHECK<NAME>: mov [[REG:r[0-9]+]], #42</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
CHECK-NOT: <NAME></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Best regards,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Thomas<br>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> James Henderson <jh7370.2008@my.bristol.ac.uk><br>
<b>Sent:</b> 31 January 2020 09:14<br>
<b>To:</b> llvm-dev <llvm-dev@lists.llvm.org>; Thomas Preud'homme <thomasp@graphcore.ai>; Paul Robinson <paul.robinson@sony.com>; George Rimar <grimar@accesssoftek.com><br>
<b>Subject:</b> [RFC][FileCheck] New option to negate check patterns</font>
<div> </div>
</div>
<div>
<p><span style="background-color:#ffeb9c"> [This message was sent from somebody outside of your organisation] </span></p>
<p> </p>
<div>
<div dir="ltr">
<div>Hi all,<br>
</div>
<div><br>
</div>
<div>There have been a few cases recently where I've noticed two test cases in the same lit test that do the same thing except invert the CHECK, to show that something is NOT present. I'm talking about something like the following:</div>
<div><br>
</div>
<div># RUN: llvm-sometool --print-string | FileCheck %s --check-prefix=STRING</div>
<div># RUN: llvm-sometool --no-print-string | FileCheck %s --check-prefix=NO-STRING<br>
</div>
<div># STRING: This is the string</div>
<div># NO-STRING-NOT: This is the string</div>
<div><br>
</div>
<div>In such cases, as can be seen, the CHECK line effectively has to be duplicated (either in an explicit check like in the above example, or via --implicit-check-not). Duplication is generally bad, especially in this sort of case, as it only takes a typo
in the NOT pattern, or a careless developer/reviewer pair changing the output to cause the NOT pattern to no longer be useful.</div>
<div><br>
</div>
<div>I'd like to propose a new FileCheck option (e.g. --check-not-prefix/--check-not-prefixes) which allows implicitly converting a check prefix to a -NOT version of the same prefix. That would allow writing the above example as:</div>
<div><br>
</div>
<div>
<div># RUN: llvm-sometool --print-string | FileCheck %s --check-prefix=STRING</div>
<div># RUN: llvm-sometool --no-print-string | FileCheck %s --check-not-prefix=STRING<br>
</div>
<div># STRING: This is the string</div>
<div><br>
</div>
<div>If there was a typo or somebody changed the string output, this mechanism would ensure there is no chance of the pattern rotting.</div>
<div><br>
</div>
<div>Caveat: I don't know what would be the appropriate way of handling non-trivial checks, i.e. existing CHECK-NOT/CHECK-NEXT/CHECK-SAME etc. I'd appreciate any ideas on this.<br>
</div>
<div><br>
</div>
<div>Thoughts?</div>
<div><br>
</div>
<div>James<br>
</div>
</div>
</div>
</div>
</div>
</body>
</html>