[PATCH] D63461: [Util] Add a helper script for converting -print-before-all output into a file based equivelent

[Philip Reames via Phabricator via llvm-commits]

reames created this revision.
reames added reviewers: fedor.sergeev, skatkov.
Herald added subscribers: bollu, mcrosier.
Herald added a project: LLVM.

Simple little utility which takes a opt logfile generated with -print-before-all -print-module-scope, and splits into a series of individual "chunk-X.ll" files.  The intended purpose is to help automate one step in failure reduction.

The imagined workflow is:

1. New crasher bug reported against clang or other frontend
2. Frontend run with -emit-llvm equivalent and manually confirmed that opt -O2 <emit.ll> crashes
3. Run this splitter script
4. Manually map pass name to invocation command (next on the to automate list)
5. Run bugpoint on last chunk file + manual command

I chose to dump every chunk rather than only the last since miscompile debugging frequently requires either manual step by step reduction, or cross feeding IR into different compiler versions.  Not an immediate target, but there may be applications.


Repository:
  rL LLVM

https://reviews.llvm.org/D63461

Files:
  utils/chunk-print-before-all.py


Index: utils/chunk-print-before-all.py
===================================================================
--- utils/chunk-print-before-all.py
+++ utils/chunk-print-before-all.py
@@ -0,0 +1,42 @@
+#!/usr/bin/env python
+# Given a -print-before-all -print-module-scope log from an opt invocation,
+# chunk it into a series of individual IR files, one for each pass invocation.
+# If the log ends with an obvious stack trace, try to split off a separate
+# "crashinfo.txt" file leaving only the valid input IR in the last chunk.
+# Files are written to current working directory.
+
+import sys
+
+basename = "chunk-"
+chunk_id = 0
+
+def print_chunk(lines):
+    global chunk_id
+    global basename
+    fname = basename + str(chunk_id) + ".ll"
+    chunk_id = chunk_id + 1
+    print "writing chunk " + fname + " (" + str(len(lines)) + " lines)"
+    with open(fname, "w") as f:
+        f.writelines(lines)
+
+isdump = False
+cur = []
+for line in sys.stdin:
+    if line.startswith("*** IR Dump Before ") and len(cur) != 0:
+        print_chunk(cur);
+        cur = []
+        cur.append("; " + line)
+    elif line.startswith("Stack dump:"):
+        print_chunk(cur);
+        cur = []
+        cur.append(line)
+        isdump = True
+    else:
+        cur.append(line)
+
+if isdump:
+    print "writing crashinfo.txt (" + str(len(cur)) + " lines)"
+    with open("crashinfo.txt", "w") as f:
+        f.writelines(cur)
+else:
+    print_chunk(cur);


-------------- next part --------------
A non-text attachment was scrubbed...
Name: D63461.205197.patch
Type: text/x-patch
Size: 1456 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20190617/58dbf0d8/attachment.bin>