[llvm] r315557 - Re-commit "llvm-isel-fuzzer: Handle a subset of backend flags in the exec name"
Kostya Serebryany via llvm-commits
llvm-commits at lists.llvm.org
Thu Oct 12 16:21:46 PDT 2017
'=' also doesn't work with oss-fuzz:
https://github.com/google/oss-fuzz/blob/master/docs/new_project_guide.md#buildsh
make sure that the binary names for your fuzz targets contain only
alphanumeric characters, underscore(_) or dash(-). Otherwise, they won't
run on our infrastructure.
What about '--' (double-dash)?
On Wed, Oct 11, 2017 at 9:35 PM, Justin Bogner via llvm-commits <
llvm-commits at lists.llvm.org> wrote:
> Author: bogner
> Date: Wed Oct 11 21:35:32 2017
> New Revision: 315557
>
> URL: http://llvm.org/viewvc/llvm-project?rev=315557&view=rev
> Log:
> Re-commit "llvm-isel-fuzzer: Handle a subset of backend flags in the exec
> name"
>
> Here we add a secondary option parser to llvm-isel-fuzzer (and provide
> it for use with other fuzzers). With this, you can copy the fuzzer to
> a name like llvm-isel-fuzzer=aarch64-gisel for a fuzzer that fuzzer
> AArch64 with GlobalISel enabled, or fuzzer=x86_64 to fuzz x86, with no
> flags required. This should be useful for running these in OSS-Fuzz.
>
> Note that this handrolls a subset of cl::opts to recognize, rather
> than embedding a complete command parser for argv[0]. If we find we
> really need the flexibility of handling arbitrary options at some
> point we can rethink this.
>
> This re-applies 315545 using "=" instead of ":" as a separator for
> arguments.
>
> Added:
> llvm/trunk/test/tools/llvm-isel-fuzzer/aarch64-execname-options.ll
> llvm/trunk/test/tools/llvm-isel-fuzzer/execname-options.ll
> Modified:
> llvm/trunk/docs/FuzzingLLVM.rst
> llvm/trunk/include/llvm/FuzzMutate/FuzzerCLI.h
> llvm/trunk/lib/FuzzMutate/FuzzerCLI.cpp
> llvm/trunk/tools/llvm-isel-fuzzer/llvm-isel-fuzzer.cpp
>
> Modified: llvm/trunk/docs/FuzzingLLVM.rst
> URL: http://llvm.org/viewvc/llvm-project/llvm/trunk/docs/FuzzingL
> LVM.rst?rev=315557&r1=315556&r2=315557&view=diff
> ============================================================
> ==================
> --- llvm/trunk/docs/FuzzingLLVM.rst (original)
> +++ llvm/trunk/docs/FuzzingLLVM.rst Wed Oct 11 21:35:32 2017
> @@ -81,6 +81,13 @@ the following command would fuzz AArch64
>
> % bin/llvm-isel-fuzzer <corpus-dir> -ignore_remaining_args=1 -mtriple
> aarch64 -global-isel -O0
>
> +Some flags can also be specified in the binary name itself in order to
> support
> +OSS Fuzz, which has trouble with required arguments. To do this, you can
> copy
> +or move ``llvm-isel-fuzzer`` to ``llvm-isel-fuzzer=x-y-z``, where x, y,
> and z
> +are architecture names (``aarch64``, ``x86_64``), optimization levels
> (``O0``,
> +``O2``), or specific keywords like ``gisel`` for enabling global
> instruction
> +selection.
> +
> llvm-mc-assemble-fuzzer
> -----------------------
>
>
> Modified: llvm/trunk/include/llvm/FuzzMutate/FuzzerCLI.h
> URL: http://llvm.org/viewvc/llvm-project/llvm/trunk/include/llvm/
> FuzzMutate/FuzzerCLI.h?rev=315557&r1=315556&r2=315557&view=diff
> ============================================================
> ==================
> --- llvm/trunk/include/llvm/FuzzMutate/FuzzerCLI.h (original)
> +++ llvm/trunk/include/llvm/FuzzMutate/FuzzerCLI.h Wed Oct 11 21:35:32
> 2017
> @@ -15,6 +15,7 @@
> #ifndef LLVM_FUZZMUTATE_FUZZER_CLI_H
> #define LLVM_FUZZMUTATE_FUZZER_CLI_H
>
> +#include "llvm/ADT/StringRef.h"
> #include "llvm/Support/DataTypes.h"
>
> namespace llvm {
> @@ -24,6 +25,17 @@ namespace llvm {
> /// This handles all arguments after -ignore_remaining_args=1 as cl::opts.
> void parseFuzzerCLOpts(int ArgC, char *ArgV[]);
>
> +/// Handle backend options that are encoded in the executable name.
> +///
> +/// Parses some common backend options out of a specially crafted
> executable
> +/// name (argv[0]). For example, a name like
> llvm-foo-fuzzer:aarch64-gisel might
> +/// set up an AArch64 triple and the Global ISel selector. This should be
> called
> +/// *before* parseFuzzerCLOpts if calling both.
> +///
> +/// This is meant to be used for environments like OSS-Fuzz that aren't
> capable
> +/// of passing in command line arguments in the normal way.
> +void handleExecNameEncodedBEOpts(StringRef ExecName);
> +
> using FuzzerTestFun = int (*)(const uint8_t *Data, size_t Size);
> using FuzzerInitFun = int (*)(int *argc, char ***argv);
>
>
> Modified: llvm/trunk/lib/FuzzMutate/FuzzerCLI.cpp
> URL: http://llvm.org/viewvc/llvm-project/llvm/trunk/lib/FuzzMutat
> e/FuzzerCLI.cpp?rev=315557&r1=315556&r2=315557&view=diff
> ============================================================
> ==================
> --- llvm/trunk/lib/FuzzMutate/FuzzerCLI.cpp (original)
> +++ llvm/trunk/lib/FuzzMutate/FuzzerCLI.cpp Wed Oct 11 21:35:32 2017
> @@ -8,7 +8,7 @@
> //===------------------------------------------------------
> ----------------===//
>
> #include "llvm/FuzzMutate/FuzzerCLI.h"
> -#include "llvm/ADT/StringRef.h"
> +#include "llvm/ADT/Triple.h"
> #include "llvm/Support/CommandLine.h"
> #include "llvm/Support/Compiler.h"
> #include "llvm/Support/Error.h"
> @@ -30,6 +30,42 @@ void llvm::parseFuzzerCLOpts(int ArgC, c
>
> cl::ParseCommandLineOptions(CLArgs.size(), CLArgs.data());
> }
> +
> +void llvm::handleExecNameEncodedBEOpts(StringRef ExecName) {
> + std::vector<std::string> Args{ExecName};
> +
> + auto NameAndArgs = ExecName.split('=');
> + if (NameAndArgs.second.empty())
> + return;
> +
> + SmallVector<StringRef, 4> Opts;
> + NameAndArgs.second.split(Opts, '-');
> + for (StringRef Opt : Opts) {
> + if (Opt.equals("gisel")) {
> + Args.push_back("-global-isel");
> + // For now we default GlobalISel to -O0
> + Args.push_back("-O0");
> + } else if (Opt.startswith("O")) {
> + Args.push_back("-" + Opt.str());
> + } else if (Triple::getArchTypeForLLVMName(Opt)) {
> + Args.push_back("-mtriple=" + Opt.str());
> + } else {
> + errs() << ExecName << ": Unknown option: " << Opt << ".\n";
> + exit(1);
> + }
> + }
> + errs() << NameAndArgs.first << ": Injected args:";
> + for (int I = 1, E = Args.size(); I < E; ++I)
> + errs() << " " << Args[I];
> + errs() << "\n";
> +
> + std::vector<const char *> CLArgs;
> + CLArgs.reserve(Args.size());
> + for (std::string &S : Args)
> + CLArgs.push_back(S.c_str());
> +
> + cl::ParseCommandLineOptions(CLArgs.size(), CLArgs.data());
> +}
>
> int llvm::runFuzzerOnInputs(int ArgC, char *ArgV[], FuzzerTestFun TestOne,
> FuzzerInitFun Init) {
>
> Added: llvm/trunk/test/tools/llvm-isel-fuzzer/aarch64-execname-options.ll
> URL: http://llvm.org/viewvc/llvm-project/llvm/trunk/test/tools/ll
> vm-isel-fuzzer/aarch64-execname-options.ll?rev=315557&view=auto
> ============================================================
> ==================
> --- llvm/trunk/test/tools/llvm-isel-fuzzer/aarch64-execname-options.ll
> (added)
> +++ llvm/trunk/test/tools/llvm-isel-fuzzer/aarch64-execname-options.ll
> Wed Oct 11 21:35:32 2017
> @@ -0,0 +1,15 @@
> +; REQUIRES: aarch64-registered-target
> +
> +; RUN: echo > %t.input
> +
> +; RUN: cp llvm-isel-fuzzer %t.bin=aarch64
> +; RUN: %t.bin=aarch64 %t.input 2>&1 | FileCheck -check-prefix=AARCH64 %s
> +; AARCH64: Injected args: -mtriple=aarch64
> +
> +; RUN: cp llvm-isel-fuzzer %t.bin=aarch64-O1
> +; RUN: %t.bin=aarch64-O1 %t.input 2>&1 | FileCheck
> -check-prefix=OPT-AFTER %s
> +; OPT-AFTER: Injected args: -mtriple=aarch64 -O1
> +
> +; RUN: cp llvm-isel-fuzzer %t.bin=O3-aarch64
> +; RUN: %t.bin=O3-aarch64 %t.input 2>&1 | FileCheck
> -check-prefix=OPT-BEFORE %s
> +; OPT-BEFORE: Injected args: -O3 -mtriple=aarch64
>
> Added: llvm/trunk/test/tools/llvm-isel-fuzzer/execname-options.ll
> URL: http://llvm.org/viewvc/llvm-project/llvm/trunk/test/tools/ll
> vm-isel-fuzzer/execname-options.ll?rev=315557&view=auto
> ============================================================
> ==================
> --- llvm/trunk/test/tools/llvm-isel-fuzzer/execname-options.ll (added)
> +++ llvm/trunk/test/tools/llvm-isel-fuzzer/execname-options.ll Wed Oct 11
> 21:35:32 2017
> @@ -0,0 +1,15 @@
> +; RUN: echo > %t.input
> +
> +; RUN: cp llvm-isel-fuzzer %t.bin=gisel
> +; RUN: not %t.bin=gisel %t.input 2>&1 | FileCheck -check-prefix=GISEL %s
> +; GISEL: Injected args: -global-isel -O0
> +; GISEL: -mtriple must be specified
> +
> +; RUN: cp llvm-isel-fuzzer %t.bin=gisel-O2
> +; RUN: not %t.bin=gisel-O2 %t.input 2>&1 | FileCheck
> -check-prefix=GISEL-O2 %s
> +; GISEL-O2: Injected args: -global-isel -O0 -O2
> +; GISEL-O2: -mtriple must be specified
> +
> +; RUN: cp llvm-isel-fuzzer %t.bin=unexist
> +; RUN: not %t.bin=unexist %t.input 2>&1 | FileCheck -check-prefix=NO-OPT
> %s
> +; NO-OPT: Unknown option:
>
> Modified: llvm/trunk/tools/llvm-isel-fuzzer/llvm-isel-fuzzer.cpp
> URL: http://llvm.org/viewvc/llvm-project/llvm/trunk/tools/llvm-is
> el-fuzzer/llvm-isel-fuzzer.cpp?rev=315557&r1=315556&r2=315557&view=diff
> ============================================================
> ==================
> --- llvm/trunk/tools/llvm-isel-fuzzer/llvm-isel-fuzzer.cpp (original)
> +++ llvm/trunk/tools/llvm-isel-fuzzer/llvm-isel-fuzzer.cpp Wed Oct 11
> 21:35:32 2017
> @@ -150,11 +150,12 @@ extern "C" LLVM_ATTRIBUTE_USED int LLVMF
> InitializeAllAsmPrinters();
> InitializeAllAsmParsers();
>
> + handleExecNameEncodedBEOpts(*argv[0]);
> parseFuzzerCLOpts(*argc, *argv);
>
> if (TargetTriple.empty()) {
> errs() << *argv[0] << ": -mtriple must be specified\n";
> - return 1;
> + exit(1);
> }
>
> Triple TheTriple = Triple(Triple::normalize(TargetTriple));
>
>
> _______________________________________________
> llvm-commits mailing list
> llvm-commits at lists.llvm.org
> http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-commits
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20171012/0d1ce6f3/attachment.html>
More information about the llvm-commits
mailing list