[PATCH] D140239: [llvm-stress] Add a mutation fuzzing mode

[Peter Rong via Phabricator via llvm-commits]

Peter added a comment.

In D140239#4002352 <https://reviews.llvm.org/D140239#4002352>, @reames wrote:

> In D140239#4002268 <https://reviews.llvm.org/D140239#4002268>, @reames wrote:
>
>> In D140239#4002246 <https://reviews.llvm.org/D140239#4002246>, @Peter wrote:
>>
>>> I think another interesting thing you can all is "How much do you want to mutate". `mutateModule` will only change the module once, i.e. insert one instruction, add one function(may be no one is using it).
>>>
>>> Can we add a command line arg `--num-mutate=` and default to, say 100, so we mutate the module 100 times before we return it.
>>>
>>> Just a thought.
>>
>> Good idea.  If you don't mind I'll leave that to a follow up commit.  I also want to add some command line control of which strategies to select from.  Again, in a separate commit.
>
> After writing this, I wondered how we'd been testing the new mutation strategies.  The answer turned out to be, we weren't.  This will give a means to write tests for individual mutations going forward as well.

Sorry I don't understand what do you mean by we are not testing mutation strategies.

If you mean unit testing, we actually have hand written modules and try it on strategies in llvm/unittests/FuzzMutate/StrategiesTest.cpp.
If you mean more large scale end-to-end testing, I have been using these strategies the whole winter so they should be good.


Repository:
  rG LLVM Github Monorepo

CHANGES SINCE LAST ACTION
  https://reviews.llvm.org/D140239/new/

https://reviews.llvm.org/D140239