[PATCH] D139370: [mlgo] Dependency-free training mode logger

[Mircea Trofin via Phabricator via llvm-commits]

mtrofin created this revision.
mtrofin added reviewers: kazu, yundiqian, jacobhegna, phosek.
Herald added subscribers: hiraditya, qcolombet, MatzeB.
Herald added a project: All.
mtrofin requested review of this revision.
Herald added a project: LLVM.
Herald added a subscriber: llvm-commits.

This is the next step in dropping the dependency on protobuf.

The simple logger produces an output consisting of lines of json
strings. Tensor values - which should constitute the bulk of the data -
are serialized as raw byte buffers. This allows for light-weight reading
of the values.

The next step is to switch the training logic to the new logging format,
following which the protobuf-based logger will be dropped, together with
the training dependency on protobuf.

Subsequent changes will also stop buffering and stream, instead - the
buffering model is just as a convenient point-in-time.


Repository:
  rG LLVM Github Monorepo

https://reviews.llvm.org/D139370

Files:
  .style.yapf
  llvm/include/llvm/Analysis/TensorSpec.h
  llvm/lib/Analysis/TensorSpec.cpp
  llvm/lib/Analysis/TrainingLogger.cpp
  llvm/lib/Analysis/models/log_reader.py
  llvm/test/CodeGen/MLRegalloc/Inputs/two-large-fcts.ll
  llvm/test/CodeGen/MLRegalloc/dev-mode-logging.ll
  llvm/test/Transforms/Inline/ML/ml-test-development-mode.ll

-------------- next part --------------
A non-text attachment was scrubbed...
Name: D139370.480244.patch
Type: text/x-patch
Size: 42130 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20221205/f70e3b37/attachment.bin>