[all-commits] [llvm/llvm-project] c5ff6f: [mlgo] Dependency-free training mode logger

[Mircea Trofin via All-commits]

  Branch: refs/heads/main
  Home:   https://github.com/llvm/llvm-project
  Commit: c5ff6f72342e0a4b0ba2ec9f603bedca86721e80
      https://github.com/llvm/llvm-project/commit/c5ff6f72342e0a4b0ba2ec9f603bedca86721e80
  Author: Mircea Trofin <mtrofin at google.com>
  Date:   2022-12-06 (Tue, 06 Dec 2022)

  Changed paths:
    A .style.yapf
    M llvm/include/llvm/Analysis/TensorSpec.h
    M llvm/lib/Analysis/TensorSpec.cpp
    M llvm/lib/Analysis/TrainingLogger.cpp
    A llvm/lib/Analysis/models/log_reader.py
    A llvm/test/CodeGen/MLRegalloc/Inputs/two-large-fcts.ll
    M llvm/test/CodeGen/MLRegalloc/dev-mode-logging.ll
    M llvm/test/Transforms/Inline/ML/ml-test-development-mode.ll

  Log Message:
  -----------
  [mlgo] Dependency-free training mode logger

This is the next step in dropping the dependency on protobuf.

The simple logger produces an output consisting of lines of json
strings. Tensor values - which should constitute the bulk of the data -
are serialized as raw byte buffers. This allows for light-weight reading
of the values.

The next step is to switch the training logic to the new logging format,
following which the protobuf-based logger will be dropped, together with
the training dependency on protobuf.

Subsequent changes will also stop buffering and stream, instead - the
buffering model is just as a convenient point-in-time.

Differential Revision: https://reviews.llvm.org/D139370