[llvm] [mlgo-utils] Hoist entry script out to the correct directory (PR #146981)

Vincent Lee via llvm-commits llvm-commits at lists.llvm.org
Thu Jul 3 18:28:32 PDT 2025


https://github.com/thevinster created https://github.com/llvm/llvm-project/pull/146981

These scripts belong in the `mlgo-utils` directory when directly used with python3. Adjust the bazel paths to account for this as well. This follows the same structure as lit. 

```
$ python3 ./llvm/utils/mlgo-utils/extract_ir.py --help                                                                                                        1s
usage: extract_ir.py [-h] [--input INPUT] [--input_type [{json,params,directory,bazel_aquery}]] [--output_dir OUTPUT_DIR] [--num_workers [NUM_WORKERS]] [--llvm_objcopy_path [LLVM_OBJCOPY_PATH]]
                     [--obj_base_dir [OBJ_BASE_DIR]] [--cmd_filter [CMD_FILTER]] [--thinlto_build [{distributed,local}]] [--cmd_section_name [CMD_SECTION_NAME]]
                     [--bitcode_section_name [BITCODE_SECTION_NAME]] [--verbosity [{DEBUG,INFO,WARNING,ERROR}]]
...

$ python3 ./llvm/utils/mlgo-utils/combine_training_corpus.py --help                                                                                           0s
usage: combine_training_corpus.py [-h] [--root_dir ROOT_DIR] [--verbosity [{DEBUG,INFO,WARNING,ERROR}]]
...

$ python3 ./llvm/utils/mlgo-utils/make_corpus.py --help                                                                                                      0s
usage: make_corpus.py [-h] [--input_dir INPUT_DIR] [--output_dir OUTPUT_DIR] [--default_args [DEFAULT_ARGS]]
...
```

>From 497d8f76d2df3dbd396c8b734b96ce81b12dcea7 Mon Sep 17 00:00:00 2001
From: Vincent Lee <leevince at fb.com>
Date: Thu, 3 Jul 2025 18:22:55 -0700
Subject: [PATCH] [mlgo-utils] Hoist entry script out to the correct directory

---
 .../mlgo-utils/{mlgo/corpus => }/combine_training_corpus.py | 0
 llvm/utils/mlgo-utils/{mlgo/corpus => }/extract_ir.py       | 0
 llvm/utils/mlgo-utils/{mlgo/corpus => }/make_corpus.py      | 0
 utils/bazel/llvm-project-overlay/llvm/BUILD.bazel           | 6 +++---
 4 files changed, 3 insertions(+), 3 deletions(-)
 rename llvm/utils/mlgo-utils/{mlgo/corpus => }/combine_training_corpus.py (100%)
 rename llvm/utils/mlgo-utils/{mlgo/corpus => }/extract_ir.py (100%)
 rename llvm/utils/mlgo-utils/{mlgo/corpus => }/make_corpus.py (100%)

diff --git a/llvm/utils/mlgo-utils/mlgo/corpus/combine_training_corpus.py b/llvm/utils/mlgo-utils/combine_training_corpus.py
similarity index 100%
rename from llvm/utils/mlgo-utils/mlgo/corpus/combine_training_corpus.py
rename to llvm/utils/mlgo-utils/combine_training_corpus.py
diff --git a/llvm/utils/mlgo-utils/mlgo/corpus/extract_ir.py b/llvm/utils/mlgo-utils/extract_ir.py
similarity index 100%
rename from llvm/utils/mlgo-utils/mlgo/corpus/extract_ir.py
rename to llvm/utils/mlgo-utils/extract_ir.py
diff --git a/llvm/utils/mlgo-utils/mlgo/corpus/make_corpus.py b/llvm/utils/mlgo-utils/make_corpus.py
similarity index 100%
rename from llvm/utils/mlgo-utils/mlgo/corpus/make_corpus.py
rename to llvm/utils/mlgo-utils/make_corpus.py
diff --git a/utils/bazel/llvm-project-overlay/llvm/BUILD.bazel b/utils/bazel/llvm-project-overlay/llvm/BUILD.bazel
index b618c74c19da1..db8a92fd25de6 100644
--- a/utils/bazel/llvm-project-overlay/llvm/BUILD.bazel
+++ b/utils/bazel/llvm-project-overlay/llvm/BUILD.bazel
@@ -5210,8 +5210,8 @@ py_binary(
 py_binary(
     name = "extract_ir",
     srcs = [
+        "utils/mlgo-utils/extract_ir.py",
         "utils/mlgo-utils/mlgo/__init__.py",
-        "utils/mlgo-utils/mlgo/corpus/extract_ir.py",
         "utils/mlgo-utils/mlgo/corpus/extract_ir_lib.py",
         "utils/mlgo-utils/mlgo/corpus/flags.py",
     ],
@@ -5221,8 +5221,8 @@ py_binary(
 py_binary(
     name = "combine_training_corpus",
     srcs = [
+        "utils/mlgo-utils/combine_training_corpus.py",
         "utils/mlgo-utils/mlgo/__init__.py",
-        "utils/mlgo-utils/mlgo/corpus/combine_training_corpus.py",
         "utils/mlgo-utils/mlgo/corpus/combine_training_corpus_lib.py",
         "utils/mlgo-utils/mlgo/corpus/flags.py",
     ],
@@ -5232,8 +5232,8 @@ py_binary(
 py_binary(
     name = "make_corpus",
     srcs = [
+        "utils/mlgo-utils/make_corpus.py",
         "utils/mlgo-utils/mlgo/__init__.py",
-        "utils/mlgo-utils/mlgo/corpus/make_corpus.py",
         "utils/mlgo-utils/mlgo/corpus/make_corpus_lib.py",
     ],
     imports = ["utils/mlgo-utils"],



More information about the llvm-commits mailing list