[Mlir-commits] [mlir] [mlir][mesh] adding shard-size control (PR #98145)

LLVM Continuous Integration llvmlistbot at llvm.org
Wed Aug 7 06:10:18 PDT 2024 

llvm-ci wrote:

LLVM Buildbot has detected a new failure on builder `mlir-nvidia` running on `mlir-nvidia` while building `mlir` at step 5 "build-check-mlir-build-only".

Full details are available at: https://lab.llvm.org/buildbot/#/builders/138/builds/2153

Here is the relevant piece of the build log for the reference:
```
Step 5 (build-check-mlir-build-only) failure: build (failure)
...
584.816 [1138/16/3762] Creating library symlink lib/libMLIRNVGPUDialect.so
584.875 [1137/16/3763] Linking CXX shared library lib/libMLIRAMDGPUUtils.so.20.0git
584.883 [1136/16/3764] Creating library symlink lib/libMLIRAMDGPUUtils.so
584.981 [1135/16/3765] Building CXX object tools/mlir/lib/Dialect/Vector/Transforms/CMakeFiles/obj.MLIRVectorTransforms.dir/VectorTransferSplitRewritePatterns.cpp.o
585.009 [1134/16/3766] Building CXX object tools/mlir/lib/Pass/CMakeFiles/obj.MLIRPass.dir/PassCrashRecovery.cpp.o
585.015 [1133/16/3767] Linking CXX shared library lib/libMLIROpenACCDialect.so.20.0git
585.023 [1132/16/3768] Creating library symlink lib/libMLIROpenACCDialect.so
585.041 [1131/16/3769] Building CXX object tools/mlir/lib/Pass/CMakeFiles/obj.MLIRPass.dir/IRPrinting.cpp.o
585.057 [1130/16/3770] Building CXX object tools/mlir/lib/Pass/CMakeFiles/obj.MLIRPass.dir/PassRegistry.cpp.o
585.058 [1129/16/3771] Linking CXX shared library lib/libMLIRTensorDialect.so.20.0git
FAILED: lib/libMLIRTensorDialect.so.20.0git 
: && /usr/bin/clang++ -fPIC -fPIC -fno-semantic-interposition -fvisibility-inlines-hidden -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -pedantic -Wno-long-long -Wc++98-compat-extra-semi -Wimplicit-fallthrough -Wcovered-switch-default -Wno-noexcept-type -Wnon-virtual-dtor -Wdelete-non-virtual-dtor -Wsuggest-override -Wstring-conversion -Wmisleading-indentation -Wctad-maybe-unsupported -fdiagnostics-color -ffunction-sections -fdata-sections -Wundef -Werror=mismatched-tags -Werror=global-constructors -O3 -DNDEBUG  -Wl,-z,defs -Wl,-z,nodelete -fuse-ld=lld -Wl,--color-diagnostics   -Wl,--gc-sections -shared -Wl,-soname,libMLIRTensorDialect.so.20.0git -o lib/libMLIRTensorDialect.so.20.0git tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/TensorDialect.cpp.o tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/TensorOps.cpp.o tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ShardingInterfaceImpl.cpp.o tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ValueBoundsOpInterfaceImpl.cpp.o  -Wl,-rpath,"\$ORIGIN/../lib:/vol/worker/mlir-nvidia/mlir-nvidia/llvm.obj/lib:"  lib/libMLIRAffineDialect.so.20.0git  lib/libMLIRParallelCombiningOpInterface.so.20.0git  lib/libMLIRMemRefDialect.so.20.0git  lib/libMLIRArithUtils.so.20.0git  lib/libMLIRComplexDialect.so.20.0git  lib/libMLIRArithAttrToLLVMConversion.so.20.0git  lib/libMLIRArithDialect.so.20.0git  lib/libMLIRCastInterfaces.so.20.0git  lib/libMLIRInferIntRangeCommon.so.20.0git  lib/libMLIRLLVMDialect.so.20.0git  lib/libLLVMBitWriter.so.20.0git  lib/libLLVMAsmParser.so.20.0git  lib/libLLVMBitReader.so.20.0git  lib/libMLIRDialectUtils.so.20.0git  lib/libMLIRShapedOpInterfaces.so.20.0git  lib/libMLIRValueBoundsOpInterface.so.20.0git  lib/libMLIRDestinationStyleOpInterface.so.20.0git  lib/libMLIRAnalysis.so.20.0git  lib/libMLIRInferTypeOpInterface.so.20.0git  lib/libMLIRSideEffectInterfaces.so.20.0git  lib/libMLIRLoopLikeInterface.so.20.0git  lib/libMLIRInferIntRangeInterface.so.20.0git  lib/libMLIRFunctionInterfaces.so.20.0git  lib/libMLIRCallInterfaces.so.20.0git  lib/libMLIRDataLayoutInterfaces.so.20.0git  lib/libMLIRPresburger.so.20.0git  lib/libMLIRViewLikeInterface.so.20.0git  lib/libLLVMCore.so.20.0git  lib/libLLVMBinaryFormat.so.20.0git  lib/libMLIRDialect.so.20.0git  lib/libMLIRControlFlowInterfaces.so.20.0git  lib/libMLIRMemorySlotInterfaces.so.20.0git  lib/libMLIRUBDialect.so.20.0git  lib/libMLIRIR.so.20.0git  lib/libMLIRSupport.so.20.0git  lib/libLLVMSupport.so.20.0git  -Wl,-rpath-link,/vol/worker/mlir-nvidia/mlir-nvidia/llvm.obj/lib && :
ld.lld: error: undefined symbol: mlir::mesh::detail::defaultGetShardingOption(mlir::Operation*, llvm::ArrayRef<mlir::mesh::MeshSharding>, llvm::ArrayRef<mlir::mesh::MeshSharding>)
>>> referenced by ShardingInterfaceImpl.cpp
>>>               tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ShardingInterfaceImpl.cpp.o:(mlir::mesh::detail::ShardingInterfaceInterfaceTraits::FallbackModel<(anonymous namespace)::EmptyOpShardingInterface>::getShardingOption(mlir::mesh::detail::ShardingInterfaceInterfaceTraits::Concept const*, mlir::Operation*, llvm::ArrayRef<mlir::mesh::MeshSharding>, llvm::ArrayRef<mlir::mesh::MeshSharding>))

ld.lld: error: undefined symbol: mlir::mesh::detail::defaultGetShardingAnnotations(mlir::Operation*, mlir::mesh::ShardingOption const&)
>>> referenced by ShardingInterfaceImpl.cpp
>>>               tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ShardingInterfaceImpl.cpp.o:(mlir::mesh::detail::ShardingInterfaceInterfaceTraits::FallbackModel<(anonymous namespace)::EmptyOpShardingInterface>::getShardingAnnotations(mlir::mesh::detail::ShardingInterfaceInterfaceTraits::Concept const*, mlir::Operation*, mlir::mesh::ShardingOption const&))

ld.lld: error: undefined symbol: mlir::mesh::detail::defaultAddShardingAnnotations(mlir::Operation*, mlir::OpBuilder&, mlir::mesh::ShardingOption const&)
>>> referenced by ShardingInterfaceImpl.cpp
>>>               tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ShardingInterfaceImpl.cpp.o:(mlir::mesh::detail::ShardingInterfaceInterfaceTraits::FallbackModel<(anonymous namespace)::EmptyOpShardingInterface>::addShardingAnnotations(mlir::mesh::detail::ShardingInterfaceInterfaceTraits::Concept const*, mlir::Operation*, mlir::OpBuilder&, mlir::mesh::ShardingOption const&))

ld.lld: error: undefined symbol: mlir::mesh::shardType(mlir::Type, mlir::mesh::MeshOp, mlir::mesh::MeshSharding)
>>> referenced by ShardingInterfaceImpl.cpp
>>>               tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ShardingInterfaceImpl.cpp.o:(mlir::mesh::detail::ShardingInterfaceInterfaceTraits::FallbackModel<(anonymous namespace)::EmptyOpShardingInterface>::spmdize(mlir::mesh::detail::ShardingInterfaceInterfaceTraits::Concept const*, mlir::Operation*, llvm::ArrayRef<mlir::Value>, llvm::ArrayRef<mlir::mesh::MeshSharding>, llvm::ArrayRef<mlir::mesh::MeshSharding>, mlir::IRMapping&, mlir::SymbolTableCollection&, mlir::OpBuilder&))

ld.lld: error: undefined symbol: mlir::mesh::ShardShapeOp::getODSResultIndexAndLength(unsigned int)
>>> referenced by ShardingInterfaceImpl.cpp
>>>               tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ShardingInterfaceImpl.cpp.o:(mlir::mesh::detail::ShardingInterfaceInterfaceTraits::FallbackModel<(anonymous namespace)::EmptyOpShardingInterface>::spmdize(mlir::mesh::detail::ShardingInterfaceInterfaceTraits::Concept const*, mlir::Operation*, llvm::ArrayRef<mlir::Value>, llvm::ArrayRef<mlir::mesh::MeshSharding>, llvm::ArrayRef<mlir::mesh::MeshSharding>, mlir::IRMapping&, mlir::SymbolTableCollection&, mlir::OpBuilder&))

ld.lld: error: undefined symbol: mlir::detail::TypeIDResolver<mlir::mesh::ShardingOp, void>::id
>>> referenced by ShardingInterfaceImpl.cpp
>>>               tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ShardingInterfaceImpl.cpp.o:(mlir::mesh::ShardingOp mlir::OpBuilder::create<mlir::mesh::ShardingOp, mlir::mesh::MeshSharding const&>(mlir::Location, mlir::mesh::MeshSharding const&))
>>> referenced by ShardingInterfaceImpl.cpp
>>>               tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ShardingInterfaceImpl.cpp.o:(llvm::DefaultDoCastIfPossible<mlir::mesh::ShardingOp, mlir::Operation*, llvm::CastInfo<mlir::mesh::ShardingOp, mlir::Operation*, void> >::doCastIfPossible(mlir::Operation*))

ld.lld: error: undefined symbol: mlir::mesh::ShardingOp::build(mlir::OpBuilder&, mlir::OperationState&, mlir::mesh::MeshSharding)
>>> referenced by ShardingInterfaceImpl.cpp
>>>               tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ShardingInterfaceImpl.cpp.o:(mlir::mesh::ShardingOp mlir::OpBuilder::create<mlir::mesh::ShardingOp, mlir::mesh::MeshSharding const&>(mlir::Location, mlir::mesh::MeshSharding const&))

ld.lld: error: undefined symbol: mlir::detail::TypeIDResolver<mlir::mesh::ProcessLinearIndexOp, void>::id
>>> referenced by ShardingInterfaceImpl.cpp
>>>               tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ShardingInterfaceImpl.cpp.o:(mlir::mesh::ProcessLinearIndexOp mlir::OpBuilder::create<mlir::mesh::ProcessLinearIndexOp, llvm::StringRef>(mlir::Location, llvm::StringRef&&))
>>> referenced by ShardingInterfaceImpl.cpp
>>>               tools/mlir/lib/Dialect/Tensor/IR/CMakeFiles/obj.MLIRTensorDialect.dir/ShardingInterfaceImpl.cpp.o:(llvm::DefaultDoCastIfPossible<mlir::mesh::ProcessLinearIndexOp, mlir::Operation*, llvm::CastInfo<mlir::mesh::ProcessLinearIndexOp, mlir::Operation*, void> >::doCastIfPossible(mlir::Operation*))

ld.lld: error: undefined symbol: mlir::mesh::ProcessLinearIndexOp::build(mlir::OpBuilder&, mlir::OperationState&, llvm::StringRef)

```

https://github.com/llvm/llvm-project/pull/98145

More information about the Mlir-commits mailing list