Issue building lapis with recipe B

[bartgol]

I am trying to build LAPIS using the recipe B (as I need torch-mlir). My cmake config script follows what's posted in the README, but I get the error

CMake Error at cmake/modules/TableGen.cmake:21 (message):
  MLIR_TABLEGEN_EXE not set
Call Stack (most recent call first):
  /home/lbertag/workdir/libs/lapis/mpact-compiler/externals/torch-mlir/externals/llvm-project/mlir/cmake/modules/AddMLIR.cmake:5 (tablegen)
  /home/lbertag/workdir/libs/lapis/mpact-compiler/externals/torch-mlir/include/torch-mlir/Conversion/TorchOnnxToTorch/CMakeLists.txt:2 (mlir_tablegen)

I grepped for MLIR_TABLEGEN_EXE, and found that it is set in externals/torch-mlir/externals/llvm-project/flang/CMakeLists.txt by find_program via

  find_program(MLIR_TABLEGEN_EXE "mlir-tblgen" ${LLVM_TOOLS_BINARY_DIR}
    NO_DEFAULT_PATH)

Am I supposed to build LLVM's tools before running the cmake config script? If so, how? Or am I supposed to install some pip package for mlir tools?

[bartgol]

I tried to add

  -D LLVM_ENABLE_PROJECTS:STRING=mlir \

to the cmake config line, and that seems to have fixed the configuration step. Not sure if this is the right thing to do though... I'm building now, so I guess I'll find out...

[brian-kelley]

@bartgol Yep, that line is correct and required for both recipes. Is that the only line that was missing/is there something we should add here? https://github.com/sandialabs/LAPIS/tree/main?tab=readme-ov-file#recipe-b-build-lapis-in-tree-with-llvmmlir-and-optionally-torch-mlirmpact

[bartgol]

Yeah, that was the only line I added. After that, I managed to install everything. One thing though: I could not run pip install -r requirements.txt in LAPIS source folder, as it was complaining it could not find torchvision=0.20.0 with torch=2.5.0. I forgot what I did, but I think I manually installed torch from the https link, and later pip installed that torchvision version (or viceversa?). I can try to reproduce again in a vanilla conda env, if you want.

[brian-kelley]

@bartgol I just tried the pip install -r requirements.txt inside a fresh virtualenv, before and after a "pip cache purge" and it worked OK. I'll message you offline about a detail specific to using pip/conda within the SRN.