Skip to content

Using nix-portable for nix on HPCs? #153

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jackerschott opened this issue May 1, 2025 · 0 comments
Open

Using nix-portable for nix on HPCs? #153

jackerschott opened this issue May 1, 2025 · 0 comments

Comments

@jackerschott
Copy link

I want to use nix-portable on an HPC with a distributed filesystem, where I want to build nix-expression, i.e. write to the nix store, on the login node and later execute binaries from the nix store on the compute nodes. Doing this directly is basically impossible due to filesystem latency (writing a bunch of small files to the nix store is exactly what a distributed filesystem doesn't like), so the best idea I currently have is to keep the .nix-portable directory as a squashfs file on the distributed filesystem and unpack it to some local storage whenever I need to read/write to it. There might be a better solution here that I am not aware of? Otherwise this sounds like something that might be worthwhile to add to nix portable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant