Any pluto-on-binder with packages gets disconnected.

[microstijn]

I have previously used Pluto in combination with binder, which worked fine.

I tried to use binder today and every notebook with a using statement fails to precompile, and gets put into Reconnecting (disconnected), even featured notebooks like such as https://featured.plutojl.org/basic/images

In addition, I get the warnings:

===
┌ Warning: Pkg operation failed. Updating registries and trying again...
└ @ GracefulPkg /srv/julia/pkg/packages/GracefulPkg/LmTcK/src/apply strategies.jl:92

Resolving...
===
┌ Warning: Pkg operation failed. Removing Manifest.toml file and trying again...
└ @ GracefulPkg /srv/julia/pkg/packages/GracefulPkg/LmTcK/src/apply strategies.jl:92

Resolving...
===
   Installed Crayons ──────────────── v4.1.1
            Installed           PtrArrays ────────────── v1.3.0                
            Installed           IrrationalConstants ──── v0.2.4                
            Installed           Hyperscript ──────────── v0.0.5                
            Installed           IOCapture ────────────── v0.2.5                
            Installed           TensorCore ───────────── v0.1.1                
            Installed           ColorTypes ───────────── v0.12.1               
            Installed           StaticArraysCore ─────── v1.4.3                
            Installed           NaNMath ──────────────── v1.1.3                
            Installed           FixedPointNumbers ────── v0.8.5                
            Installed           ColorVectorSpace ─────── v0.11.0                
            Installed           MarchingCubes ────────── v0.1.11                
            Installed           Contour ──────────────── v0.6.3                 
            Installed           StaticArrays ─────────── v1.9.14                
            Installed           Reexport ─────────────── v1.2.2                 
            Installed           Requires ─────────────── v1.3.1                 
            Installed           LogExpFunctions ──────── v0.3.29                
            Installed           PlutoUI ──────────────── v0.7.71                
            Installed           DataStructures ───────── v0.19.0                
            Installed           Colors ───────────────── v0.13.1                
            Installed           AbstractPlutoDingetjes ─ v1.3.2                 
            Installed           StatsAPI ─────────────── v1.7.1                 
            Installed           Missings ─────────────── v1.2.0                 
            Installed           AliasTables ──────────── v1.1.3                 
            Installed           StatsBase ────────────── v0.34.6                
            Installed           SortingAlgorithms ────── v1.2.2                 
            Installed           UnicodePlots ─────────── v3.8.1                 
            Installed           DocStringExtensions ──── v0.9.5                 
            Installed           ColorSchemes ─────────── v3.30.0                
             Updating           `/tmp/jl_TjAbqJ/Project.toml`                   
  [7f904dfe] + PlutoUI v0.7.71
  [b8865327] + UnicodePlots v3.8.1
    Updating `/tmp/jl_TjAbqJ/Manifest.toml`
  [6e696c72] + AbstractPlutoDingetjes v1.3.2
 **... SNIP ...**
  [8e850ede] + nghttp2_jll v1.52.0+1
  [3f19e933] + p7zip_jll v17.4.0+2
        Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m`

Instantiating...
===

Precompiling...
===
  Activating project at `/tmp/jl_TjAbqJ`
Precompiling packages...

This is point where every notebooks disconnects from the binder service.

[fonsp]

Hi Stijn!

That sucks :( I suspect it's happening because the binder worker runs out of memory, because the Pkg precompilation suddenly starts a number of Julia processes to precompile.

You see this if you launch the same binder, without Pluto:

https://mybinder.org/v2/gh/fonsp/pluto-on-binder/HEAD

If I start a Julia jupyter notebook, and run import Pkg; Pkg.add("Images"), it also crashes:

Details

I think this is caused by Julia becoming more demanding. And perhaps the memory limit in binder was decreased.

We could experiment with:

• Changing the number of parallel Pkg precompilation processes
• Different Julia flags to make precompilation less intensive (we currently use this)

[microstijn]

Hi Fons!

Changing the number of parallel Pkg precompilation processes should not be too difficult. I will see if can cook up a quick edit later this week.

Stijn

[fonsp]

Nice! You could first try it in a binder jupyter session, just change the ENV variable and then run Pkg.add("Images")