A1111 Notebook for Sagemaker Studio Lab?

[i-huzaifa-arshad]

Since google banned SD on free tier colab, I was exploring for the alternatives. I found Sagemaker Studio Lab as a perfect alternative. It gives 4 hour Free GPU every 24 hours, and 8 hours CPU. YES it is possible to run SD on sagemaker studio lab. I am running InvokeAI on sagemaker studio lab. I tried converting A1111 notebook by @TheLastBen by just changing the paths but gave up at the end coz getting errors and also I am not pro. For me I was having these issues:

• LORAs were not installing properly so I deleted the code
• Didn't install the Control Net due to storage (25G total storage provided by Sagemaker Studio Lab)
• I tried modifying code to work only with ngrok but couldn't start the gui due to errors
• I gave up

The modified code to start stable diffusion gui:

from IPython.utils import capture
import time
import sys
import fileinput
from pyngrok import ngrok, conf
import re

Ngrok_token = "" # Enter your Ngrok token here

with capture.capture_output() as cap:
  %cd /home/studio-lab-user/sd/stable-diffusion-webui/modules/
  !wget -q -O extras.py https://raw.githubusercontent.com/AUTOMATIC1111/stable-diffusion-webui/master/modules/extras.py
  !wget -q -O sd_models.py https://raw.githubusercontent.com/AUTOMATIC1111/stable-diffusion-webui/master/modules/sd_models.py
  !wget -q -O /usr/local/lib/python3.10/dist-packages/gradio/blocks.py https://raw.githubusercontent.com/TheLastBen/fast-stable-diffusion/main/AUTOMATIC1111_files/blocks.py
  %cd /home/studio-lab-user/sd/stable-diffusion-webui/

  !sed -i 's@shared.opts.data\["sd_model_checkpoint"] = checkpoint_info.title@shared.opts.data\["sd_model_checkpoint"] = checkpoint_info.title;model.half()@' /home/studio-lab-user/sd/stable-diffusion-webui/modules/sd_models.py
  !sed -i 's@ui.create_ui().*@ui.create_ui();shared.demo.queue(concurrency_count=999999,status_update_rate=0.1)@' /home/studio-lab-user/sd/stable-diffusion-webui/webui.py
  !sed -i "s@map_location='cpu'@map_location='cuda'@" /home/studio-lab-user/sd/stable-diffusion-webui/modules/extras.py

  !sed -i 's@possible_sd_paths =.*@possible_sd_paths = [\"/home/studio-lab-user/sd/stablediffusion\"]@' /home/studio-lab-user/sd/stable-diffusion-webui/modules/paths.py
  !sed -i 's@\.\.\/@src/@g' /home/studio-lab-user/sd/stable-diffusion-webui/modules/paths.py
  !sed -i 's@src/generative-models@generative-models@g' /home/studio-lab-user/sd/stable-diffusion-webui/modules/paths.py

  !sed -i 's@print(\"No module.*@@' /home/studio-lab-user/sd/stablediffusion/ldm/modules/diffusionmodules/model.py
  !sed -i 's@\["sd_model_checkpoint"\]@\["sd_model_checkpoint", "sd_vae", "CLIP_stop_at_last_layers", "inpainting_mask_weight", "initial_noise_multiplier"\]@g' /home/studio-lab-user/sd/stable-diffusion-webui/modules/shared.py

share=''
if Ngrok_token!="":
  ngrok.kill()
  srv=ngrok.connect(7860, pyngrok_config=conf.PyngrokConfig(auth_token=Ngrok_token) , bind_tls=True).public_url

  for line in fileinput.input('/usr/local/lib/python3.10/dist-packages/gradio/blocks.py', inplace=True):
    if line.strip().startswith('self.server_name ='):
        line = f'            self.server_name = "{srv[8:]}"\n'
    if line.strip().startswith('self.protocol = "https"'):
        line = '            self.protocol = "https"\n'
    if line.strip().startswith('if self.local_url.startswith("https") or self.is_colab'):
        line = ''
    if line.strip().startswith('else "http"'):
        line = ''
    sys.stdout.write(line)

else:
  share='--share'

ckptdir=''
if os.path.exists('/home/studio-lab-user/temp_models'):
  ckptdir='--ckpt-dir /home/studio-lab-user/temp_models'

try:
  model
  if os.path.isfile(model):
    !python /home/studio-lab-user/sd/stable-diffusion-webui/webui.py $share --api --disable-safe-unpickle --enable-insecure-extension-access --no-download-sd-model --no-half-vae  --ckpt "$model" --xformers $auth --disable-console-progressbars --upcast-sampling $ckptdir
  else:
    !python /home/studio-lab-user/sd/stable-diffusion-webui/webui.py $share --api --disable-safe-unpickle --enable-insecure-extension-access --no-download-sd-model --no-half-vae  --ckpt-dir "$model" --xformers $auth --disable-console-progressbars --upcast-sampling
except:
   !python /home/studio-lab-user/sd/stable-diffusion-webui/webui.py $share --api --disable-safe-unpickle --enable-insecure-extension-access --no-download-sd-model --no-half-vae --xformers $auth --disable-console-progressbars --upcast-sampling $ckptdir

The Error:

Traceback (most recent call last):
  File "/home/studio-lab-user/sd/stable-diffusion-webui/webui.py", line 13, in <module>
    initialize.imports()
  File "/home/studio-lab-user/sd/stable-diffusion-webui/modules/initialize.py", line 24, in imports
    from modules import paths, timer, import_hook, errors  # noqa: F401
  File "/home/studio-lab-user/sd/stable-diffusion-webui/modules/paths.py", line 34, in <module>
    assert sd_path is not None, f"Couldn't find Stable Diffusion in any of: {possible_sd_paths}"
AssertionError: Couldn't find Stable Diffusion in any of: ['/home/studio-lab-user/sd/stablediffusion']

I don't know what went wrong, the rest code is same, just with modified paths to work with sagemaker studio lab, and got the error with this code.

@TheLastBen Sir it would be nice if you can look into it. Thanks.