An Online Demo

[Egrt]

We have built an online demo demo based on your work at Click here

[jtwhu3s]

hello, have you save the docker environment and would you please release it for me? I am facing lots of troubles when configuring the environment. many thanks!

[Egrt]

I did not use docker to configure the environment, but configured it manually under win11. Which dependency did you have problems installing?

[jtwhu3s]

actually I don't know the reason, the errors are as follows, and I can't solve it:
so I want to get an environment that can successfully excute this code.Did you use conda environment?

Training on fold(s): ['train']
INFO: Loading defaults from configs/config.defaults.mapping_dataset.json
        INFO: Loading defaults from configs/config.defaults.json
                        INFO: Loading defaults from configs/loss_params.json
                        INFO: Loading defaults from configs/optim_params.json
                        INFO: Loading defaults from configs/polygonize_params.json
                INFO: Loading defaults from configs/dataset_params.mapping_dataset.json
                INFO: Loading defaults from configs/eval_params.mapping_dataset.json
                        INFO: Loading defaults from configs/eval_params.defaults.json
        INFO: Loading defaults from configs/backbone_params.unet_resnet101.json
GPU 0 -> Ready. There are 1 GPU(s) available on this node.
GPU 0 -> Using data from /data/mapping_challenge_dataset
# --- Start training --- #
Train dataset has 210556 samples.
Model has 76686222 trainable params
Init loss norms:   0%|                                                                                                      | 0/501 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "main.py", line 403, in <module>
    torch.multiprocessing.spawn(train_process, nprocs=args.gpus, args=(config, shared_dict, barrier))
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/multiprocessing/spawn.py", line 200, in spawn
    return start_processes(fn, args, nprocs, join, daemon, start_method='spawn')
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/multiprocessing/spawn.py", line 158, in start_processes
    while not context.join():
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/multiprocessing/spawn.py", line 119, in join
    raise Exception(msg)
Exception: 

-- Process 0 terminated with the following error:
Traceback (most recent call last):
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/multiprocessing/spawn.py", line 20, in _wrap
    fn(i, *args)
  File "/home/jt/code/Polygonization-by-Frame-Field-Learning/child_processes.py", line 50, in train_process
    train(gpu, config, shared_dict, barrier, train_ds, val_ds, backbone)
  File "/home/jt/code/Polygonization-by-Frame-Field-Learning/frame_field_learning/train.py", line 146, in train
    trainer.fit(train_dl, val_dl=val_dl, init_dl=init_dl)
  File "/home/jt/code/Polygonization-by-Frame-Field-Learning/frame_field_learning/trainer.py", line 321, in fit
    self.compute_loss_norms(init_dl, loss_norm_batches)
  File "/home/jt/code/Polygonization-by-Frame-Field-Learning/frame_field_learning/trainer.py", line 289, in compute_loss_norms
    for batch in dl:
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 279, in __iter__
    return _MultiProcessingDataLoaderIter(self)
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 719, in __init__
    w.start()
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/context.py", line 224, in _Popen
    return _default_context.get_context().Process._Popen(process_obj)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/context.py", line 283, in _Popen
    return Popen(process_obj)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 47, in _launch
    reduction.dump(process_obj, fp)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/reduction.py", line 60, in dump
    ForkingPickler(file, protocol).dump(obj)
_pickle.PicklingError: Can't pickle <class 'torch._C._VariableFunctions'>: it's not the same object as torch._C._VariableFunctions
```

[Egrt]

actually I don't know the reason, the errors are as follows, and I can't solve it: so I want to get an environment that can successfully excute this code.Did you use conda environment?

Training on fold(s): ['train']
INFO: Loading defaults from configs/config.defaults.mapping_dataset.json
        INFO: Loading defaults from configs/config.defaults.json
                        INFO: Loading defaults from configs/loss_params.json
                        INFO: Loading defaults from configs/optim_params.json
                        INFO: Loading defaults from configs/polygonize_params.json
                INFO: Loading defaults from configs/dataset_params.mapping_dataset.json
                INFO: Loading defaults from configs/eval_params.mapping_dataset.json
                        INFO: Loading defaults from configs/eval_params.defaults.json
        INFO: Loading defaults from configs/backbone_params.unet_resnet101.json
GPU 0 -> Ready. There are 1 GPU(s) available on this node.
GPU 0 -> Using data from /data/mapping_challenge_dataset
# --- Start training --- #
Train dataset has 210556 samples.
Model has 76686222 trainable params
Init loss norms:   0%|                                                                                                      | 0/501 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "main.py", line 403, in <module>
    torch.multiprocessing.spawn(train_process, nprocs=args.gpus, args=(config, shared_dict, barrier))
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/multiprocessing/spawn.py", line 200, in spawn
    return start_processes(fn, args, nprocs, join, daemon, start_method='spawn')
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/multiprocessing/spawn.py", line 158, in start_processes
    while not context.join():
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/multiprocessing/spawn.py", line 119, in join
    raise Exception(msg)
Exception: 

-- Process 0 terminated with the following error:
Traceback (most recent call last):
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/multiprocessing/spawn.py", line 20, in _wrap
    fn(i, *args)
  File "/home/jt/code/Polygonization-by-Frame-Field-Learning/child_processes.py", line 50, in train_process
    train(gpu, config, shared_dict, barrier, train_ds, val_ds, backbone)
  File "/home/jt/code/Polygonization-by-Frame-Field-Learning/frame_field_learning/train.py", line 146, in train
    trainer.fit(train_dl, val_dl=val_dl, init_dl=init_dl)
  File "/home/jt/code/Polygonization-by-Frame-Field-Learning/frame_field_learning/trainer.py", line 321, in fit
    self.compute_loss_norms(init_dl, loss_norm_batches)
  File "/home/jt/code/Polygonization-by-Frame-Field-Learning/frame_field_learning/trainer.py", line 289, in compute_loss_norms
    for batch in dl:
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 279, in __iter__
    return _MultiProcessingDataLoaderIter(self)
  File "/opt/conda/envs/frame_field/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 719, in __init__
    w.start()
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/context.py", line 224, in _Popen
    return _default_context.get_context().Process._Popen(process_obj)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/context.py", line 283, in _Popen
    return Popen(process_obj)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 47, in _launch
    reduction.dump(process_obj, fp)
  File "/opt/conda/envs/frame_field/lib/python3.8/multiprocessing/reduction.py", line 60, in dump
    ForkingPickler(file, protocol).dump(obj)
_pickle.PicklingError: Can't pickle <class 'torch._C._VariableFunctions'>: it's not the same object as torch._C._VariableFunctions

I have not encountered this problem, but I think it should be a Pickle and torch compatibility problem, try to upgrade your torch version to 1.7.1 and upgrade the corresponding torchvision version.

[jtwhu3s]

Thanks very much! I tried it but it still don't work. could please share your conda environment configuration(yml files by conda env export > xxxx.yaml)? thanks a lot!

[Egrt]

Thanks very much! I tried it but it still don't work. could please share your conda environment configuration(yml files by conda env export > xxxx.yaml)? thanks a lot!
Sorry, my environment has been changed. I redeployed the app on Huggingface with the following specific environment：
Successfully installed MarkupSafe-2.1.1 Pillow-8.2.0 PyWavelets-1.4.1 Pygments-2.13.0 affine-2.3.1 alabaster-0.7.12 anyio-3.6.2 babel-2.11.0 bcrypt-4.0.1 cffi-1.15.1 click-7.1.2 click-plugins-1.1.1 cligj-0.7.2 cryptography-38.0.3 cycler-0.11.0 cython-0.29.32 dataclasses-0.6 descartes-1.1.0 dill-0.3.4 docutils-0.19 et-xmlfile-1.1.0 fastapi-0.87.0 ffmpy-0.3.0 fiona-1.8.21 future-0.18.2 gradio-3.6 h11-0.12.0 h5py-2.10.0 httpcore-0.15.0 httpx-0.23.1 imageio-2.9.0 imagesize-1.4.1 importlib-metadata-5.0.0 jinja2-3.1.2 jsmin-3.0.1 kiwisolver-1.4.4 kornia-0.5.0 linkify-it-py-1.0.3 llvmlite-0.39.1 markdown-it-py-2.1.0 matplotlib-3.3.2 mdit-py-plugins-0.3.1 mdurl-0.1.2 multiprocess-0.70.12.2 munch-2.5.0 networkx-2.8.8 numba-0.56.4 numpy-1.23.1 numpydoc-1.5.0 opencv_python-4.5.4.60 openpyxl-3.0.10 orjson-3.8.2 overpy-0.6 paramiko-2.12.0 pycocotools-2.0.3 pycparser-2.21 pycryptodome-3.15.0 pydantic-1.10.2 pydub-0.25.1 pynacl-1.5.0 pyproj-2.5.0 python-multipart-0.0.5 rasterio-1.1.3 rfc3986-1.5.0 scikit-image-0.19.3 scipy-1.4.1 shapely-1.8.1 skan-0.10.0 sklearn-0.0.post1 sniffio-1.3.0 snowballstemmer-2.2.0 snuggs-1.4.7 sphinx-5.3.0 sphinxcontrib-applehelp-1.0.2 sphinxcontrib-devhelp-1.0.2 sphinxcontrib-htmlhelp-2.0.0 sphinxcontrib-jsmath-1.0.1 sphinxcontrib-qthelp-1.0.3 sphinxcontrib-serializinghtml-1.1.5 starlette-0.21.0 tifffile-2022.10.10 toolz-0.12.0 torch-1.7.0 torchvision-0.8.0 tqdm-4.63.0 uc-micro-py-1.0.1 uvicorn-0.20.0 websockets-10.4 zipp-3.4.0
Hope this helps.

In particular, the version of multiprocess is 0.70.12.2

[jtwhu3s]

Thank a lot! I can run this code successfully using your environment condifuration.

[Egrt]

Thank a lot! I can run this code successfully using your environment condifuration.

Congratulations! You are a student of Wuhan University?

[jtwhu3s]

Thank a lot! I can run this code successfully using your environment condifuration.

Congratulations! You are a student of Wuhan University?

yes! My major is remote sensing, are you also in wuhan university?

[Egrt]

Thank a lot! I can run this code successfully using your environment condifuration.

Congratulations! You are a student of Wuhan University?

yes! My major is remote sensing, are you also in wuhan university?

朋友是你们学院的研究生，帮她做的。

[codFish3]

Thanks very much! I tried it but it still don't work. could please share your conda environment configuration(yml files by conda env export > xxxx.yaml)? thanks a lot!
Sorry, my environment has been changed. I redeployed the app on Huggingface with the following specific environment：
Successfully installed MarkupSafe-2.1.1 Pillow-8.2.0 PyWavelets-1.4.1 Pygments-2.13.0 affine-2.3.1 alabaster-0.7.12 anyio-3.6.2 babel-2.11.0 bcrypt-4.0.1 cffi-1.15.1 click-7.1.2 click-plugins-1.1.1 cligj-0.7.2 cryptography-38.0.3 cycler-0.11.0 cython-0.29.32 dataclasses-0.6 descartes-1.1.0 dill-0.3.4 docutils-0.19 et-xmlfile-1.1.0 fastapi-0.87.0 ffmpy-0.3.0 fiona-1.8.21 future-0.18.2 gradio-3.6 h11-0.12.0 h5py-2.10.0 httpcore-0.15.0 httpx-0.23.1 imageio-2.9.0 imagesize-1.4.1 importlib-metadata-5.0.0 jinja2-3.1.2 jsmin-3.0.1 kiwisolver-1.4.4 kornia-0.5.0 linkify-it-py-1.0.3 llvmlite-0.39.1 markdown-it-py-2.1.0 matplotlib-3.3.2 mdit-py-plugins-0.3.1 mdurl-0.1.2 multiprocess-0.70.12.2 munch-2.5.0 networkx-2.8.8 numba-0.56.4 numpy-1.23.1 numpydoc-1.5.0 opencv_python-4.5.4.60 openpyxl-3.0.10 orjson-3.8.2 overpy-0.6 paramiko-2.12.0 pycocotools-2.0.3 pycparser-2.21 pycryptodome-3.15.0 pydantic-1.10.2 pydub-0.25.1 pynacl-1.5.0 pyproj-2.5.0 python-multipart-0.0.5 rasterio-1.1.3 rfc3986-1.5.0 scikit-image-0.19.3 scipy-1.4.1 shapely-1.8.1 skan-0.10.0 sklearn-0.0.post1 sniffio-1.3.0 snowballstemmer-2.2.0 snuggs-1.4.7 sphinx-5.3.0 sphinxcontrib-applehelp-1.0.2 sphinxcontrib-devhelp-1.0.2 sphinxcontrib-htmlhelp-2.0.0 sphinxcontrib-jsmath-1.0.1 sphinxcontrib-qthelp-1.0.3 sphinxcontrib-serializinghtml-1.1.5 starlette-0.21.0 tifffile-2022.10.10 toolz-0.12.0 torch-1.7.0 torchvision-0.8.0 tqdm-4.63.0 uc-micro-py-1.0.1 uvicorn-0.20.0 websockets-10.4 zipp-3.4.0
Hope this helps.

In particular, the version of multiprocess is 0.70.12.2

Hi I've also encountered the environment issue, I've checked your Hugging Face commmunity project but only found requirements.txt. May I ask where can I get your complete environment.yml file?