Skip to content
Open
Show file tree
Hide file tree
Changes from 75 commits
Commits
Show all changes
92 commits
Select commit Hold shift + click to select a range
4cc930c
simualte different embeddings
edyoshikun Jul 9, 2025
905247c
update the msd calculation to re-use cdist functions in the repo
edyoshikun Jul 10, 2025
c39d1d6
adding a test for the msd
edyoshikun Jul 10, 2025
cf97df4
removing unused msd functions
edyoshikun Jul 14, 2025
4c1a492
renaming msd to compute_track_displacement
edyoshikun Jul 15, 2025
8638168
default to cosine distance
edyoshikun Jul 15, 2025
c40b64c
adding the gradient attribution video.
edyoshikun Jul 16, 2025
b51c1b8
extend to training ratios
edyoshikun Jul 16, 2025
4eabce3
demo beta_vae 2.5D
edyoshikun Jul 21, 2025
c976f98
improving the logging for readability and drop pythae baseclasses
edyoshikun Jul 21, 2025
29a822e
condense the logging to have less tabs.
edyoshikun Jul 21, 2025
86b3467
fix disentagle metrics
edyoshikun Jul 21, 2025
2bb6d19
fixing beta warmup bug
edyoshikun Jul 22, 2025
8e8eba8
renaming to loss
edyoshikun Jul 22, 2025
116183d
updating architecture to flatten vs spatial VAE with convs
edyoshikun Jul 23, 2025
e47de7c
chaning to use mse with mean reduction and normalizing the kl loss by…
edyoshikun Jul 25, 2025
cfdc51a
optunea proof of concept
edyoshikun Jul 25, 2025
bcc1406
add normalized sampled into the transforms so we can use it with MONA…
edyoshikun Jul 26, 2025
53a3e2d
update loss debugging code
edyoshikun Jul 26, 2025
a3510d0
adding sync for disentaglement metrics
edyoshikun Jul 27, 2025
252a4d0
adding the dataloader for rpe1 dataset and plotting utils
edyoshikun Jul 31, 2025
385322b
cleanup the vae and add the monai to lightning. adding configs
edyoshikun Aug 2, 2025
e0bf813
add saving hyperparameters
edyoshikun Aug 3, 2025
a1ad2dc
fix hyperparameter logging
edyoshikun Aug 4, 2025
17c1e89
add embedding logging to the CLIP version
edyoshikun Aug 4, 2025
4269787
test and plot of monaivae
edyoshikun Aug 6, 2025
ed7f5a7
handle monai_vae 2d
edyoshikun Aug 13, 2025
5e27e7c
redifining rotation agumentsations
edyoshikun Aug 13, 2025
f122040
adding optional scaling to phate
edyoshikun Aug 13, 2025
5a5f4a9
adding alias and output 2d
edyoshikun Aug 14, 2025
5597aec
normalizing by also the latent dim and swapping to FP32 for forward p…
edyoshikun Aug 15, 2025
c782928
update test for magnitudes
edyoshikun Aug 20, 2025
6fce186
expose the normalization for vae
edyoshikun Aug 20, 2025
dd3da5d
add sam 2 test
edyoshikun Aug 25, 2025
8ae92f7
refactor smoothness metrics
edyoshikun Aug 26, 2025
9d36a6f
rever to normalalize kl wrt to batch size and removing the the beta …
edyoshikun Aug 31, 2025
d5bac4a
commit dtwembeddings w sam
edyoshikun Sep 3, 2025
1b1f9b7
added a clamp to logvar, switch to mse loss sum reduction like the or…
edyoshikun Sep 5, 2025
b012bad
remove unecessary vae logging losses.
edyoshikun Sep 5, 2025
9f4be8d
add a way to handle when using 'mean' reduction for proper scaling
edyoshikun Sep 8, 2025
e97dad1
adding optional config for middle slice index for computing sam2 embe…
edyoshikun Sep 8, 2025
3ec6744
converting latent stats active_dimensions parameter to float to remov…
edyoshikun Sep 8, 2025
6f0edc5
Merge branch 'main' into beta_vae
edyoshikun Sep 8, 2025
fb0ecc4
ruff
edyoshikun Sep 9, 2025
7f295cc
removing the optuna config
edyoshikun Sep 9, 2025
d2f3659
numpy docstring
edyoshikun Sep 9, 2025
a36318a
fix compute smoothness script
edyoshikun Sep 9, 2025
173f297
archiving old scripts
edyoshikun Sep 9, 2025
f12bc33
re org the pc features scripts
edyoshikun Sep 9, 2025
f04bfa7
embeddings for phase
edyoshikun Sep 9, 2025
13fbd57
add smoothness (mean rand vs adj frame) to the csv
edyoshikun Sep 9, 2025
395ddc5
archiving old beta vae code
edyoshikun Sep 9, 2025
7c22906
Merge branch 'main' into beta_vae
edyoshikun Sep 11, 2025
a73e7b6
ruff
edyoshikun Sep 16, 2025
7fbf6c8
fix format
ziw-liu Sep 16, 2025
a6c2c69
fix typo
ziw-liu Sep 17, 2025
9ed78b4
remove the archived unecessary files
edyoshikun Sep 17, 2025
6bf7a4a
remove the test run archived file
edyoshikun Sep 17, 2025
8de14e4
adding normalizeintensity
edyoshikun Sep 17, 2025
f5412d5
fixing the vae_logging typing and removing PC plotting from here
edyoshikun Sep 17, 2025
2892af0
fixing the compute_embedding_smoothness docstring
edyoshikun Sep 17, 2025
dc78397
simplify the distance metrics and removing deprecated functions and s…
edyoshikun Sep 17, 2025
9a1af70
remove deprecated functions from clustering.py
edyoshikun Sep 17, 2025
6daf62e
add timelpase to grad_attr.py script
edyoshikun Sep 17, 2025
221cbeb
refactoring the betavaemodule. removing the hyperparamter logging, ad…
edyoshikun Sep 17, 2025
7a92548
remove the optuna dependency
edyoshikun Sep 17, 2025
06c7ea2
deleting old msd test
edyoshikun Sep 17, 2025
66c0100
ruff format
edyoshikun Sep 17, 2025
3dae71e
fix to explicitly stratify on fov level
edyoshikun Sep 17, 2025
57e7811
adding reference to dataset for rpe1
edyoshikun Sep 17, 2025
4ca2926
fix pyproject.toml dev
edyoshikun Sep 17, 2025
116c560
Merge branch 'main' into beta_vae
ziw-liu Sep 17, 2025
6bd786f
format and lint
ziw-liu Sep 17, 2025
4bb7b92
restore no-augmentation flag effect
ziw-liu Sep 17, 2025
b5d71fd
format tests
ziw-liu Sep 17, 2025
f3108f0
rename the sam2 file
edyoshikun Sep 18, 2025
01ed038
removing unused arguments for logging embeddings.
edyoshikun Sep 18, 2025
c73ffff
removing duplication in the lca
edyoshikun Sep 19, 2025
7aa6d8d
remove disentaglement metrics
edyoshikun Sep 22, 2025
d1b255b
vectorized the anchor filtering for celldivisiontriplet dataset
edyoshikun Sep 22, 2025
9e939af
map the channels to the rpe dataset convention
edyoshikun Sep 22, 2025
6307ef8
fix logistic regresion standardization
edyoshikun Sep 22, 2025
0fe0ef8
update rpe classifier to include mitosis
edyoshikun Sep 22, 2025
cbadef3
ruff
edyoshikun Sep 22, 2025
cce2c46
Merge branch 'main' into beta_vae
edyoshikun Sep 22, 2025
46ff7a2
remove unused logging
edyoshikun Sep 22, 2025
4536d3c
datamodule agnostic
edyoshikun Sep 23, 2025
9f00cfd
cleaning up duplicated code in the benchmarking
edyoshikun Sep 23, 2025
842d78a
Merge branch 'main' into beta_vae
edyoshikun Oct 22, 2025
7807d9a
cleanup vae
edyoshikun Oct 22, 2025
f06e0a3
keeping it consistent and using residual units
edyoshikun Oct 22, 2025
35c9f75
fix typings betavaemonai
edyoshikun Oct 23, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
datamodule:
batch_size: 32
final_yx_patch_size:
- 256
- 256
include_fov_names: null
include_track_ids: null
initial_yx_patch_size:
- 256
- 256
normalizations:
- class_path: viscy.transforms.ScaleIntensityRangePercentilesd
init_args:
b_max: 1.0
b_min: 0.0
keys:
- RFP
lower: 50
upper: 99
- class_path: viscy.transforms.NormalizeIntensityd
init_args:
keys:
- Phase3D
num_workers: 10
source_channel:
- RFP
- Phase3D
z_range:
- 15
- 45

embedding:
pca_kwargs:
n_components: 8
phate_kwargs:
decay: 40
knn: 5
n_components: 2
n_jobs: -1
random_state: 42
reductions:
- PHATE
- PCA

execution:
overwrite: false
save_config: true
show_config: true

model:
model_name: facebook/dinov3-convnext-tiny-pretrain-lvd1689m
pooling_method: mean # Options: "mean", "max", "cls_token"
middle_slice_index: 18 # Specific z-slice index (if null, uses D//2)
channel_reduction_methods:
Phase3D: middle_slice
RFP: max
channel_names:
- RFP
- Phase3D

paths:
data_path: /hpc/projects/intracellular_dashboard/organelle_dynamics/2024_02_04_A549_DENV_ZIKV_timelapse/8-train-test-split/registered_test.zarr
output_path: /hpc/mydata/eduardo.hirata/repos/viscy/applications/benchmarking/DynaCLR/DINOV3/embeddings_convnext_tiny_mean.zarr
tracks_path: /hpc/projects/intracellular_dashboard/organelle_dynamics/2024_02_04_A549_DENV_ZIKV_timelapse/8-train-test-split/track_test.zarr
Loading
Loading