Skip to content

Commit 036615f

Browse files
authored
Merge pull request #253 from gridai/dev
Add Missing Artifact Documentation
2 parents 17c8637 + 50eb424 commit 036615f

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

docs/features/runs/2_Analyzing Runs/3_artifacts.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,24 @@ Artifacts are the output produced by the training process.
1010

1111
Anytime your script saves artifacts, Grid captures those for you. It does not matter which folder you save artifacts to... Grid will automatically detect them.
1212

13+
Grid uploads your artifacts to long-term storage while your experiment is running *and* at the end of your experiment. This is to ensure that even if your experiment crashes, your artifacts will be saved.
14+
15+
:::note
16+
This may have two side effects, depending on how large and how many artifacts your code generates:
17+
18+
1. Extra Memory Usage
19+
20+
Grid may need to use extra memory while your experiment is running to sync your artifacts to long term storage.
21+
- Grid will only use extra memory to sync artifacts larger than 1 Gib
22+
- Grid will use 50 Mi of extra memory to sync artifacts larger than 1 Gib
23+
- Grid will not use more than 200 Mi of extra memory
24+
- If you are running memory intensive experiments *and* are generating artifacts over 1 Gib, it is recommended to use a larger instance type
25+
26+
2. Increased run time
27+
28+
Your experiment will not be marked `done` until Grid has finished syncing your artifacts to long-term storage. If you are generating lots of artifacts per experiment, this may increase your experiment run times.
29+
:::
30+
1331
Try [hello.py](https://github.com/williamFalcon/hello/blob/main/hello.py) as an example, to see how artifacts are generated and saved.
1432

1533
![](/images/runs/runs-artifacts.png)

0 commit comments

Comments
 (0)