Skip to content
Snippets Groups Projects
Verified Commit 1595d62d authored by Jannis Klinkenberg's avatar Jannis Klinkenberg
Browse files

word fix

parent f96a9512
No related branches found
No related tags found
No related merge requests found
...@@ -9,7 +9,7 @@ A TensorFlow native version that is constraint to a single compute node with mul ...@@ -9,7 +9,7 @@ A TensorFlow native version that is constraint to a single compute node with mul
A TensorFlow native version that utilizes multiple processes (1 process per GPU) that work together using a `tf.distribute.MultiWorkerMirroredStrategy`. Although this is not constraint to a single node, it requires a bit more preparation to setup the distributed environment (via `TF_CONFIG` environment variable) A TensorFlow native version that utilizes multiple processes (1 process per GPU) that work together using a `tf.distribute.MultiWorkerMirroredStrategy`. Although this is not constraint to a single node, it requires a bit more preparation to setup the distributed environment (via `TF_CONFIG` environment variable)
## Version 3: (`submit_job_container_horovod.sh`) ## Version 3: (`submit_job_container_horovod.sh`)
A version that is using Horovod ontop of TensorFlow to perform the distributed training and communication of e.g. model weights/updates. Typically, these calls also use 1 process per GPU. A version that is using Horovod ontop of TensorFlow to perform the distributed training and communication of e.g. model weights/updates. Typically, these cases also use 1 process per GPU.
More information and examples concerning Horovod can be found under: More information and examples concerning Horovod can be found under:
- https://horovod.readthedocs.io/en/stable/tensorflow.html - https://horovod.readthedocs.io/en/stable/tensorflow.html
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment