Interested in using TensorFlow with MPI on ACCESS HPC systems

Q&A
1

Could you provide any tips or resources to get started?

2

To use TensorFlow with MPI on ACCESS HPC systems, you’ll need to build TensorFlow from source including MPI support. Detailed instructions can be found in TensorFlow’s official installation guide. Additionally, the HPC-AI Advisory Council has a specific tutorial on integrating TensorFlow with MPI. Remember, when running your TensorFlow scripts, use the ‘mpirun’ command to leverage MPI.

https://www.researchgate.net/publication/301842011_Distributed_TensorFlow_with_MPI