Tensorflow can allow distributed training strategies, such as multi-GPU on a single machine, or across multiple machines.
Furthermore, you can utilise Google TPUs if training on the cloud.
Information is here https://www.tensorflow.org/alpha/guide/distribute_strategy
Note not all strategies are currently supported in 2.0
Tensorflow can allow distributed training strategies, such as multi-GPU on a single machine, or across multiple machines.
Furthermore, you can utilise Google TPUs if training on the cloud.
Information is here https://www.tensorflow.org/alpha/guide/distribute_strategy
Note not all strategies are currently supported in 2.0