Boosting Performance and Utilization with Multi-Instance GPU
Multi-Instance GPU (MIG) on the NVIDIA A100 Tensor Core GPU can guarantee performance for up to seven jobs running concurrently on the same GPU—and each GPU instance is fully isolated with its own compute, memory, and bandwidth. This unique capability of the A100 GPU offers the right-sized GPU for every job and maximizes data center utilization. This demo shows inference performance on a single slice of MIG and then scales linearly across the entire A100.
Watch video Boosting Performance and Utilization with Multi-Instance GPU online without registration, duration hours minute second in high quality. This video was added by user NVIDIA Developer 22 June 2020, don't forget to share it with your friends and acquaintances, it has been viewed on our site 2,420 once and liked it 72 people.