SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints
Today, Amazon SageMaker Inference supports GPU partitioning, which uses [NVIDIA Multi-Instance GPU](https://docs.nvidia.com/datacenter/tesla/mig-user-guide/latest/) (MIG) to