Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters
SageMaker HyperPod adds a Global Inference Gateway for cross-region request routing and failover.
Source excerpt · Today, SageMaker HyperPod introduces the Global Inference Gateway.