Amazon Web Services (AWS) announced NVIDIA Multi-Instance GPU support for Amazon SageMaker Inference on November 6, 2026, letting multiple hardware-isolated models share one accelerator on real-time endpoints instead of assigning each deployment an entire GPU. The feature addresses two constraints of whole-GPU allocation. Accelerator count caps how many models an instance can host, regardless of how little memory or compute each model uses, and customers considering a newer GPU must allocate…