NVIDIA A30 Enterprise Tensor Core 24GB 165W

Description

• AI Inference and Mainstream computing for Every Enterprise

   

  Bring accelerated performance to every enterprise workload with NVIDIA A30 Tensor Core GPUs. With NVIDIA Ampere architecture Tensor Cores and Multi-Instance GPU (MIG), it delivers speedups securely across diverse workloads, including AI inference at scale and high-performance computing (HPC) applications. By combining fast memory bandwidth and low-power consumption in a PCIe form factor—optimal for mainstream servers—A30 enables an elastic data center and delivers maximum value for enterprises.

  Deep Learning Training

  AI Training—Up to 3X higher throughput than v100 and 6X higher than T4

  Training AI models for next-level challenges such as conversational AI requires massive computing power and scalability.

  NVIDIA A30 Tensor Cores with Tensor Float (TF32) provide up to 10X higher performance over the NVIDIA T4 with zero code changes and an additional 2X boost with automatic mixed precision and FP16, delivering a combined 20X throughput increase. When combined with NVIDIA^® NVLink^®, PCIe Gen4, NVIDIA networking, and the NVIDIA Magnum IO^™ SDK, it’s possible to scale to thousands of GPUs.

  Tensor Cores and MIG enable A30 to be used for workloads dynamically throughout the day. It can be used for production inference at peak demand, and part of the GPU can be repurposed to rapidly re-train those very same models during off-peak hours.

  NVIDIA set multiple performance records in MLPerf, the industry-wide benchmark for AI training