HOT SALE
NVIDIA 8X DGX H100 Deep Learning Console
NVIDIA 8X DGX H100 Deep Learning Console - Image 2
NVIDIA 8X DGX H100 Deep Learning Console - Image 3
NVIDIA 8X DGX H100 Deep Learning Console - Image 4
NVIDIA 8X DGX H100 Deep Learning Console - Image 5
NVIDIA 8X DGX H100 Deep Learning Console - Image 6
NVIDIA 8X DGX H100 Deep Learning Console - Image 7

NVIDIA 8X DGX H100 Deep Learning Console

Model: 8X DGX H100
SKU: 8XDGXH100
$415,000.00 Original price was: $415,000.00.$322,000.00Current price is: $322,000.00.
Add to wishlist Compare

✓ Equipped with 8x NVIDIA H100 Tensor Core GPUs (SXM5)

✓ GPU memory totals 640GB

✓ Achieves 32 petaFLOPS FP8 performance

✓ Incorporates 4x NVIDIA® NVSwitch™

✓ System power usage peaks at ~10.2kW

✓ Employs Dual 56-core 4th Gen Intel® Xeon® Scalable processors

✓ Provides 2TB of system memory

✓ Offers robust networking, including 4x OSFP ports, NVIDIA ConnectX-7 VPI, and options for 400 Gb/s InfiniBand or 200 Gb/s Ethernet

✓ Features 10 Gb/s onboard NIC with RJ45 for management network, with options for a 50 Gb/s Ethernet NIC

✓ Storage includes 2x 1.9TB NVMe M.2 for OS and 8x 3.84TB NVMe U.2 for internal storage

✓ Comes pre-loaded with NVIDIA AI Enterprise software, NVIDIA Base Command, and a choice of Ubuntu, Red Hat Enterprise Linux, or CentOS operating systems

✓ Operates within a temperature range of 5–30°C (41–86°F)

✓ 3 year manufacturer parts or replacement warranty included

Description

NVIDIA DGX H100

The Gold Standard for AI Infrastructure

NVIDIA DGX H100 powers business innovation and optimization. The latest iteration of NVIDIA’s legendary DGX systems and the foundation of NVIDIA DGX SuperPOD™, DGX H100 is an AI powerhouse that features the groundbreaking NVIDIA H100 Tensor Core GPU. The system is designed to maximize AI throughput, providing enterprises with a highly refined, systemized, and scalable platform to help them achieve breakthroughs in natural language processing, recommender systems, data analytics, and much more. Available on-premises and through a wide variety of access and deployment options, DGX H100 delivers the performance needed for enterprises to solve the biggest challenges with AI.

Break Through the Barriers to AI at Scale

As the world’s first system with the NVIDIA H100 Tensor Core GPU, NVIDIA DGX H100 breaks the limits of AI scale and performance. It features 9X more performance, 2X faster networking with NVIDIA ConnectX®-7 smart network interface cards (SmartNICs), and high-speed scalability for NVIDIA DGX SuperPOD. The next-generation architecture is supercharged for the largest, most complex AI jobs, such as natural language processing and deep learning recommendation models.

Powered by NVIDIA Base Command

NVIDIA Base Command powers every DGX system, enabling organizations to leverage the best of NVIDIA software innovation. Enterprises can unleash the full potential of their DGX investment with a proven platform that includes enterprise-grade orchestration and cluster management, libraries that accelerate compute, storage and network infrastructure, and an operating system optimized for AI workloads. Additionally, DGX systems include NVIDIA AI Enterprise, offering a suite of software optimized to streamline AI development and deployment.

Specification Description
GPU 8x NVIDIA H100 Tensor Core GPUs SXM5
GPU memory 640GB total
Performance 32 petaFLOPS FP8
NVIDIA® NVSwitch™ 4x
System power usage ~10.2kW max
CPU Dual 56-core 4th Gen Intel® Xeon® Scalable processors
System memory 2TB
Networking 4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI; 400 Gb/s InfiniBand or 200 Gb/s Ethernet; 2x dual-port NVIDIA ConnectX-7 VPI; 1x 400 Gb/s InfiniBand; 1x 200 Gb/s Ethernet
Management network 10 Gb/s onboard NIC with RJ45; 50 Gb/s Ethernet optional NIC; Host baseboard management controller (BMC) with RJ45
Storage OS: 2x 1.9TB NVMe M.2; Internal storage: 8x 3.84TB NVMe U.2
Software NVIDIA AI Enterprise – Optimized AI software; NVIDIA Base Command – Orchestration, scheduling, and cluster management; Ubuntu / Red Hat Enterprise Linux / CentOS – Operating system
Support Comes with 3-year business-standard hardware and software support
Operating temperature range 5–30°C (41–86°F)

Brand

Nvidia

Related products

SALE
NVIDIA A800 Enterprise 80GB PCIe
Add to wishlist Compare

NVIDIA A800 Enterprise 80GB PCIe

Original price was: $20,700.00.Current price is: $17,999.00.
Add to cart
Two months after it was banned by US government from selling high-performance AI chips to China, NVIDIA has introduced a new A800 GPU designed to bypass those restrictions.   The new NVIDIA A800 is based on the same Ampere microarchitecture as the A100, which was used as the performance baseline by the US government.   Despite its numerically larger model number (the lucky number 8 was probably picked to appeal to the Chinese), this is a detuned part, with slightly reduced performance to meet export control limitations and the 33% reduced NVLINK speed is hardly noticeable. It can only be stacked to 8-GPUs per system, not 16 like the A100. This card is the industry standard and premier value choice for ever demanding high-end AI and CGI workloads.   Ships in 10 days from payment. Limited allocations available. 3-year warranty included. All sales final. No returns or cancellations.
HOT
NVIDIA H800 Enterprise 80GB
Add to wishlist Compare

NVIDIA H800 Enterprise 80GB

Original price was: $30,800.00.Current price is: $27,700.00.
Add to cart
✓ GPU Name: GH100 ✓ Architecture: Hopper ✓ Foundry: TSMC ✓ Process Size: 4 nm ✓ Transistors: 80,000 million ✓ Die Size: 814mm² ✓ Generation: Tesla Hopper ✓ Type: Desktop ✓ Bus Interface: PCIe 5.0 x16 ✓ Base Clock: 1095MHz ✓ Boost Clock: 1755MHz   Ships in 10 days from payment. All sales final.
SALE
NVIDIA A16 Enterprise 64GB 250W
Add to wishlist Compare

NVIDIA A16 Enterprise 64GB 250W

Original price was: $3,580.00.Current price is: $2,999.00.
Add to cart
  • ✔ Number of stream processors: 5120
  • ✔ Power consumption (W): 250
  • ✔ Architecture: Ampere
  • ✔ Monitor output: None
  • ✔ Interface: PCI-E 4.0 8x
  • ✔ Gigabytes of memory: 64
  • ✔ Cooling type: Passive
  • ✔ Memory type: GDDR6
  • ✔ Slot count: 2
  • ✔ Profile: FH
  • ✔ Warranty: Manufacturer repair or replace 2 years
  Ships in 5 days from payment. All sales are final. No returns or cancellations
HOT SALE
NVIDIA H100 NVL HBM3 94GB 350W
Add to wishlist Compare

NVIDIA H100 NVL HBM3 94GB 350W

Original price was: $27,700.00.Current price is: $22,999.00.
Add to cart
The H100 NVL has a full 6144-bit memory interface (1024-bit for each HBM3 stack) and memory speed up to 5.1 Gbps. This means that the maximum throughput is 7.8GB/s, more than twice as much as the H100 SXM. Large Language Models require large buffers and higher bandwidth will certainly have an impact as well.   NVIDIA H100 NVL for Large Language Model Deployment is ideal for deploying massive LLMs like ChatGPT at scale. The new H100 NVL with 96GB of memory with Transformer Engine acceleration delivers up to 12x faster inference performance at GPT-3 compared to the prior generation A100 at data center scale.
Ships in 5 days from payment. 
HOT
NVIDIA A30 Enterprise Tensor Core 24GB 165W
Add to wishlist Compare

NVIDIA A30 Enterprise Tensor Core 24GB 165W

Original price was: $5,150.00.Current price is: $4,375.00.
Add to cart
✓ GPU memory: 24GB HBM2 ✓ GPU memory bandwidth: 933GB/s ✓ Interconnect: PCIe Gen4: 64GB/s, Third-gen NVLINK: 200GB/s** ✓ Form factor: Dual-slot, full-height, full-length (FHFL) ✓ Max thermal design power (TDP): 165W ✓ Multi-Instance GPU (MIG): 4 GPU instances @ 6GB each, 2 GPU instances @ 12GB each, 1 GPU instance @ 24GB ✓ Virtual GPU (vGPU) software support: NVIDIA AI Enterprise, NVIDIA Virtual Compute Server ✓ Warranty: 2 year manufacturer repair or replace   Ships in 5 days from payment. No returns or cancellations. All sales final.
GPU SALE
NVIDIA RTX 6000 Ada Generation Enterprise 48G
Add to wishlist Compare

NVIDIA RTX 6000 Ada Generation Enterprise 48G

Original price was: $8,950.00.Current price is: $8,050.00.
Add to cart

The NVIDIA RTX 6000 ADA Generation delivers the features, capabilities, and performance to meet the challenges of today’s professional workflows. Built on the NVIDIA Ada Lovelace GPU architecture, the RTX 6000 combines third-generation RT Cores, fourth-generation Tensor Cores, and next-gen CUDA cores with 48GB of graphics memory for unprecedented rendering, AI (artificial intelligence) processing, common graphics, and extreme compute performance. NVIDIA RTX 6000-powered workstations provide what you need to succeed in today’s ultra-challenging business environment.

  • GPU memory: 48GB GDDR6 Memory interface: 384-bit
  • Memory bandwidth: 960 GB/s
  • Error correction code (ECC): Yes
  • NVIDIA Ada Lovelace architecture-based CUDA Cores: 18,176 NVIDIA third-generation
  • Tensor Cores: 568 NVIDIA second-generation
  • RT Cores: 142
  • System interface: PCIe 4.0 x16 Power consumption
  • Total board power: 300 W
  • Thermal solution: Active
  • Form factor: 4.4” H x 10.5” L, dual slot, full height
  • Display connectors: 4x DisplayPort 1.4a
  • Power connector: 1x PCIe CEM5 16-pin Encode/decode engines: 3x encode, 3x decode (+AV1 encode and decode)
  • VR ready Graphics APIs: DirectX 12, Shader Model 6.6, OpenGL 4.66, Vulkan 1.3 Compute APIs CUDA 11.6, OpenCL 3.0, DirectCompute
  • NVIDIA NVLink: No
  • 3-Year manufacturer warranty included.
Ships in 5 days from payment. All sales final. No returns or cancellations