B200 SXM1×BlackwellNVLink VRAM / GPU180GBHBM3e $1.690/hr$40.56 / dayConfigure 28 vCPU320 GB RAM4 TB NVMeVirginia16 available nodesDetails Memory bandwidth7,700 GB/sInterconnectNVLink 5, 1.8 TB/s GPU-to-GPU; PCIe Gen5 128 GB/sLocal storage4,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0282 / minuteGPU memory180 GB per GPU · 180 GB totalConfigure in a regionVirginiaUS EastCompare
H200 SXM1×HopperNVLink VRAM / GPU141GBHBM3e $0.750/hr$18.00 / dayConfigure 26 vCPU240 GB RAM2 TB NVMeVirginia+116 available nodesDetails Memory bandwidth4,800 GB/sInterconnectNVLink 4, 900 GB/s; PCIe Gen5 128 GB/sLocal storage2,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0125 / minuteGPU memory141 GB per GPU · 141 GB totalConfigure in a regionVirginiaUS EastFrankfurtEU CentralCompare
H200 NVL1×HopperNVLink VRAM / GPU141GBHBM3e $0.690/hr$16.56 / dayConfigure 26 vCPU240 GB RAM2 TB NVMeVirginia16 available nodesDetails Memory bandwidth4,800 GB/sInterconnectNVLink bridge 900 GB/s per GPU (2- or 4-way); PCIe Gen5 128 GB/sLocal storage2,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0115 / minuteGPU memory141 GB per GPU · 141 GB totalConfigure in a regionVirginiaUS EastCompare
H100 SXM1×HopperNVLink VRAM / GPU80GBHBM3 $0.550/hr$13.20 / dayConfigure 26 vCPU240 GB RAM2 TB NVMeVirginia+240 available nodesDetails Memory bandwidth3,350 GB/sInterconnectNVLink 4, 900 GB/s; PCIe Gen5 128 GB/sLocal storage2,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0092 / minuteGPU memory80 GB per GPU · 80 GB totalConfigure in a regionVirginiaUS EastOregonUS WestFrankfurtEU CentralCompare
H100 NVL1×HopperNVLink VRAM / GPU94GBHBM3 $0.490/hr$11.76 / dayConfigure 26 vCPU240 GB RAM2 TB NVMeVirginia+116 available nodesDetails Memory bandwidth3,938 GB/sInterconnectPCIe Gen5 x16; NVLink bridge 600 GB/s (3 bridges, 2 cards)Local storage2,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0082 / minuteGPU memory94 GB per GPU · 94 GB totalConfigure in a regionVirginiaUS EastFrankfurtEU CentralCompare
H100 PCIe1×Hopper VRAM / GPU80GBHBM2e $0.450/hr$10.80 / dayConfigure 26 vCPU240 GB RAM2 TB NVMeVirginia+240 available nodesDetails Memory bandwidth2,000 GB/sInterconnectPCIe Gen5 x16; NVLink bridge (3 bridges) 600 GB/s to one adjacent cardLocal storage2,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0075 / minuteGPU memory80 GB per GPU · 80 GB totalConfigure in a regionVirginiaUS EastOregonUS WestFrankfurtEU CentralCompare
GH2001×HopperNVLink VRAM / GPU96GBHBM3 $0.490/hr$11.76 / dayConfigure 72 vCPU480 GB RAM4 TB NVMeVirginia16 available nodesDetails Memory bandwidth4,000 GB/sInterconnectNVLink-C2C 900 GB/s CPU-GPU; NVLink 4 (NVL2/NVL32); up to 4x PCIe Gen5 x16Local storage4,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0082 / minuteGPU memory96 GB per GPU · 96 GB totalConfigure in a regionVirginiaUS EastCompare
A100 SXM 80GB1×AmpereNVLink VRAM / GPU80GBHBM2e $0.190/hr$4.56 / dayConfigure 16 vCPU128 GB RAM1 TB NVMeVirginia+240 available nodesDetails Memory bandwidth2,039 GB/sInterconnectNVLink 3, 600 GB/s; PCIe Gen4 64 GB/sLocal storage1,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0032 / minuteGPU memory80 GB per GPU · 80 GB totalConfigure in a regionVirginiaUS EastOregonUS WestFrankfurtEU CentralCompare
A100 PCIe 80GB1×Ampere VRAM / GPU80GBHBM2e $0.090/hr$2.16 / dayConfigure 16 vCPU128 GB RAM1 TB NVMeVirginia+240 available nodesDetails Memory bandwidth1,935 GB/sInterconnectPCIe Gen4 64 GB/s; NVLink bridge 600 GB/s for 2 GPUsLocal storage1,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0015 / minuteGPU memory80 GB per GPU · 80 GB totalConfigure in a regionVirginiaUS EastOregonUS WestFrankfurtEU CentralCompare
A100 40GB1×Ampere VRAM / GPU40GBHBM2 $0.090/hr$2.16 / dayConfigure 12 vCPU96 GB RAM1 TB NVMeVirginia+116 available nodesDetails Memory bandwidth1,555 GB/sInterconnectPCIe Gen4 64 GB/s; NVLink bridge 600 GB/s for 2 GPUsLocal storage1,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0015 / minuteGPU memory40 GB per GPU · 40 GB totalConfigure in a regionVirginiaUS EastFrankfurtEU CentralCompare
MI325X1×CDNA 3Most memory VRAM / GPU256GBHBM3e $1.090/hr$26.16 / dayConfigure 24 vCPU256 GB RAM2 TB NVMeVirginia16 available nodesDetails Memory bandwidth6,000 GB/sInterconnectInfinity Fabric: 8 links x 128 GB/s; PCIe 5.0 x16Local storage2,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0182 / minuteGPU memory256 GB per GPU · 256 GB totalConfigure in a regionVirginiaUS EastCompare
MI300X1×CDNA 3 VRAM / GPU192GBHBM3 $0.990/hr$23.76 / dayConfigure 24 vCPU256 GB RAM2 TB NVMeVirginia16 available nodesDetails Memory bandwidth5,300 GB/sInterconnectInfinity Fabric: 8 links x 128 GB/s; PCIe 5.0 x16Local storage2,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0165 / minuteGPU memory192 GB per GPU · 192 GB totalConfigure in a regionVirginiaUS EastCompare
L40S1×Ada Lovelace VRAM / GPU48GBGDDR6 $0.150/hr$3.60 / dayConfigure 12 vCPU96 GB RAM1 TB NVMeVirginia+240 available nodesDetails Memory bandwidth864 GB/sInterconnectPCIe Gen4 x16 64 GB/sLocal storage1,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0025 / minuteGPU memory48 GB per GPU · 48 GB totalConfigure in a regionVirginiaUS EastOregonUS WestFrankfurtEU CentralCompare
L401×Ada Lovelace VRAM / GPU48GBGDDR6 $0.090/hr$2.16 / dayConfigure 12 vCPU96 GB RAM1 TB NVMeVirginia+116 available nodesDetails Memory bandwidth864 GB/sInterconnectPCIe Gen4 x16 64 GB/s; NVLink: NoLocal storage1,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0015 / minuteGPU memory48 GB per GPU · 48 GB totalConfigure in a regionVirginiaUS EastFrankfurtEU CentralCompare
A401×Ampere VRAM / GPU48GBGDDR6 $0.060/hr$1.44 / dayConfigure 12 vCPU96 GB RAM1 TB NVMeVirginia+116 available nodesDetails Memory bandwidth696 GB/sInterconnectPCIe Gen4 64 GB/s; NVLink 112.5 GB/s bidirectional (2 GPUs)Local storage1,000 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0010 / minuteGPU memory48 GB per GPU · 48 GB totalConfigure in a regionVirginiaUS EastFrankfurtEU CentralCompare
A301×Ampere VRAM / GPU24GBHBM2 $0.050/hr$1.20 / dayConfigure 8 vCPU64 GB RAM500 GB NVMeVirginia+116 available nodesDetails Memory bandwidth933 GB/sInterconnectPCIe Gen4 64 GB/s; NVLink 3 bridge 200 GB/s (2 GPUs)Local storage500 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0008 / minuteGPU memory24 GB per GPU · 24 GB totalConfigure in a regionVirginiaUS EastFrankfurtEU CentralCompare
A101×Ampere VRAM / GPU24GBGDDR6 $0.090/hr$2.16 / dayConfigure 8 vCPU64 GB RAM500 GB NVMeVirginia+240 available nodesDetails Memory bandwidth600 GB/sInterconnectPCIe Gen4 64 GB/sLocal storage500 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0015 / minuteGPU memory24 GB per GPU · 24 GB totalConfigure in a regionVirginiaUS EastOregonUS WestFrankfurtEU CentralCompare
L41×Ada Lovelace VRAM / GPU24GBGDDR6 $0.050/hr$1.20 / dayConfigure 8 vCPU64 GB RAM500 GB NVMeVirginia+240 available nodesDetails Memory bandwidth300 GB/sInterconnectPCIe Gen4 x16 64 GB/sLocal storage500 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0008 / minuteGPU memory24 GB per GPU · 24 GB totalConfigure in a regionVirginiaUS EastOregonUS WestFrankfurtEU CentralCompare
T41×Turing VRAM / GPU16GBGDDR6 $0.040/hr$0.96 / dayConfigure 6 vCPU32 GB RAM500 GB NVMeVirginia+240 available nodesDetails Memory bandwidth320 GB/sInterconnectPCIe Gen3 x16Local storage500 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0007 / minuteGPU memory16 GB per GPU · 16 GB totalConfigure in a regionVirginiaUS EastOregonUS WestFrankfurtEU CentralCompare
V100 32GB1×VoltaNVLink VRAM / GPU32GBHBM2 $0.060/hr$1.44 / dayConfigure 8 vCPU64 GB RAM500 GB NVMeVirginia+116 available nodesDetails Memory bandwidth900 GB/sInterconnectNVLink 2, 300 GB/sLocal storage500 GB includedNetwork100 GbpsPersistent diskNone selectedSoftwareUbuntu 22.04 (driver only)Billing$0.0010 / minuteGPU memory32 GB per GPU · 32 GB totalConfigure in a regionVirginiaUS EastFrankfurtEU CentralCompare