NVIDIA · Ampere
NVIDIA A100 40GB cloud pricing
Compare every cloud instance with NVIDIA A100 40GB GPUs across AWS, Azure, Google Cloud: 7 instance types with 1 to 16 A100 40GBs. Cheapest on demand: $2.745 per A100 40GB-hour on AWS p4d.24xlarge in US East (Ohio).
- on-demand / A100 40GB-hour
- $2.745
- spot / A100 40GB-hour
- $0.7167
- memory per device
- 40 GB
- instance types
- 7
AWS p4d.24xlarge
AWS p4d.24xlarge
3 clouds
Every NVIDIA A100 40GB instance
cheapest region per instance · Linux · on-demand per GPU-hour = hourly price ÷ GPU count · government regions excluded
| Provider | Instance | GPUs | GPU memory | vCPU | RAM | On-demand /hr | Per GPU-hr | Spot per GPU-hr | Cheapest region |
|---|---|---|---|---|---|---|---|---|---|
| AWS | p4d.24xlarge | 8 | 320 GiB | 96 | 1,152 GiB | $21.96 | $2.745 | $0.7167 | US East (Ohio) us-east-2 |
| Azure | ND96asr A100 v4 | 8 | 320 GiB | 96 | 900 GiB | $27.20 | $3.40 | $0.7479 | East US eastus |
| Google Cloud | a2-megagpu-16g | 16 | 640 GiB | 96 | 1,360 GiB | $55.74 | $3.484 | $1.643 | Iowa us-central1 |
| Google Cloud | a2-highgpu-1g | 1 | 40 GiB | 12 | 85 GiB | $3.673 | $3.673 | $1.74 | Iowa us-central1 |
| Google Cloud | a2-highgpu-2g | 2 | 80 GiB | 24 | 170 GiB | $7.347 | $3.673 | $1.74 | Iowa us-central1 |
| Google Cloud | a2-highgpu-4g | 4 | 160 GiB | 48 | 340 GiB | $14.69 | $3.673 | $1.74 | Iowa us-central1 |
| Google Cloud | a2-highgpu-8g | 8 | 320 GiB | 96 | 680 GiB | $29.39 | $3.673 | $1.74 | Iowa us-central1 |
Other GPUs
NVIDIA A100 40GB FAQ
How much does an A100 40GB cost per hour in the cloud?
On demand, from $2.745 per A100 40GB-hour (AWS p4d.24xlarge, $21.96 per hour for 8 A100 40GB in US East (Ohio)). Spot capacity starts at $0.7167 per A100 40GB-hour on AWS p4d.24xlarge.
Which clouds offer A100 40GB instances?
AWS (from $2.745 per GPU-hour, e.g. p4d.24xlarge); Azure (from $3.40 per GPU-hour, e.g. ND96asr A100 v4); Google Cloud (from $3.484 per GPU-hour, e.g. a2-megagpu-16g).
How much memory does the A100 40GB have?
40 GB per GPU (Ampere architecture). Cloud instances combine 1 to 16 of them.