inf2.24xlarge

Amazon EC2 · Inf2 family

The inf2.24xlarge is a gpu & accelerated Amazon EC2 instance type with 96 vCPUs and 384 GiB of memory, 6 × AWS Inferentia2, running on AMD EPYC 7R13 Processor with 50 Gigabit networking, starting at $6.491 per hour on demand.

gpu & acceleratedx86-64amdai
vCPUs
96

dedicated

memory
384 GiB

4 GiB per vCPU

accelerator
6× Inferentia2

192 GiB total

on-demand
$6.491

$4,738/mo · us-east-1

spot
$2.445

−62% vs on-demand

1-yr reserved
$4.089

−37% vs on-demand

inf2.24xlarge price by region

13 regions · hourly list prices in USD · On-demand · Spot · 1-yr Reserved · 3-yr Reserved

US East (N. Virginia)us-east-1cheapestreferenceNorth America$6.491$2.445$4.089$2.804
US East (Ohio)us-east-2cheapestNorth America$6.491$1.165$4.089$2.804
US West (Oregon)us-west-2cheapestNorth America$6.491$1.185$4.089$2.804
EU (Stockholm)eu-north-1Europe$7.14$0.7259$4.498$3.084
EU (Ireland)eu-west-1Europe$8.113$2.685$5.111$3.505
Asia Pacific (Mumbai)ap-south-1Asia$8.438$2.622$5.316$3.926
Asia Pacific (Sydney)ap-southeast-2Oceania$8.438$0.8563$5.316$3.645
Asia Pacific (Singapore)ap-southeast-1Asia$9.087$0.9087$5.725$3.926
EU (Paris)eu-west-3Europe$9.087$0.9304$5.725$4.206
Asia Pacific (Tokyo)ap-northeast-1Asia$9.736$1.333$6.134$4.486
EU (Frankfurt)eu-central-1Europe$9.736$1.236$6.134$4.486
EU (London)eu-west-2Europe$9.736$1.012$6.134$4.486
South America (Sao Paulo)sa-east-1South America$11.03$1.103$6.951$4.767

Specifications

compute

vCPUs
96
Memory
384 GiB
Memory per vCPU
4 GiB
Processor
AMD EPYC 7R13 Processor
CPU vendor
AMD
Architecture
x86-64
Clock speed
2.95 GHz
Burstable CPU
No

storage & network

Local storage
Network storage only
Storage detail
EBS only
Network
50 Gigabit
Peak bandwidth
50 Gbps

accelerators

Count
6
Memory (total)
192 GiB
Vendor
AWS

aws details

API name
inf2.24xlarge
Family
Inf2
Category
GPU & accelerated
Generation
Current
Regions
13 (Asia, Europe, North America, Oceania, South America)
Cheapest region
US East (N. Virginia) · $6.491/hr
Dedicated EBS throughput
30 Gbps
Enhanced networking
Yes
Normalization size factor
8.56
Processor features
AMD Turbo; AVX; AVX2
Spot interruption rate (us-east-1)
>20%
Spot savings vs on-demand (us-east-1)
78%

Inf2 family sizes

all about Inf2→
SizevCPUMemoryAcceleratorLocal storageOn-demandMonthlySpot1-yr
inf2.xlarge416 GiB1 × AWS Inferentia2–$0.7582$553$0.3178$0.4777
inf2.8xlarge32128 GiB1 × AWS Inferentia2–$1.968$1,437$0.7988$1.24
inf2.24xlarge96384 GiB6 × AWS Inferentia2–$6.491$4,738$2.445$4.089
inf2.48xlarge192768 GiB12 × AWS Inferentia2–$12.98$9,476$5.048$8.178

inf2.24xlarge FAQ

How much does inf2.24xlarge cost?

inf2.24xlarge costs $6.491 per hour on demand with Linux in US East (N. Virginia) (us-east-1), about $4,738 per month. Across 13 regions the Linux on-demand price ranges from $6.491 in US East (N. Virginia) to $11.03 in South America (Sao Paulo). Spot capacity costs $2.445 per hour (62% less), but can be reclaimed. A 1-yr Reserved commitment brings it to $4.089 per hour.

How many vCPUs and how much memory does inf2.24xlarge have?

inf2.24xlarge has 96 vCPUs and 384 GiB of memory (4 GiB per vCPU), running on AMD EPYC 7R13 Processor. It is a gpu & accelerated instance type in the Inf2 family.

What accelerator does inf2.24xlarge have?

inf2.24xlarge has 6 × AWS Inferentia2 with 192 GiB of accelerator memory in total.