inf2.24xlarge by Amazon Web Services
inf2.24xlarge is a AWS Inferentia Gen2 24xlarge server offered by Amazon Web Services with 96 vCPUs, 384 GiB of memory and 0 GB of storage. The pricing starts at 0.696 USD per hour.
96 vCPU
384 GiB Memory
Spare SCore
143448
(All-cores)
(All-cores)
2991
(Single-core)
(Single-core)
Specifications
Server Details
| General | |
|---|---|
Vendor ID | aws |
Server ID | inf2.24xlarge |
Name | inf2.24xlarge |
API Reference | inf2.24xlarge |
Display Name | inf2.24xlarge |
Description | AWS Inferentia Gen2 24xlarge |
Family | inf2 |
Status | active |
Observed At | 2026-02-21T12:51:24.233184 |
| CPU | |
|---|---|
vCPUs | 96 |
Hypervisor | nitro |
CPU Allocation | Dedicated |
CPU Cores | 48 |
CPU Speed | 3.6 GHz |
CPU Architecture | x86_64 |
CPU Manufacturer | AMD |
CPU Family | EPYC |
CPU Model | 7R13 |
CPU L1 Cache | 2 MiB |
CPU L2 Cache | 24 MiB |
CPU L3 Cache | 192 MiB |
CPU Flags | fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ht, syscall, nx, mmxext, fxsr_opt, pdpe1gb, rdtscp, lm, constant_tsc, rep_good, nopl, nonstop_tsc, cpuid, extd_apicid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, cmp_legacy, cr8_legacy, abm, sse4a, misalignsse, 3dnowprefetch, topoext, perfctr_core, ssbd, ibrs, ibpb, stibp, vmmcall, fsgsbase, bmi1, avx2, smep, bmi2, invpcid, rdseed, adx, smap, clflushopt, clwb, sha_ni, xsaveopt, xsavec, xgetbv1, clzero, xsaveerptr, rdpru, wbnoinvd, arat, npt, nrip_save, vaes, vpclmulqdq, rdpid |
| Memory | |
|---|---|
Memory Amount | 384 GiB |
Memory Generation | DDR4 |
Memory Speed | 3200 Mhz |
| GPU | |
|---|---|
GPU Count | 0 |
GPUs |
| Storage | |
|---|---|
Storage Size | 0 GB |
Storages |
| Network | |
|---|---|
Network Speed | 50 Gbps |
Inbound Traffic | 0 GB/month |
Outbound Traffic | 0 GB/month |
IPv4 | 0 |
Availability
| REGION / ID | SPOT | ONDEMAND |
|---|---|---|
Ohio (US) / us-east-2 | 0.737667 USD/h | 6.4906 USD/h |
Northern Virgina (US) / us-east-1 | 1.263575 USD/h | 6.4906 USD/h |
Oregon (US) / us-west-2 | 1.599175 USD/h | 6.4906 USD/h |
Stockholm (SE) / eu-north-1 | 2.38185 USD/h | 7.1397 USD/h |
Dublin (IE) / eu-west-1 | 2.0861 USD/h | 8.1133 USD/h |
Mumbai (IN) / ap-south-1 | 1.32035 USD/h | 8.4378 USD/h |
Sydney (AU) / ap-southeast-2 | 2.13095 USD/h | 8.4378 USD/h |
Singapore (SG) / ap-southeast-1 | 2.4214 USD/h | 9.0869 USD/h |
Paris (FR) / eu-west-3 | 1.014 USD/h | 9.0869 USD/h |
London (GB) / eu-west-2 | 1.2179 USD/h | 9.736 USD/h |
Tokyo (JP) / ap-northeast-1 | 4.17135 USD/h | 9.736 USD/h |
Frankfurt (DE) / eu-central-1 | 5.78285 USD/h | 9.736 USD/h |
Sao Paulo (BR) / sa-east-1 | 1.1034 USD/h | 11.0341 USD/h |
Economics
Performance
Alternatives
Servers of the Same Family
| INSTANCE | vCPUs | MEMORY | GPUs |
|---|---|---|---|
| inf2.xlarge | 4 | 16 GiB | 0 |
| inf2.8xlarge | 32 | 128 GiB | 0 |
| inf2.48xlarge | 192 | 768 GiB | 0 |
Similar Servers
| INSTANCE | VENDOR | vCPUs | MEMORY | GPUs |
|---|