inf2.24xlarge by Amazon Web Services
inf2.24xlarge is a AWS Inferentia Gen2 24xlarge server offered by Amazon Web Services with 96 vCPUs, 384 GiB of memory and 0 GB of storage. The pricing starts at 0.6491 USD per hour.
96 vCPU
384 GiB Memory
Spare SCore
143448
(All-cores)
(All-cores)
2991
(Single-core)
(Single-core)
Specifications
Server Metadata
Vendor ID | aws |
Name | inf2.24xlarge |
Description | AWS Inferentia Gen2 24xlarge |
Family | inf2 |
Status | active |
Observed At | 2026-03-14T03:51:52.824873 |
Availability
| REGION / ID | SPOT | ONDEMAND |
|---|---|---|
Ohio (US) / us-east-2 | 0.6491 USD/h | 6.4906 USD/h |
Oregon (US) / us-west-2 | 1.3381 USD/h | 6.4906 USD/h |
Northern Virgina (US) / us-east-1 | 1.654825 USD/h | 6.4906 USD/h |
Stockholm (SE) / eu-north-1 | 6.1056 USD/h | 7.1397 USD/h |
Dublin (IE) / eu-west-1 | 2.051367 USD/h | 8.1133 USD/h |
Mumbai (IN) / ap-south-1 | 1.36535 USD/h | 8.4378 USD/h |
Sydney (AU) / ap-southeast-2 | 4.92265 USD/h | 8.4378 USD/h |
Paris (FR) / eu-west-3 | 1.0482 USD/h | 9.0869 USD/h |
Singapore (SG) / ap-southeast-1 | 5.4504 USD/h | 9.0869 USD/h |
London (GB) / eu-west-2 | 1.1628 USD/h | 9.736 USD/h |
Frankfurt (DE) / eu-central-1 | 5.5931 USD/h | 9.736 USD/h |
Tokyo (JP) / ap-northeast-1 | 2.53925 USD/h | 9.736 USD/h |
Sao Paulo (BR) / sa-east-1 | 1.1034 USD/h | 11.0341 USD/h |
Processor
vCPUs | 96 |
Hypervisor | nitro |
CPU Allocation | Dedicated |
CPU Cores | 48 |
CPU Speed | 3.6 GHz |
CPU Architecture | x86_64 |
CPU Manufacturer | AMD |
CPU Family | EPYC |
CPU Model | 7R13 |
CPU L1 Cache | 2 MiB |
CPU L2 Cache | 24 MiB |
CPU L3 Cache | 192 MiB |
CPU Flags | fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ht, syscall, nx, mmxext, fxsr_opt, pdpe1gb, rdtscp, lm, constant_tsc, rep_good, nopl, nonstop_tsc, cpuid, extd_apicid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, cmp_legacy, cr8_legacy, abm, sse4a, misalignsse, 3dnowprefetch, topoext, perfctr_core, ssbd, ibrs, ibpb, stibp, vmmcall, fsgsbase, bmi1, avx2, smep, bmi2, invpcid, rdseed, adx, smap, clflushopt, clwb, sha_ni, xsaveopt, xsavec, xgetbv1, clzero, xsaveerptr, rdpru, wbnoinvd, arat, npt, nrip_save, vaes, vpclmulqdq, rdpid |
System Resources and Accelerators
| MEMORY | |
|---|---|
Memory Amount | 384 GiB |
Memory Generation | DDR4 |
Memory Speed | 3200 Mhz |
| GPU | |
|---|---|
GPU Count | 0 |
GPUs |
| STORAGE | |
|---|---|
Storage Size | 0 GB |
Storages |
| NETWORK | |
|---|---|
Network Speed | 50 Gbps |
Inbound Traffic | 0 GB/month |
Outbound Traffic | 0 GB/month |
IPv4 | 0 |
Economics
Performance
Alternatives
Servers of the Same Family
| INSTANCE | vCPUs | MEMORY | GPUs |
|---|---|---|---|
| inf2.xlarge | 4 | 16 GiB | 0 |
| inf2.8xlarge | 32 | 128 GiB | 0 |
| inf2.48xlarge | 192 | 768 GiB | 0 |
Similar Servers
| INSTANCE | VENDOR | vCPUs | MEMORY | GPUs |
|---|