inf1.24xlarge by Amazon Web Services
(All-cores)
(Single-core)
Specifications #
Server Metadata #
Vendor ID | aws |
Name | inf1.24xlarge |
Description | AWS Inferentia Gen1 24xlarge |
Family | Accelerated Computing |
Series | inf1 |
Hw Virt | |
Status | active |
Observed At | 2026-11-17T03:21:45.138178 |
Availability #
| Region / ID | Spot | Ondemand |
|---|---|---|
Ohio (US) / us-east-2 | 0.539433 USD/h | 4.721 USD/h |
Northern Virgina (US) / us-east-1 | 0.91312 USD/h | 4.721 USD/h |
Oregon (US) / us-west-2 | 1.298125 USD/h | 4.721 USD/h |
Mumbai (IN) / ap-south-1 | 0.646167 USD/h | 4.965 USD/h |
Stockholm (SE) / eu-north-1 | 1.45155 USD/h | 5.016 USD/h |
Quebec (CA) / ca-central-1 | 3.16085 USD/h | 5.26 USD/h |
Dublin (IE) / eu-west-1 | 1.296667 USD/h | 5.26 USD/h |
Paris (FR) / eu-west-3 | 0.5517 USD/h | 5.517 USD/h |
Milan (IT) / eu-south-1 | 0.553 USD/h | 5.53 USD/h |
London (GB) / eu-west-2 | 0.553 USD/h | 5.53 USD/h |
California (US) / us-west-1 | 3.0921 USD/h | 5.671 USD/h |
Seoul (KR) / ap-northeast-2 | 1.058 USD/h | 5.812 USD/h |
Frankfurt (DE) / eu-central-1 | 2.6397 USD/h | 5.902 USD/h |
Sydney (AU) / ap-southeast-2 | 0.780833 USD/h | 5.902 USD/h |
Cape Town (ZA) / af-south-1 | 0.6249 USD/h | 6.249 USD/h |
Tokyo (JP) / ap-northeast-1 | 3.0306 USD/h | 6.376 USD/h |
Singapore (SG) / ap-southeast-1 | 2.762433 USD/h | 6.376 USD/h |
Hong Kong (HK) / ap-east-1 | 4.0007 USD/h | 7.274 USD/h |
Sao Paulo (BR) / sa-east-1 | 0.78 USD/h | 7.8 USD/h |
Processor #
vCPUs | 96 |
Hypervisor | nitro |
CPU Allocation | Dedicated |
CPU Cores | 48 |
CPU Speed | 2.5 GHz |
CPU Architecture | x86_64 |
CPU Manufacturer | Intel |
CPU Family | Xeon |
CPU Model | 8275CL |
CPU L1D Cache | 32 KiB |
CPU L1D Cache Total | 2 MiB |
CPU L1I Cache | 32 KiB |
CPU L1I Cache Total | 2 MiB |
CPU L2 Cache | 1 MiB |
CPU L2 Cache Total | 48 MiB |
CPU L3 Cache | 36 MiB |
CPU L3 Cache Total | 72 MiB |
CPU Flags | fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, ht, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, arch_perfmon, rep_good, nopl, xtopology, nonstop_tsc, cpuid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, tsc_deadline_timer, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, pti, fsgsbase, tsc_adjust, bmi1, avx2, smep, bmi2, erms, invpcid, mpx, avx512f, avx512dq, rdseed, adx, smap, clflushopt, clwb, avx512cd, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, ida, arat, pku, ospke |
Ecpus | 60.6 |
Scalability | 63.12 |
System Resources and Accelerators #
| Memory | |
|---|---|
Memory Amount | 192 GiB |
Memory Amount Actual | 192 GiB |
Memory Generation | DDR4 |
Memory Speed | 2933 Mhz |
| Accelerators | |
|---|---|
Accelerator Count | 16 |
Accelerator Memory Min | 8 GiB |
Accelerator Memory Total | 128 GiB |
Accelerator Type | NPU |
Accelerator Manufacturer | AWS |
Accelerator Model | Inferentia |
Accelerators |
|
| Storage | |
|---|---|
Storage Size | 0 GB |
Storages | |
Compatible Storage IDs | standard, gp2, gp3, st1, sc1, io1, io2 |
| Network | |
|---|---|
Network Speed Baseline | 100 Gbps |
Network Speed Max | 100 Gbps |
Network Storage Speed Baseline | 19 Gbps |
Network Storage Speed Max | 19 Gbps |
Inbound Traffic | 0 GB/month |
Outbound Traffic | 0 GB/month |
IPv4 | 0 |
CPU and System Topology #
Server Description #
A high-core compute instance with 100 Gbps networking, optimized for multi-threaded processing and high-throughput database workloads.
Amazon Web Services inf1.24xlarge is an x86_64 compute-focused server featuring 96 vCPUs (48 physical cores) powered by an Intel Xeon 8275CL processor running at 2.5 GHz. It is configured with 192.0 GB of DDR4 RAM, a 100 Gbps baseline network speed, and no local storage or GPUs. Operating on the AWS Nitro hypervisor, the server delivers strong multi-core CPU performance and exceptional memory bandwidth, scoring in the top 25% for Redis SET operations and Passmark database tests. However, text generation benchmarks for large language models are poor. This server is highly suited for multi-threaded CPU workloads, high-throughput database operations, software compilation, and network-intensive applications.
Economics #
Performance #
Memory Bandwidth#
Compression #
OpenSSL #
Geekbench Single-Core #
Geekbench Multi-Core #
Passmark CPU Scores #
| BENCHMARK | SCORE |
|---|---|
Mark | 62,409 |
Compression | 1,328,995 |
Encryption | 41,648 |
Extended Instructions | 83,999 |
Floating Point Maths | 169,727 |
Integer Maths | 317,154 |
Physics | 5,211 |
Prime Numbers | 349 |
Single Threaded | 2,186 |
String Sorting | 151,153 |
Passmark Memory Scores #
| BENCHMARK | SCORE |
|---|---|
Memory Mark | 2,812 |
Database Operations | 22,950 |
Memory Latency | 51 |
Memory Read Cached | 26,138 |
Memory Read Uncached | 10,774 |
Memory Write | 10,344 |
Stress-ng Raw Scores #
Stress-ng Relative Multicore Performance #
Static Web Server#
Redis#
Alternatives #
Servers of the Same Family #
| INSTANCE | vCPUs | MEMORY | Accelerators |
|---|---|---|---|
| inf1.xlarge | 4 | 8 GiB | 1 |
| inf1.2xlarge | 8 | 16 GiB | 1 |
| inf1.6xlarge | 24 | 48 GiB | 4 |
Similar Servers #
| INSTANCE | VENDOR | vCPUs | MEMORY | Accelerators |
|---|