inf2.48xlarge by Amazon Web Services
inf2.48xlarge is a AWS Inferentia Gen2 48xlarge server offered by Amazon Web Services with 192 vCPUs, 768 GiB of memory and 0 GB of storage. The pricing starts at 1.2981 USD per hour.
192 vCPU
768 GiB Memory
Spare SCore
286883
(All-cores)
(All-cores)
2992
(Single-core)
(Single-core)
Specifications
Server Metadata
Vendor ID | aws |
Name | inf2.48xlarge |
Description | AWS Inferentia Gen2 48xlarge |
Family | inf2 |
Status | active |
Observed At | 2026-05-02T14:50:25.241081 |
Availability
| REGION / ID | SPOT | ONDEMAND |
|---|---|---|
Ohio (US) / us-east-2 | 1.2981 USD/h | 12.9813 USD/h |
Oregon (US) / us-west-2 | 2.307225 USD/h | 12.9813 USD/h |
Northern Virgina (US) / us-east-1 | 7.4263 USD/h | 12.9813 USD/h |
Stockholm (SE) / eu-north-1 | 4.2813 USD/h | 14.2794 USD/h |
Dublin (IE) / eu-west-1 | 2.256333 USD/h | 16.2266 USD/h |
Mumbai (IN) / ap-south-1 | 3.27995 USD/h | 16.8757 USD/h |
Sydney (AU) / ap-southeast-2 | 10.08705 USD/h | 16.8757 USD/h |
Paris (FR) / eu-west-3 | 1.92955 USD/h | 18.1738 USD/h |
Singapore (SG) / ap-southeast-1 | 10.9855 USD/h | 18.1738 USD/h |
London (GB) / eu-west-2 | 2.1324 USD/h | 19.4719 USD/h |
Frankfurt (DE) / eu-central-1 | 13.27325 USD/h | 19.4719 USD/h |
Tokyo (JP) / ap-northeast-1 | 19.4719 USD/h | 19.4719 USD/h |
Sao Paulo (BR) / sa-east-1 | 2.2068 USD/h | 22.0681 USD/h |
Processor
vCPUs | 192 |
Hypervisor | nitro |
CPU Allocation | Dedicated |
CPU Cores | 96 |
CPU Speed | 3.6 GHz |
CPU Architecture | x86_64 |
CPU Manufacturer | AMD |
CPU Family | EPYC |
CPU Model | 7R13 |
CPU L1D Cache | 32 KiB |
CPU L1D Cache Total | 3 MiB |
CPU L1I Cache | 32 KiB |
CPU L1I Cache Total | 3 MiB |
CPU L2 Cache | 512 KiB |
CPU L2 Cache Total | 48 MiB |
CPU L3 Cache | 32 MiB |
CPU L3 Cache Total | 384 MiB |
CPU Flags | fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ht, syscall, nx, mmxext, fxsr_opt, pdpe1gb, rdtscp, lm, constant_tsc, rep_good, nopl, nonstop_tsc, cpuid, extd_apicid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, cmp_legacy, cr8_legacy, abm, sse4a, misalignsse, 3dnowprefetch, topoext, perfctr_core, ssbd, ibrs, ibpb, stibp, vmmcall, fsgsbase, bmi1, avx2, smep, bmi2, invpcid, rdseed, adx, smap, clflushopt, clwb, sha_ni, xsaveopt, xsavec, xgetbv1, clzero, xsaveerptr, rdpru, wbnoinvd, arat, npt, nrip_save, vaes, vpclmulqdq, rdpid |
System Resources and Accelerators
| MEMORY | |
|---|---|
Memory Amount | 768 GiB |
Memory Generation | DDR4 |
Memory Speed | 3200 Mhz |
| GPU | |
|---|---|
GPU Count | 0 |
GPUs |
| STORAGE | |
|---|---|
Storage Size | 0 GB |
Storages |
| NETWORK | |
|---|---|
Network Speed | 100 Gbps |
Inbound Traffic | 0 GB/month |
Outbound Traffic | 0 GB/month |
IPv4 | 0 |
Economics
Performance
Memory Bandwidth
Compression
OpenSSL
Geekbench Single-Core
Score: 1,677
Geekbench Multi-Core
Score: 15,331
Passmark CPU Scores
| BENCHMARK | SCORE |
|---|---|
Mark | 95525 |
Compression | 2982357 |
Encryption | 221586 |
Extended Instructions | 153692 |
Floating Point Maths | 483941 |
Integer Maths | 880361 |
Physics | 14535 |
Prime Numbers | 1050 |
Single Threaded | 1980 |
String Sorting | 367059 |
Passmark Memory Scores
| BENCHMARK | SCORE |
|---|---|
Memory Mark | 1174 |
Database Operations | 16815 |
Memory Latency | 73 |
Memory Read Cached | 10071 |
Memory Read Uncached | 3053 |
Memory Write | 2914 |
Stress-ng Raw Scores
Stress-ng Relative Multicore Performance
LLM Inference Speed for Prompt Processing
LLM Inference Speed for Text Generation
Static Web Server
Redis
Alternatives
Servers of the Same Family
| INSTANCE | vCPUs | MEMORY | GPUs |
|---|---|---|---|
| inf2.xlarge | 4 | 16 GiB | 0 |
| inf2.8xlarge | 32 | 128 GiB | 0 |
| inf2.24xlarge | 96 | 384 GiB | 0 |
Similar Servers
| INSTANCE | VENDOR | vCPUs | MEMORY | GPUs |
|---|