logo

inf2.8xlarge by Amazon Web Services

inf2.8xlarge is a AWS Inferentia Gen2 8xlarge server offered by Amazon Web Services with 32 vCPUs, 128 GiB of memory and 0 GB of storage. The pricing starts at 0.2165 USD per hour.
Visit Vendor Status Page
32 vCPU
128 GiB Memory
Spare SCore
47852
(All-cores)
2991
(Single-core)

Specifications

Server Metadata

Vendor ID
aws
Name
inf2.8xlarge
Description
AWS Inferentia Gen2 8xlarge
Family
inf2
Status
active
Observed At
2026-05-02T14:50:25.242978

Availability

REGION / IDSPOTONDEMAND
Ohio (US) / us-east-2
0.2925 USD/h 1.9679 USD/h
Oregon (US) / us-west-2
0.4121 USD/h 1.9679 USD/h
Northern Virgina (US) / us-east-1
0.662625 USD/h 1.9679 USD/h
Stockholm (SE) / eu-north-1
0.4958 USD/h 2.1646 USD/h
Dublin (IE) / eu-west-1
0.7236 USD/h 2.4598 USD/h
Sydney (AU) / ap-southeast-2
0.7322 USD/h 2.5582 USD/h
Mumbai (IN) / ap-south-1
0.91745 USD/h 2.5582 USD/h
Paris (FR) / eu-west-3
0.30475 USD/h 2.755 USD/h
Singapore (SG) / ap-southeast-1
1.69625 USD/h 2.755 USD/h
London (GB) / eu-west-2
0.5977 USD/h 2.9518 USD/h
Frankfurt (DE) / eu-central-1
1.77785 USD/h 2.9518 USD/h
Tokyo (JP) / ap-northeast-1
2.48965 USD/h 2.9518 USD/h
Sao Paulo (BR) / sa-east-1
0.3345 USD/h 3.3454 USD/h

Processor

vCPUs
32
Hypervisor
nitro
CPU Allocation
Dedicated
CPU Cores
16
CPU Speed
3.6 GHz
CPU Architecture
x86_64
CPU Manufacturer
AMD
CPU Family
EPYC
CPU Model
7R13
CPU L1D Cache
32 KiB
CPU L1D Cache Total
512 KiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
512 KiB
CPU L2 Cache
512 KiB
CPU L2 Cache Total
8 MiB
CPU L3 Cache
32 MiB
CPU L3 Cache Total
64 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ht, syscall, nx, mmxext, fxsr_opt, pdpe1gb, rdtscp, lm, constant_tsc, rep_good, nopl, nonstop_tsc, cpuid, extd_apicid, aperfmperf, tsc_known_freq, pni, pclmulqdq, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, cmp_legacy, cr8_legacy, abm, sse4a, misalignsse, 3dnowprefetch, topoext, ssbd, ibrs, ibpb, stibp, vmmcall, fsgsbase, bmi1, avx2, smep, bmi2, invpcid, rdseed, adx, smap, clflushopt, clwb, sha_ni, xsaveopt, xsavec, xgetbv1, clzero, xsaveerptr, rdpru, wbnoinvd, arat, npt, nrip_save, vaes, vpclmulqdq, rdpid

System Resources and Accelerators

MEMORY
Memory Amount
128 GiB
Memory Generation
DDR4
Memory Speed
3200 Mhz
GPU
GPU Count
0
GPUs
    STORAGE
    Storage Size
    0 GB
    Storages
      NETWORK
      Network Speed
      16.667 Gbps
      Inbound Traffic
      0 GB/month
      Outbound Traffic
      0 GB/month
      IPv4
      0

      Economics

      Average Price per Region

      Prices per Zone

      Lowest Prices

      Performance

      Memory Bandwidth

      Compression

      OpenSSL

      Geekbench Single-Core

      Score: 1,686

      Geekbench Multi-Core

      Score: 13,860

      Passmark CPU Scores

      BENCHMARKSCORE
      Mark
      		41970
      Compression
      		557525
      Encryption
      		37953
      Extended Instructions
      		33147
      Floating Point Maths
      		80773
      Integer Maths
      		147258
      Physics
      		4058
      Prime Numbers
      		204
      Single Threaded
      		2645
      String Sorting
      		74749

      Passmark Memory Scores

      BENCHMARKSCORE
      Memory Mark
      		2878
      Database Operations
      		14151
      Memory Latency
      		61
      Memory Read Cached
      		26588
      Memory Read Uncached
      		17494
      Memory Write
      		17577

      Stress-ng Raw Scores

      Stress-ng Relative Multicore Performance

      LLM Inference Speed for Prompt Processing

      LLM Inference Speed for Text Generation

      Static Web Server

      Redis

      Alternatives

      Servers of the Same Family

      INSTANCEvCPUsMEMORYGPUs
      inf2.xlarge 416 GiB0
      inf2.24xlarge 96384 GiB0
      inf2.48xlarge 192768 GiB0

      Similar Servers

      INSTANCEVENDORvCPUsMEMORYGPUs

      inf2.8xlarge FAQs