p4d.24xlarge by Amazon Web Services

p4d.24xlarge is a GPU accelerated [Instance store volumes] Gen4 24xlarge server offered by Amazon Web Services with 96 vCPUs, 1152 GiB of memory and 8 TB of storage. The pricing starts at 2.7209 USD per hour.
96 vCPU
1152 GiB Memory
8 TB Storage
8 GPU
Spare SCore
94,545
(All-cores)
1,565
(Single-core)

Specifications

Server Metadata

Vendor ID
aws
Name
p4d.24xlarge
Description
GPU accelerated [Instance store volumes] Gen4 24xlarge
Family
p4d
Hw Virt
Status
active
Observed At
2026-09-13T22:55:32.769587

Availability

REGION / IDSPOTONDEMAND
Northern Virgina (US) / us-east-1
16.034725 USD/h 21.9576 USD/h
Ohio (US) / us-east-2
13.317967 USD/h 21.9576 USD/h
Oregon (US) / us-west-2
15.654775 USD/h 21.9576 USD/h
Stockholm (SE) / eu-north-1
2.7209 USD/h 23.7157 USD/h
Dublin (IE) / eu-west-1
16.1412 USD/h 23.7157 USD/h
Quebec (CA) / ca-central-1
17.2174 USD/h 25.2517 USD/h
Mumbai (IN) / ap-south-1
26.3444 USD/h 26.3444 USD/h
Frankfurt (DE) / eu-central-1
21.848167 USD/h 27.433 USD/h
Sydney (AU) / ap-southeast-2
18.05845 USD/h 28.5449 USD/h
London (GB) / eu-west-2
28.5449 USD/h 28.5449 USD/h
Tokyo (JP) / ap-northeast-1
23.10705 USD/h 30.0978 USD/h
Seoul (KR) / ap-northeast-2
9.7275 USD/h 30.4103 USD/h
Sao Paulo (BR) / sa-east-1
29.9466 USD/h 35.5569 USD/h

Processor

vCPUs
96
Hypervisor
nitro
CPU Allocation
Dedicated
CPU Cores
48
CPU Speed
3 GHz
CPU Architecture
x86_64
CPU Manufacturer
Intel
CPU Family
Xeon
CPU Model
8275CL
CPU L1D Cache
32 KiB
CPU L1D Cache Total
2 MiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
2 MiB
CPU L2 Cache
1 MiB
CPU L2 Cache Total
48 MiB
CPU L3 Cache
36 MiB
CPU L3 Cache Total
72 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, ht, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, arch_perfmon, rep_good, nopl, xtopology, nonstop_tsc, cpuid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, tsc_deadline_timer, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, pti, fsgsbase, tsc_adjust, bmi1, avx2, smep, bmi2, erms, invpcid, mpx, avx512f, avx512dq, rdseed, adx, smap, clflushopt, clwb, avx512cd, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, ida, arat, pku, ospke
Ecpus
60.4
Scalability
125.83

System Resources and Accelerators

MEMORY
Memory Amount
1 TB
Memory Amount Actual
1 TB
Memory Generation
DDR4
Memory Speed
3200 Mhz
GPU
GPU Count
8
GPU Memory Min
40 GiB
GPU Memory Total
320 GiB
GPU Manufacturer
NVIDIA
GPU Family
Ampere
GPU Model
A100
GPUs
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
STORAGE
Storage Size
8000 GB
Storage Type
nvme ssd
Storages
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
NETWORK
Network Speed Baseline
100 Gbps
Network Speed Max
100 Gbps
Network Storage Speed Baseline
19 Gbps
Network Storage Speed Max
19 Gbps
Inbound Traffic
0 GB/month
Outbound Traffic
0 GB/month
IPv4
0

Server Description

A high-density GPU instance combining eight accelerators, massive system memory, and high-speed local NVMe storage for parallel computing.

GPU AcceleratedMemory OptimizedStorage & Database

Amazon Web Services p4d.24xlarge is a GPU-accelerated instance built on the AWS Nitro hypervisor. It features 96 vCPUs from Intel Xeon 8275CL processors, 1152.0 GB of DDR4 memory, and eight NVIDIA A100 Ampere GPUs with 320 GB of total VRAM. Storage is supported by 8000 GB of local NVMe SSDs, and networking provides a 100 Gbps baseline. Performance benchmarks highlight strong multi-core capabilities, with a stress-ng multi-core score of 94545.39, and high memory bandwidth. However, single-core performance remains average, and text generation benchmarks show lower relative efficiency. This instance is optimized for high-density compute tasks, making it suitable for machine learning training, large-scale database operations, and parallel scientific computing.

Economics

Average Price per Region

Prices per Zone

Lowest Prices

Performance

Workload Profiles

3Score
Precomputed compound score for Cache Intensive workloads. A weighted average (geometric mean) of benchmark scores compared to their medians: score = ∏ (x_i / m_i)^(w_i / Σw). The score of 1.0 represents a synthetic baseline server with the median performance of each component benchmark; 0.5 means roughly half the performance; and 2.0 means twice the performance of that reference profile. Component weights: 50% Redis RPS (pipeline=1, SET), 20% Redis RPS (pipeline=16, SET), 10% PassMark Memory Mark (composite), 10% Memory bandwidth (read, 16 MB ~ L3), 10% PassMark single-thread CPU. Rationale for component selection: In-memory key-value store workload, mixing direct Redis performance metrics with memory speed and latency benchmarks, and single-core CPU performance profiles.
Component Score Weight Impact
Raw Reference Normalized Target Actual
Redis RPS (pipeline=1, SET) 8,409,312 ops/sec 1,917,397 ops/sec 4.39 50.00% 50.00% +110.00%
Redis RPS (pipeline=16, SET) 47,425,241 ops/sec 11,681,410 ops/sec 4.06 20.00% 20.00% +32.30%
PassMark Memory Mark (composite) 2,734 2,418 1.13 10.00% 10.00% +1.23%
Memory bandwidth (read, 16 MB ~ L3) 230,701 MB/sec 108,140 MB/sec 2.13 10.00% 10.00% +7.85%
PassMark single-thread CPU 2,167 Mops/s 2,365 Mops/s 0.916 10.00% 10.00% -0.87%

Memory Bandwidth

Compression

OpenSSL

Geekbench Single-Core

Score: 1,291

Geekbench Multi-Core

Score: 12,962

Passmark CPU Scores

BENCHMARKSCORE
Mark
 61679
Compression
 1311699
Encryption
 40031
Extended Instructions
 83280
Floating Point Maths
 169655
Integer Maths
 316998
Physics
 5155
Prime Numbers
 354
Single Threaded
 2167
String Sorting
 147376

Passmark Memory Scores

BENCHMARKSCORE
Memory Mark
 2734
Database Operations
 23096
Memory Latency
 52
Memory Read Cached
 26050
Memory Read Uncached
 10259
Memory Write
 9840

Stress-ng Raw Scores

Stress-ng Relative Multicore Performance

LLM Inference Speed for Prompt Processing

LLM Inference Speed for Text Generation

Static Web Server

Redis

Alternatives

Servers of the Same Family

INSTANCEvCPUsMEMORYGPUs

Similar Servers

INSTANCEVENDORvCPUsMEMORYGPUs

p4d.24xlarge FAQs