p4d.24xlarge by Amazon Web Services

p4d.24xlarge is a GPU accelerated [Instance store volumes] Gen4 24xlarge server offered by Amazon Web Services with 96 vCPUs, 1152 GiB of memory and 8 TB of storage. The pricing starts at 3.0954 USD per hour.
96 vCPU
1152 GiB Memory
8 TB Storage
8 GPU
Spare SCore
94,545
(All-cores)
1,565
(Single-core)

Specifications

Server Metadata

Vendor ID
aws
Name
p4d.24xlarge
Description
GPU accelerated [Instance store volumes] Gen4 24xlarge
Family
p4d
Hw Virt
Status
active
Observed At
2026-10-28T23:25:16.782967

Availability

REGION / IDSPOTONDEMAND
Ohio (US) / us-east-2
10.182533 USD/h 21.9576 USD/h
Oregon (US) / us-west-2
14.157475 USD/h 21.9576 USD/h
Northern Virgina (US) / us-east-1
18.55275 USD/h 21.9576 USD/h
Stockholm (SE) / eu-north-1
7.0369 USD/h 23.7157 USD/h
Dublin (IE) / eu-west-1
16.065 USD/h 23.7157 USD/h
Quebec (CA) / ca-central-1
14.49045 USD/h 25.2517 USD/h
Mumbai (IN) / ap-south-1
26.3444 USD/h 26.3444 USD/h
Frankfurt (DE) / eu-central-1
22.189567 USD/h 27.433 USD/h
London (GB) / eu-west-2
19.098 USD/h 28.5449 USD/h
Sydney (AU) / ap-southeast-2
20.00225 USD/h 28.5449 USD/h
Tokyo (JP) / ap-northeast-1
20.003 USD/h 30.0978 USD/h
Seoul (KR) / ap-northeast-2
10.66055 USD/h 30.4103 USD/h
Sao Paulo (BR) / sa-east-1
28.9166 USD/h 35.5569 USD/h

Processor

vCPUs
96
Hypervisor
nitro
CPU Allocation
Dedicated
CPU Cores
48
CPU Speed
3 GHz
CPU Architecture
x86_64
CPU Manufacturer
Intel
CPU Family
Xeon
CPU Model
8275CL
CPU L1D Cache
32 KiB
CPU L1D Cache Total
2 MiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
2 MiB
CPU L2 Cache
1 MiB
CPU L2 Cache Total
48 MiB
CPU L3 Cache
36 MiB
CPU L3 Cache Total
72 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, ht, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, arch_perfmon, rep_good, nopl, xtopology, nonstop_tsc, cpuid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, tsc_deadline_timer, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, pti, fsgsbase, tsc_adjust, bmi1, avx2, smep, bmi2, erms, invpcid, mpx, avx512f, avx512dq, rdseed, adx, smap, clflushopt, clwb, avx512cd, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, ida, arat, pku, ospke
Ecpus
60.4
Scalability
62.92

System Resources and Accelerators

MEMORY
Memory Amount
1 TB
Memory Amount Actual
1 TB
Memory Generation
DDR4
Memory Speed
3200 Mhz
ACCELERATORS
Accelerator Count
8
Accelerator Memory Min
40 GiB
Accelerator Memory Total
320 GiB
Accelerator Type
GPU
Accelerator Manufacturer
NVIDIA
Accelerator Family
Ampere
Accelerator Model
A100
Accelerators
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
STORAGE
Storage Size
8000 GB
Storage Type
nvme ssd
Storages
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
NETWORK
Network Speed Baseline
100 Gbps
Network Speed Max
100 Gbps
Network Storage Speed Baseline
19 Gbps
Network Storage Speed Max
19 Gbps
Inbound Traffic
0 GB/month
Outbound Traffic
0 GB/month
IPv4
0

Server Description

A high-density GPU instance combining eight accelerators, massive system memory, and high-speed local NVMe storage for parallel computing.

GPU AcceleratedMemory OptimizedStorage & Database

Amazon Web Services p4d.24xlarge is a GPU-accelerated instance built on the AWS Nitro hypervisor. It features 96 vCPUs from Intel Xeon 8275CL processors, 1152.0 GB of DDR4 memory, and eight NVIDIA A100 Ampere GPUs with 320 GB of total VRAM. Storage is supported by 8000 GB of local NVMe SSDs, and networking provides a 100 Gbps baseline. Performance benchmarks highlight strong multi-core capabilities, with a stress-ng multi-core score of 94545.39, and high memory bandwidth. However, single-core performance remains average, and text generation benchmarks show lower relative efficiency. This instance is optimized for high-density compute tasks, making it suitable for machine learning training, large-scale database operations, and parallel scientific computing.

Economics

Average Price per Region

Prices per Zone

Lowest Prices

Performance

Workload Profiles

3Score
Precomputed compound score for Cache Intensive workloads. A weighted average (geometric mean) of benchmark scores compared to their medians: score = ∏ (x_i / m_i)^(w_i / Σw). The score of 1.0 represents a synthetic baseline server with the median performance of each component benchmark; 0.5 means roughly half the performance; and 2.0 means twice the performance of that reference profile. Component weights: 50% Redis RPS (pipeline=1, SET), 20% Redis RPS (pipeline=16, SET), 10% PassMark Memory Mark (composite), 10% Memory bandwidth (read, 16 MB ~ L3), 10% PassMark single-thread CPU. Rationale for component selection: In-memory key-value store workload, mixing direct Redis performance metrics with memory speed and latency benchmarks, and single-core CPU performance profiles.
Component Score Weight Impact
Raw Reference Normalized Target Actual
Redis RPS (pipeline=1, SET) 8,409,312 ops/sec 1,919,289 ops/sec 4.4 50.00% 50.00% +110.00%
Redis RPS (pipeline=16, SET) 47,425,241 ops/sec 11,728,058 ops/sec 3.9 20.00% 20.00% +31.00%
PassMark Memory Mark (composite) 2,734 2,416 1.1 10.00% 10.00% +0.96%
Memory bandwidth (read, 16 MB ~ L3) 230,701 MB/sec 108,466 MB/sec 2.1 10.00% 10.00% +7.70%
PassMark single-thread CPU 2,167 Mops/s 2,365 Mops/s 0.92 10.00% 10.00% -0.83%

Memory Bandwidth

Compression

OpenSSL

Geekbench Single-Core

Score: 1,291

Geekbench Multi-Core

Score: 12,962

Passmark CPU Scores

BENCHMARKSCORE
Mark
61,679
Compression
1,311,699
Encryption
40,031
Extended Instructions
83,280
Floating Point Maths
169,655
Integer Maths
316,998
Physics
5,155
Prime Numbers
354
Single Threaded
2,167
String Sorting
147,376

Passmark Memory Scores

BENCHMARKSCORE
Memory Mark
2,734
Database Operations
23,096
Memory Latency
52
Memory Read Cached
26,050
Memory Read Uncached
10,259
Memory Write
9,840

Stress-ng Raw Scores

Stress-ng Relative Multicore Performance

LLM Inference Speed for Prompt Processing

LLM Inference Speed for Text Generation

Static Web Server

Redis

Alternatives

Servers of the Same Family

INSTANCEvCPUsMEMORYAccelerators

Similar Servers

INSTANCEVENDORvCPUsMEMORYAccelerators

p4d.24xlarge FAQs