logo

p4d.24xlarge by Amazon Web Services

p4d.24xlarge is a GPU accelerated [Instance store volumes] Gen4 24xlarge server offered by Amazon Web Services with 96 vCPUs, 1152 GiB of memory and 8 TB of storage. The pricing starts at 6.4989 USD per hour.
96 vCPU
1152 GiB Memory
8 TB Storage
8 GPU
Spare SCore
94545
(All-cores)
1565
(Single-core)

Specifications

Server Metadata

Vendor ID
aws
Name
p4d.24xlarge
Description
GPU accelerated [Instance store volumes] Gen4 24xlarge
Family
p4d
Hw Virt
Status
active
Observed At
2026-07-31T07:33:32.579935

Availability

REGION / IDSPOTONDEMAND
Ohio (US) / us-east-2
13.770867 USD/h 21.9576 USD/h
Northern Virgina (US) / us-east-1
16.212125 USD/h 21.9576 USD/h
Oregon (US) / us-west-2
18.091625 USD/h 21.9576 USD/h
Stockholm (SE) / eu-north-1
11.8869 USD/h 23.7157 USD/h
Dublin (IE) / eu-west-1
16.5755 USD/h 23.7157 USD/h
Quebec (CA) / ca-central-1
24.30535 USD/h 25.2517 USD/h
Mumbai (IN) / ap-south-1
26.0734 USD/h 26.3444 USD/h
Frankfurt (DE) / eu-central-1
22.149 USD/h 27.433 USD/h
London (GB) / eu-west-2
17.7767 USD/h 28.5449 USD/h
Sydney (AU) / ap-southeast-2
10.3255 USD/h 28.5449 USD/h
Tokyo (JP) / ap-northeast-1
21.4747 USD/h 30.0978 USD/h
Seoul (KR) / ap-northeast-2
12.75105 USD/h 30.4103 USD/h
Sao Paulo (BR) / sa-east-1
29.4801 USD/h 35.5569 USD/h

Processor

vCPUs
96
Hypervisor
nitro
CPU Allocation
Dedicated
CPU Cores
48
CPU Speed
3 GHz
CPU Architecture
x86_64
CPU Manufacturer
Intel
CPU Family
Xeon
CPU Model
8275CL
CPU L1D Cache
32 KiB
CPU L1D Cache Total
2 MiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
2 MiB
CPU L2 Cache
1 MiB
CPU L2 Cache Total
48 MiB
CPU L3 Cache
36 MiB
CPU L3 Cache Total
72 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, ht, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, arch_perfmon, rep_good, nopl, xtopology, nonstop_tsc, cpuid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, tsc_deadline_timer, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, pti, fsgsbase, tsc_adjust, bmi1, avx2, smep, bmi2, erms, invpcid, mpx, avx512f, avx512dq, rdseed, adx, smap, clflushopt, clwb, avx512cd, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, ida, arat, pku, ospke
Ecpus
60.4
Scalability
125.83

System Resources and Accelerators

MEMORY
Memory Amount
1 TB
Memory Amount Actual
1 TB
Memory Generation
DDR4
Memory Speed
3200 Mhz
GPU
GPU Count
8
GPU Memory Min
40 GiB
GPU Memory Total
320 GiB
GPU Manufacturer
NVIDIA
GPU Family
Ampere
GPU Model
A100
GPUs
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
  • NVIDIA Ampere NVIDIA A100-SXM4-40GB (Memory amount: 40960, Firmware version: 535.183.01, BIOS version: 92.00.36.00.04, Clock rate: 1410)
STORAGE
Storage Size
8000 GB
Storage Type
nvme ssd
Storages
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
  • 1000 GB nvme ssd
NETWORK
Network Speed Baseline
100 Gbps
Network Speed Max
100 Gbps
Network Storage Speed Baseline
19 Gbps
Network Storage Speed Max
19 Gbps
Inbound Traffic
0 GB/month
Outbound Traffic
0 GB/month
IPv4
0

Server Description

A high-density GPU instance combining eight accelerators, massive system memory, and local NVMe storage for parallelized, data-intensive computational workloads.

GPU AcceleratedStorage & DatabaseMemory Optimized

Amazon Web Services p4d.24xlarge is a GPU-accelerated instance built on the Nitro hypervisor, featuring 96 vCPUs from Intel Xeon 8275CL processors at 3.0 GHz and 1152.0 GB of DDR4 memory. It integrates eight NVIDIA Ampere A100 GPUs with 320 GB of total VRAM, alongside 8000 GB of local NVMe SSD storage and 100 Gbps baseline network bandwidth. Benchmarks show strong multi-core CPU performance, high memory bandwidth, and rapid database operations, including 78.21 million Redis SET operations per second. However, single-core processing and LLM text generation speeds are comparatively moderate to weak. This instance is configured for parallelized GPU workloads, high-throughput database systems, and multi-threaded computational tasks.

Economics

Average Price per Region

Prices per Zone

Lowest Prices

Performance

Workload Profiles

3.03Score
Precomputed compound score for Cache Intensive workloads. A weighted average (geometric mean) of benchmark scores compared to their medians: score = ∏ (x_i / m_i)^(w_i / Σw). The score of 1.0 represents a synthetic baseline server with the median performance of each component benchmark; 0.5 means roughly half the performance; and 2.0 means twice the performance of that reference profile. Component weights: 50% Redis RPS (pipeline=1, SET), 20% Redis RPS (pipeline=16, SET), 10% PassMark Memory Mark (composite), 10% Memory bandwidth (read, 16 MB ~ L3), 10% PassMark single-thread CPU. Rationale for component selection: In-memory key-value store workload, mixing direct Redis performance metrics with memory speed and latency benchmarks, and single-core CPU performance profiles.
Component Score Weight Impact
Raw Reference Normalized Target Actual
Redis RPS (pipeline=1, SET) 8,409,312 ops/sec 1,896,415 ops/sec 4.43 50.00% 50.00% +110.00%
Redis RPS (pipeline=16, SET) 47,425,241 ops/sec 11,539,523 ops/sec 4.11 20.00% 20.00% +32.70%
PassMark Memory Mark (composite) 2,734 2,411 1.13 10.00% 10.00% +1.23%
Memory bandwidth (read, 16 MB ~ L3) 230,701 MB/sec 107,368 MB/sec 2.15 10.00% 10.00% +7.96%
PassMark single-thread CPU 2,167 Mops/s 2,363 Mops/s 0.917 10.00% 10.00% -0.86%

Memory Bandwidth

Compression

OpenSSL

Geekbench Single-Core

Score: 1,291

Geekbench Multi-Core

Score: 12,962

Passmark CPU Scores

BENCHMARKSCORE
Mark
 61679
Compression
 1311699
Encryption
 40031
Extended Instructions
 83280
Floating Point Maths
 169655
Integer Maths
 316998
Physics
 5155
Prime Numbers
 354
Single Threaded
 2167
String Sorting
 147376

Passmark Memory Scores

BENCHMARKSCORE
Memory Mark
 2734
Database Operations
 23096
Memory Latency
 52
Memory Read Cached
 26050
Memory Read Uncached
 10259
Memory Write
 9840

Stress-ng Raw Scores

Stress-ng Relative Multicore Performance

LLM Inference Speed for Prompt Processing

LLM Inference Speed for Text Generation

Static Web Server

Redis

Alternatives

Servers of the Same Family

INSTANCEvCPUsMEMORYGPUs

Similar Servers

INSTANCEVENDORvCPUsMEMORYGPUs

p4d.24xlarge FAQs