logo

p3dn.24xlarge by Amazon Web Services

p3dn.24xlarge is a GPU accelerated [Instance store volumes] [Network and EBS optimized] Gen3 24xlarge server offered by Amazon Web Services with 96 vCPUs, 768 GiB of memory and 1.8 TB of storage. The pricing starts at 5.2071 USD per hour.
96 vCPU
768 GiB Memory
1.8 TB Storage
8 GPU
Spare SCore
80919
(All-cores)
1379
(Single-core)

Specifications

Server Metadata

Vendor ID
aws
Name
p3dn.24xlarge
Description
GPU accelerated [Instance store volumes] [Network and EBS optimized] Gen3 24xlarge
Family
p3dn
Hw Virt
Status
active
Observed At
2026-07-25T07:02:16.668620

Availability

REGION / IDSPOTONDEMAND
Northern Virgina (US) / us-east-1
5.31705 USD/h 31.212 USD/h
Oregon (US) / us-west-2
6.80805 USD/h 31.212 USD/h
Dublin (IE) / eu-west-1
8.5002 USD/h 33.711 USD/h
Tokyo (JP) / ap-northeast-1
22.9777 USD/h 42.783 USD/h

Processor

vCPUs
96
Hypervisor
nitro
CPU Allocation
Dedicated
CPU Cores
48
CPU Speed
2.5 GHz
CPU Architecture
x86_64
CPU Manufacturer
Intel
CPU Family
Xeon
CPU Model
8175M
CPU L1D Cache
32 KiB
CPU L1D Cache Total
2 MiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
2 MiB
CPU L2 Cache
1 MiB
CPU L2 Cache Total
48 MiB
CPU L3 Cache
33 MiB
CPU L3 Cache Total
66 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, ht, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, arch_perfmon, rep_good, nopl, xtopology, nonstop_tsc, cpuid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, tsc_deadline_timer, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, pti, fsgsbase, tsc_adjust, bmi1, avx2, smep, bmi2, erms, invpcid, mpx, avx512f, avx512dq, rdseed, adx, smap, clflushopt, clwb, avx512cd, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, ida, arat, pku, ospke
Ecpus
58.7
Scalability
122.29

System Resources and Accelerators

MEMORY
Memory Amount
768 GiB
Memory Amount Actual
768 GiB
Memory Generation
DDR4
Memory Speed
2666 Mhz
GPU
GPU Count
8
GPU Memory Min
32 GiB
GPU Memory Total
256 GiB
GPU Manufacturer
NVIDIA
GPU Family
Volta
GPU Model
V100
GPUs
  • NVIDIA Volta Tesla V100-SXM2-32GB (Memory amount: 32768, BIOS version: 88.00.8F.00.0F, Clock rate: 1530)
  • NVIDIA Volta Tesla V100-SXM2-32GB (Memory amount: 32768, BIOS version: 88.00.8F.00.0F, Clock rate: 1530)
  • NVIDIA Volta Tesla V100-SXM2-32GB (Memory amount: 32768, BIOS version: 88.00.8F.00.0F, Clock rate: 1530)
  • NVIDIA Volta Tesla V100-SXM2-32GB (Memory amount: 32768, BIOS version: 88.00.8F.00.0F, Clock rate: 1530)
  • NVIDIA Volta Tesla V100-SXM2-32GB (Memory amount: 32768, BIOS version: 88.00.8F.00.0F, Clock rate: 1530)
  • NVIDIA Volta Tesla V100-SXM2-32GB (Memory amount: 32768, BIOS version: 88.00.8F.00.0F, Clock rate: 1530)
  • NVIDIA Volta Tesla V100-SXM2-32GB (Memory amount: 32768, BIOS version: 88.00.8F.00.0F, Clock rate: 1530)
  • NVIDIA Volta Tesla V100-SXM2-32GB (Memory amount: 32768, BIOS version: 88.00.8F.00.0F, Clock rate: 1530)
STORAGE
Storage Size
1800 GB
Storage Type
nvme ssd
Storages
  • 900 GB nvme ssd
  • 900 GB nvme ssd
NETWORK
Network Speed Baseline
100 Gbps
Network Speed Max
100 Gbps
Network Storage Speed Baseline
19 Gbps
Network Storage Speed Max
19 Gbps
Inbound Traffic
0 GB/month
Outbound Traffic
0 GB/month
IPv4
0

CPU and System Topology

Server Description

A GPU-accelerated platform combining eight accelerators, massive memory bandwidth, and high-speed networking for parallelized machine learning workloads.

GPU AcceleratedMemory OptimizedStorage & Database

Amazon Web Services p3dn.24xlarge is a GPU-accelerated instance featuring 96 vCPUs from an Intel Xeon 8175M processor, 768.0 GB of DDR4 RAM, and eight NVIDIA Volta V100 GPUs with 256 GB of total VRAM. Built on the Nitro hypervisor, it includes 1800 GB of local NVMe SSD storage and a 100 Gbps network interface. While single-core CPU benchmarks are weak, the instance delivers strong multi-core CPU performance and top-tier LLM inference speeds, processing 144.96 tokens/sec for large 70B models. This high resource density makes it highly effective for parallel processing but less efficient for single-threaded tasks. It is designed for deep learning, large-scale machine learning inference, and high-performance computing workloads.

Economics

Average Price per Region

Prices per Zone

Lowest Prices

Performance

Workload Profiles

2.91Score
Precomputed compound score for Cache Intensive workloads. A weighted average (geometric mean) of benchmark scores compared to their medians: score = ∏ (x_i / m_i)^(w_i / Σw). The score of 1.0 represents a synthetic baseline server with the median performance of each component benchmark; 0.5 means roughly half the performance; and 2.0 means twice the performance of that reference profile. Component weights: 50% Redis RPS (pipeline=1, SET), 20% Redis RPS (pipeline=16, SET), 10% PassMark Memory Mark (composite), 10% Memory bandwidth (read, 16 MB ~ L3), 10% PassMark single-thread CPU. Rationale for component selection: In-memory key-value store workload, mixing direct Redis performance metrics with memory speed and latency benchmarks, and single-core CPU performance profiles.
Component Score Weight Impact
Raw Reference Normalized Target Actual
Redis RPS (pipeline=1, SET) 8,097,875 ops/sec 1,896,415 ops/sec 4.27 50.00% 50.00% +107.00%
Redis RPS (pipeline=16, SET) 45,826,060 ops/sec 11,539,523 ops/sec 3.97 20.00% 20.00% +31.80%
PassMark Memory Mark (composite) 2,694 2,411 1.12 10.00% 10.00% +1.14%
Memory bandwidth (read, 16 MB ~ L3) 225,301 MB/sec 107,368 MB/sec 2.1 10.00% 10.00% +7.70%
PassMark single-thread CPU 1,959 Mops/s 2,363 Mops/s 0.829 10.00% 10.00% -1.86%

Memory Bandwidth

Compression

OpenSSL

Geekbench Single-Core

Score: 1,156

Geekbench Multi-Core

Score: 11,798

Passmark CPU Scores

BENCHMARKSCORE
Mark
 55736
Compression
 1182319
Encryption
 37026
Extended Instructions
 74975
Floating Point Maths
 145201
Integer Maths
 271254
Physics
 5013
Prime Numbers
 340
Single Threaded
 1959
String Sorting
 136905

Passmark Memory Scores

BENCHMARKSCORE
Memory Mark
 2694
Database Operations
 21503
Memory Latency
 53
Memory Read Cached
 23522
Memory Read Uncached
 10587
Memory Write
 10168

Stress-ng Raw Scores

Stress-ng Relative Multicore Performance

LLM Inference Speed for Prompt Processing

LLM Inference Speed for Text Generation

Static Web Server

Redis

Alternatives

Servers of the Same Family

INSTANCEvCPUsMEMORYGPUs

Similar Servers

INSTANCEVENDORvCPUsMEMORYGPUs

p3dn.24xlarge FAQs