logo

g5.24xlarge by Amazon Web Services

g5.24xlarge is a Graphics intensive Gen5 24xlarge server offered by Amazon Web Services with 96 vCPUs, 384 GiB of memory and 3.8 TB of storage. The pricing starts at 1.6698 USD per hour.
96 vCPU
384 GiB Memory
3.8 TB Storage
4 GPU
Spare SCore
36855
(All-cores)
753
(Single-core)

Specifications

Server Metadata

Vendor ID
aws
Name
g5.24xlarge
Description
Graphics intensive Gen5 24xlarge
Family
g5
Hw Virt
Status
active
Observed At
2026-07-11T00:00:56.939220

Availability

REGION / IDSPOTONDEMAND
Ohio (US) / us-east-2
2.508667 USD/h 8.144 USD/h
Northern Virgina (US) / us-east-1
3.72174 USD/h 8.144 USD/h
Oregon (US) / us-west-2
4.0999 USD/h 8.144 USD/h
Stockholm (SE) / eu-north-1
2.8178 USD/h 8.6378 USD/h
Quebec (CA) / ca-central-1
6.5562 USD/h 9.0426 USD/h
Dublin (IE) / eu-west-1
3.124933 USD/h 9.0912 USD/h
Tel Aviv (IL) / il-central-1
9.5457 USD/h 9.5457 USD/h
Mumbai (IN) / ap-south-1
6.3336 USD/h 9.7793 USD/h
United Arab Emirates / me-central-1
3.9079 USD/h 9.9898 USD/h
Seoul (KR) / ap-northeast-2
3.924033 USD/h 10.014 USD/h
Frankfurt (DE) / eu-central-1
6.0636 USD/h 10.184 USD/h
London (GB) / eu-west-2
10.3379 USD/h 10.3379 USD/h
Sydney (AU) / ap-southeast-2
10.5888 USD/h 10.5888 USD/h
Jakarta (ID) / ap-southeast-3
7.3168 USD/h 11.3984 USD/h
Tokyo (JP) / ap-northeast-1
11.8112 USD/h 11.8112 USD/h
Hong Kong (HK) / ap-east-1
8.34725 USD/h 12.5382 USD/h
Sao Paulo (BR) / sa-east-1
11.69005 USD/h 13.8432 USD/h

Processor

vCPUs
96
Hypervisor
nitro
CPU Allocation
Dedicated
CPU Cores
48
CPU Speed
3.3 GHz
CPU Architecture
x86_64
CPU Manufacturer
AMD
CPU Family
EPYC
CPU Model
7R32
CPU L1D Cache
32 KiB
CPU L1D Cache Total
2 MiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
2 MiB
CPU L2 Cache
512 KiB
CPU L2 Cache Total
24 MiB
CPU L3 Cache
16 MiB
CPU L3 Cache Total
192 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ht, syscall, nx, mmxext, fxsr_opt, pdpe1gb, rdtscp, lm, constant_tsc, rep_good, nopl, nonstop_tsc, cpuid, extd_apicid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, sse4_1, sse4_2, movbe, popcnt, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, cmp_legacy, cr8_legacy, abm, sse4a, misalignsse, 3dnowprefetch, topoext, perfctr_core, ssbd, ibrs, ibpb, stibp, vmmcall, fsgsbase, bmi1, avx2, smep, bmi2, rdseed, adx, smap, clflushopt, clwb, sha_ni, xsaveopt, xsavec, xgetbv1, clzero, xsaveerptr, rdpru, wbnoinvd, arat, npt, nrip_save, rdpid
Ecpus
48.9
Scalability
101.88

System Resources and Accelerators

MEMORY
Memory Amount
384 GiB
Memory Amount Actual
384 GiB
Memory Generation
DDR4
Memory Speed
3200 Mhz
GPU
GPU Count
4
GPU Memory Min
22 GiB
GPU Memory Total
89 GiB
GPU Manufacturer
NVIDIA
GPU Family
Ampere
GPU Model
A10G
GPUs
  • NVIDIA Ampere NVIDIA A10G (Memory amount: 23028, Firmware version: 590.48.01, BIOS version: 94.02.75.00.01, Clock rate: 1710)
  • NVIDIA Ampere NVIDIA A10G (Memory amount: 23028, Firmware version: 590.48.01, BIOS version: 94.02.75.00.01, Clock rate: 1710)
  • NVIDIA Ampere NVIDIA A10G (Memory amount: 23028, Firmware version: 590.48.01, BIOS version: 94.02.75.00.01, Clock rate: 1710)
  • NVIDIA Ampere NVIDIA A10G (Memory amount: 23028, Firmware version: 590.48.01, BIOS version: 94.02.75.00.01, Clock rate: 1710)
STORAGE
Storage Size
3800 GB
Storage Type
nvme ssd
Storages
  • 3800 GB nvme ssd
NETWORK
Network Speed Baseline
50 Gbps
Network Speed Max
50 Gbps
Network Storage Speed Baseline
19 Gbps
Network Storage Speed Max
19 Gbps
Inbound Traffic
0 GB/month
Outbound Traffic
0 GB/month
IPv4
0

CPU and System Topology

Server Description

A high-density GPU instance featuring four NVIDIA Ampere accelerators and local NVMe storage for demanding machine learning and rendering workloads.

GPU AcceleratedCompute OptimizedStorage & Database

Amazon Web Services g5.24xlarge is a GPU-accelerated server instance designed for compute-intensive and graphics-heavy workloads. Powered by the Nitro hypervisor, it features 96 dedicated vCPUs via an AMD EPYC 7R32 processor running at 3.3 GHz, 384.0 GB of DDR4 memory, and 3800 GB of local NVMe SSD storage. The instance integrates four NVIDIA Ampere A10G GPUs with a total of 89 GB of VRAM, delivering top-tier performance in large language model inference and strong results in ray tracing and image processing. While single-core CPU performance is limited, its multi-core capabilities and 50 Gbps baseline network bandwidth provide robust throughput. This server is optimized for machine learning inference, data science, and parallel rendering applications.

Economics

Average Price per Region

Prices per Zone

Lowest Prices

Performance

Workload Profiles

Memory Bandwidth

Compression

OpenSSL

Geekbench Single-Core

Score: 1,310

Geekbench Multi-Core

Score: 14,734

Passmark CPU Scores

BENCHMARKSCORE
Mark
68547
Compression
1368947
Encryption
101562
Extended Instructions
78157
Floating Point Maths
193153
Integer Maths
323582
Physics
6710
Prime Numbers
434
Single Threaded
2093
String Sorting
177391

Passmark Memory Scores

BENCHMARKSCORE
Memory Mark
2901
Database Operations
21621
Memory Latency
52
Memory Read Cached
24182
Memory Read Uncached
12674
Memory Write
13425

Stress-ng Raw Scores

Stress-ng Relative Multicore Performance

LLM Inference Speed for Prompt Processing

LLM Inference Speed for Text Generation

Static Web Server

Redis

Alternatives

Servers of the Same Family

INSTANCEvCPUsMEMORYGPUs
g5.xlarge 416 GiB1
g5.2xlarge 832 GiB1
g5.4xlarge 1664 GiB1
g5.8xlarge 32128 GiB1
g5.12xlarge 48192 GiB4
g5.16xlarge 64256 GiB1
g5.48xlarge 192768 GiB8

Similar Servers

INSTANCEVENDORvCPUsMEMORYGPUs

g5.24xlarge FAQs