g5.24xlarge by Amazon Web Services
(All-cores)
(Single-core)
Specifications
Server Metadata
Vendor ID | aws |
Name | g5.24xlarge |
Description | Graphics intensive Gen5 24xlarge |
Family | g5 |
Hw Virt | |
Status | active |
Observed At | 2026-07-11T00:00:56.939220 |
Availability
| REGION / ID | SPOT | ONDEMAND |
|---|---|---|
Ohio (US) / us-east-2 | 2.508667 USD/h | 8.144 USD/h |
Northern Virgina (US) / us-east-1 | 3.72174 USD/h | 8.144 USD/h |
Oregon (US) / us-west-2 | 4.0999 USD/h | 8.144 USD/h |
Stockholm (SE) / eu-north-1 | 2.8178 USD/h | 8.6378 USD/h |
Quebec (CA) / ca-central-1 | 6.5562 USD/h | 9.0426 USD/h |
Dublin (IE) / eu-west-1 | 3.124933 USD/h | 9.0912 USD/h |
Tel Aviv (IL) / il-central-1 | 9.5457 USD/h | 9.5457 USD/h |
Mumbai (IN) / ap-south-1 | 6.3336 USD/h | 9.7793 USD/h |
United Arab Emirates / me-central-1 | 3.9079 USD/h | 9.9898 USD/h |
Seoul (KR) / ap-northeast-2 | 3.924033 USD/h | 10.014 USD/h |
Frankfurt (DE) / eu-central-1 | 6.0636 USD/h | 10.184 USD/h |
London (GB) / eu-west-2 | 10.3379 USD/h | 10.3379 USD/h |
Sydney (AU) / ap-southeast-2 | 10.5888 USD/h | 10.5888 USD/h |
Jakarta (ID) / ap-southeast-3 | 7.3168 USD/h | 11.3984 USD/h |
Tokyo (JP) / ap-northeast-1 | 11.8112 USD/h | 11.8112 USD/h |
Hong Kong (HK) / ap-east-1 | 8.34725 USD/h | 12.5382 USD/h |
Sao Paulo (BR) / sa-east-1 | 11.69005 USD/h | 13.8432 USD/h |
Processor
vCPUs | 96 |
Hypervisor | nitro |
CPU Allocation | Dedicated |
CPU Cores | 48 |
CPU Speed | 3.3 GHz |
CPU Architecture | x86_64 |
CPU Manufacturer | AMD |
CPU Family | EPYC |
CPU Model | 7R32 |
CPU L1D Cache | 32 KiB |
CPU L1D Cache Total | 2 MiB |
CPU L1I Cache | 32 KiB |
CPU L1I Cache Total | 2 MiB |
CPU L2 Cache | 512 KiB |
CPU L2 Cache Total | 24 MiB |
CPU L3 Cache | 16 MiB |
CPU L3 Cache Total | 192 MiB |
CPU Flags | fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ht, syscall, nx, mmxext, fxsr_opt, pdpe1gb, rdtscp, lm, constant_tsc, rep_good, nopl, nonstop_tsc, cpuid, extd_apicid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, sse4_1, sse4_2, movbe, popcnt, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, cmp_legacy, cr8_legacy, abm, sse4a, misalignsse, 3dnowprefetch, topoext, perfctr_core, ssbd, ibrs, ibpb, stibp, vmmcall, fsgsbase, bmi1, avx2, smep, bmi2, rdseed, adx, smap, clflushopt, clwb, sha_ni, xsaveopt, xsavec, xgetbv1, clzero, xsaveerptr, rdpru, wbnoinvd, arat, npt, nrip_save, rdpid |
Ecpus | 48.9 |
Scalability | 101.88 |
System Resources and Accelerators
| MEMORY | |
|---|---|
Memory Amount | 384 GiB |
Memory Amount Actual | 384 GiB |
Memory Generation | DDR4 |
Memory Speed | 3200 Mhz |
| GPU | |
|---|---|
GPU Count | 4 |
GPU Memory Min | 22 GiB |
GPU Memory Total | 89 GiB |
GPU Manufacturer | NVIDIA |
GPU Family | Ampere |
GPU Model | A10G |
GPUs |
|
| STORAGE | |
|---|---|
Storage Size | 3800 GB |
Storage Type | nvme ssd |
Storages |
|
| NETWORK | |
|---|---|
Network Speed Baseline | 50 Gbps |
Network Speed Max | 50 Gbps |
Network Storage Speed Baseline | 19 Gbps |
Network Storage Speed Max | 19 Gbps |
Inbound Traffic | 0 GB/month |
Outbound Traffic | 0 GB/month |
IPv4 | 0 |
CPU and System Topology
Server Description
A high-density GPU instance featuring four NVIDIA Ampere accelerators and local NVMe storage for demanding machine learning and rendering workloads.
Amazon Web Services g5.24xlarge is a GPU-accelerated server instance designed for compute-intensive and graphics-heavy workloads. Powered by the Nitro hypervisor, it features 96 dedicated vCPUs via an AMD EPYC 7R32 processor running at 3.3 GHz, 384.0 GB of DDR4 memory, and 3800 GB of local NVMe SSD storage. The instance integrates four NVIDIA Ampere A10G GPUs with a total of 89 GB of VRAM, delivering top-tier performance in large language model inference and strong results in ray tracing and image processing. While single-core CPU performance is limited, its multi-core capabilities and 50 Gbps baseline network bandwidth provide robust throughput. This server is optimized for machine learning inference, data science, and parallel rendering applications.
Economics
Performance
Workload Profiles
Memory Bandwidth
Compression
OpenSSL
Geekbench Single-Core
Geekbench Multi-Core
Passmark CPU Scores
| BENCHMARK | SCORE |
|---|---|
Mark | 68547 |
Compression | 1368947 |
Encryption | 101562 |
Extended Instructions | 78157 |
Floating Point Maths | 193153 |
Integer Maths | 323582 |
Physics | 6710 |
Prime Numbers | 434 |
Single Threaded | 2093 |
String Sorting | 177391 |
Passmark Memory Scores
| BENCHMARK | SCORE |
|---|---|
Memory Mark | 2901 |
Database Operations | 21621 |
Memory Latency | 52 |
Memory Read Cached | 24182 |
Memory Read Uncached | 12674 |
Memory Write | 13425 |
Stress-ng Raw Scores
Stress-ng Relative Multicore Performance
LLM Inference Speed for Prompt Processing
LLM Inference Speed for Text Generation
Static Web Server
Redis
Alternatives
Servers of the Same Family
| INSTANCE | vCPUs | MEMORY | GPUs |
|---|---|---|---|
| g5.xlarge | 4 | 16 GiB | 1 |
| g5.2xlarge | 8 | 32 GiB | 1 |
| g5.4xlarge | 16 | 64 GiB | 1 |
| g5.8xlarge | 32 | 128 GiB | 1 |
| g5.12xlarge | 48 | 192 GiB | 4 |
| g5.16xlarge | 64 | 256 GiB | 1 |
| g5.48xlarge | 192 | 768 GiB | 8 |
Similar Servers
| INSTANCE | VENDOR | vCPUs | MEMORY | GPUs |
|---|