logo

g7e.24xlarge by Amazon Web Services

g7e.24xlarge is a Graphics intensive [Extra storage or memory] Gen7 24xlarge server offered by Amazon Web Services with 96 vCPUs, 1024 GiB of memory and 7.6 TB of storage. The pricing starts at 2.8803 USD per hour.
96 vCPU
1024 GiB Memory
7.6 TB Storage
4 GPU
Spare SCore
85028
(All-cores)
2107
(Single-core)

Specifications

Server Metadata

Vendor ID
aws
Name
g7e.24xlarge
Description
Graphics intensive [Extra storage or memory] Gen7 24xlarge
Family
g7e
Hw Virt
Status
active
Observed At
2026-08-05T17:56:08.385509

Availability

REGION / IDSPOTONDEMAND
Ohio (US) / us-east-2
6.54505 USD/h 16.5722 USD/h
Northern Virgina (US) / us-east-1
7.67555 USD/h 16.5722 USD/h
Oregon (US) / us-west-2
12.8957 USD/h 16.5722 USD/h
Aragón (ES) / eu-south-2
6.05845 USD/h 17.4627 USD/h
Seoul (KR) / ap-northeast-2
8.042 USD/h 20.3746 USD/h
Stockholm (SE) / eu-north-1
11.37385 USD/h 23.9067 USD/h
Tokyo (JP) / ap-northeast-1
7.43365 USD/h 24.0345 USD/h
Mumbai (IN) / ap-south-1
- 27.0675 USD/h
Frankfurt (DE) / eu-central-1
17.45655 USD/h 28.1818 USD/h
London (GB) / eu-west-2
7.88325 USD/h 28.8034 USD/h

Processor

vCPUs
96
Hypervisor
nitro
CPU Allocation
Dedicated
CPU Cores
48
CPU Speed
2.4 GHz
CPU Architecture
x86_64
CPU Manufacturer
Intel
CPU Family
Xeon
CPU Model
8559C
CPU L1D Cache
48 KiB
CPU L1D Cache Total
2 MiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
2 MiB
CPU L2 Cache
2 MiB
CPU L2 Cache Total
96 MiB
CPU L3 Cache
320 MiB
CPU L3 Cache Total
320 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, ht, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, arch_perfmon, rep_good, nopl, xtopology, nonstop_tsc, cpuid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pdcm, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, tsc_deadline_timer, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, cpuid_fault, ssbd, ibrs, ibpb, stibp, ibrs_enhanced, fsgsbase, tsc_adjust, bmi1, avx2, smep, bmi2, erms, invpcid, avx512f, avx512dq, rdseed, adx, smap, avx512ifma, clflushopt, clwb, avx512cd, sha_ni, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, avx_vnni, avx512_bf16, wbnoinvd, ida, arat, avx512vbmi, umip, pku, ospke, waitpkg, avx512_vbmi2, gfni, vaes, vpclmulqdq, avx512_vnni, avx512_bitalg, tme, avx512_vpopcntdq, rdpid, cldemote, movdiri, movdir64b, md_clear, serialize, amx_bf16, avx512_fp16, amx_tile, amx_int8, flush_l1d, arch_capabilities
Ecpus
40.4
Scalability
84.17

System Resources and Accelerators

MEMORY
Memory Amount
1 TB
Memory Amount Actual
1 TB
Memory Generation
DDR5
Memory Speed
5600 Mhz
GPU
GPU Count
4
GPU Memory Min
96 GiB
GPU Memory Total
384 GiB
GPU Manufacturer
NVIDIA
GPU Family
Blackwell
GPU Model
RTX Pro 6000
GPUs
  • NVIDIA Blackwell NVIDIA RTX PRO 6000 Blackwell Server Edition (Memory amount: 97887, Firmware version: 590.48.01, BIOS version: 98.02.9E.00.03, Clock rate: 2430)
  • NVIDIA Blackwell NVIDIA RTX PRO 6000 Blackwell Server Edition (Memory amount: 97887, Firmware version: 590.48.01, BIOS version: 98.02.9E.00.03, Clock rate: 2430)
  • NVIDIA Blackwell NVIDIA RTX PRO 6000 Blackwell Server Edition (Memory amount: 97887, Firmware version: 590.48.01, BIOS version: 98.02.9E.00.03, Clock rate: 2430)
  • NVIDIA Blackwell NVIDIA RTX PRO 6000 Blackwell Server Edition (Memory amount: 97887, Firmware version: 590.48.01, BIOS version: 98.02.9E.00.03, Clock rate: 2430)
STORAGE
Storage Size
7600 GB
Storage Type
nvme ssd
Storages
  • 3800 GB nvme ssd
  • 3800 GB nvme ssd
NETWORK
Network Speed Baseline
400 Gbps
Network Speed Max
400 Gbps
Network Storage Speed Baseline
50 Gbps
Network Storage Speed Max
50 Gbps
Inbound Traffic
0 GB/month
Outbound Traffic
0 GB/month
IPv4
0

CPU and System Topology

Server Description

Equipped with four Blackwell GPUs, massive DDR5 memory, and local NVMe storage for parallel computing and large-scale model inference.

GPU AcceleratedStorage & DatabaseMemory Optimized

Amazon Web Services g7e.24xlarge is a graphics-intensive instance featuring 96 vCPUs powered by an Intel Xeon 8559C processor, 1024.0 GB of DDR5 memory, and four NVIDIA Blackwell RTX Pro 6000 GPUs with 384 GB of total VRAM. Built on the Nitro hypervisor, it includes 7600 GB of local NVMe SSD storage and 400 Gbps of baseline network bandwidth. The hardware configuration delivers top-tier performance in multi-core processing, ray tracing, and large language model inference, processing 1278.65 tokens per second on a 70B model. While single-core CPU performance is average, the instance offers high resource density for parallel workloads. It is suited for LLM inference, graphics rendering, database operations, and high-throughput web serving.

Economics

Average Price per Region

Prices per Zone

Lowest Prices

Performance

Workload Profiles

4.44Score
Precomputed compound score for Cache Intensive workloads. A weighted average (geometric mean) of benchmark scores compared to their medians: score = ∏ (x_i / m_i)^(w_i / Σw). The score of 1.0 represents a synthetic baseline server with the median performance of each component benchmark; 0.5 means roughly half the performance; and 2.0 means twice the performance of that reference profile. Component weights: 50% Redis RPS (pipeline=1, SET), 20% Redis RPS (pipeline=16, SET), 10% PassMark Memory Mark (composite), 10% Memory bandwidth (read, 16 MB ~ L3), 10% PassMark single-thread CPU. Rationale for component selection: In-memory key-value store workload, mixing direct Redis performance metrics with memory speed and latency benchmarks, and single-core CPU performance profiles.
Component Score Weight Impact
Raw Reference Normalized Target Actual
Redis RPS (pipeline=1, SET) 13,767,200 ops/sec 1,910,660 ops/sec 7.21 50.00% 50.00% +169.00%
Redis RPS (pipeline=16, SET) 71,949,579 ops/sec 11,608,287 ops/sec 6.2 20.00% 20.00% +44.00%
PassMark Memory Mark (composite) 2,810 2,416 1.16 10.00% 10.00% +1.50%
Memory bandwidth (read, 16 MB ~ L3) 280,384 MB/sec 107,896 MB/sec 2.6 10.00% 10.00% +10.00%
PassMark single-thread CPU 3,150 Mops/s 2,364 Mops/s 1.33 10.00% 10.00% +2.89%

Memory Bandwidth

Compression

OpenSSL

Geekbench Single-Core

Score: 2,278

Geekbench Multi-Core

Score: 21,470

Passmark CPU Scores

BENCHMARKSCORE
Mark
91429
Compression
1411004
Encryption
88995
Extended Instructions
99970
Floating Point Maths
288139
Integer Maths
407061
Physics
12618
Prime Numbers
814
Single Threaded
3150
String Sorting
187473

Passmark Memory Scores

BENCHMARKSCORE
Memory Mark
2810
Database Operations
32984
Memory Latency
46
Memory Read Cached
26771
Memory Read Uncached
9247
Memory Write
8894

Stress-ng Raw Scores

Stress-ng Relative Multicore Performance

LLM Inference Speed for Prompt Processing

LLM Inference Speed for Text Generation

Static Web Server

Redis

Alternatives

Servers of the Same Family

INSTANCEvCPUsMEMORYGPUs
g7e.2xlarge 864 GiB1
g7e.4xlarge 16128 GiB1
g7e.8xlarge 32256 GiB1
g7e.12xlarge 48512 GiB2
g7e.48xlarge 1922048 GiB8

Similar Servers

INSTANCEVENDORvCPUsMEMORYGPUs

g7e.24xlarge FAQs