g7e.24xlarge by Amazon Web Services

g7e.24xlarge is a Graphics intensive [Extra storage or memory] Gen7 24xlarge server offered by Amazon Web Services with 96 vCPUs, 1024 GiB of memory and 7.6 TB of storage. The pricing starts at 5.0839 USD per hour.
96 vCPU
1024 GiB Memory
7.6 TB Storage
4 GPU
Spare SCore
85,028
(All-cores)
2,107
(Single-core)

Specifications

Server Metadata

Vendor ID
aws
Name
g7e.24xlarge
Description
Graphics intensive [Extra storage or memory] Gen7 24xlarge
Family
g7e
Hw Virt
Status
active
Observed At
2026-11-04T00:05:29.044816

Availability

REGION / IDSPOTONDEMAND
Northern Virgina (US) / us-east-1
8.179 USD/h 16.5722 USD/h
Ohio (US) / us-east-2
8.971867 USD/h 16.5722 USD/h
Oregon (US) / us-west-2
12.4029 USD/h 16.5722 USD/h
Aragón (ES) / eu-south-2
10.9164 USD/h 17.4627 USD/h
Seoul (KR) / ap-northeast-2
18.3371 USD/h 20.3746 USD/h
Stockholm (SE) / eu-north-1
11.5985 USD/h 23.9067 USD/h
Tokyo (JP) / ap-northeast-1
16.2233 USD/h 24.0345 USD/h
Mumbai (IN) / ap-south-1
27.0675 USD/h 27.0675 USD/h
Frankfurt (DE) / eu-central-1
21.15095 USD/h 28.1818 USD/h
(MY) / ap-southeast-5
- 28.3911 USD/h
(TH) / ap-southeast-7
- 28.3911 USD/h
London (GB) / eu-west-2
9.29495 USD/h 28.8034 USD/h
Jakarta (ID) / ap-southeast-3
14.6505 USD/h 31.5485 USD/h

Processor

vCPUs
96
Hypervisor
nitro
CPU Allocation
Dedicated
CPU Cores
48
CPU Speed
2.4 GHz
CPU Architecture
x86_64
CPU Manufacturer
Intel
CPU Family
Xeon
CPU Model
8559C
CPU L1D Cache
48 KiB
CPU L1D Cache Total
2 MiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
2 MiB
CPU L2 Cache
2 MiB
CPU L2 Cache Total
96 MiB
CPU L3 Cache
320 MiB
CPU L3 Cache Total
320 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, ht, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, arch_perfmon, rep_good, nopl, xtopology, nonstop_tsc, cpuid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pdcm, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, tsc_deadline_timer, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, cpuid_fault, ssbd, ibrs, ibpb, stibp, ibrs_enhanced, fsgsbase, tsc_adjust, bmi1, avx2, smep, bmi2, erms, invpcid, avx512f, avx512dq, rdseed, adx, smap, avx512ifma, clflushopt, clwb, avx512cd, sha_ni, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, avx_vnni, avx512_bf16, wbnoinvd, ida, arat, avx512vbmi, umip, pku, ospke, waitpkg, avx512_vbmi2, gfni, vaes, vpclmulqdq, avx512_vnni, avx512_bitalg, tme, avx512_vpopcntdq, rdpid, cldemote, movdiri, movdir64b, md_clear, serialize, amx_bf16, avx512_fp16, amx_tile, amx_int8, flush_l1d, arch_capabilities
Ecpus
40.4
Scalability
42.08

System Resources and Accelerators

MEMORY
Memory Amount
1 TB
Memory Amount Actual
1 TB
Memory Generation
DDR5
Memory Speed
5600 Mhz
ACCELERATORS
Accelerator Count
4
Accelerator Memory Min
96 GiB
Accelerator Memory Total
384 GiB
Accelerator Type
GPU
Accelerator Manufacturer
NVIDIA
Accelerator Family
Blackwell
Accelerator Model
RTX PRO 6000
Accelerators
  • NVIDIA Blackwell NVIDIA RTX PRO 6000 Blackwell Server Edition (Memory amount: 97887, Firmware version: 590.48.01, BIOS version: 98.02.9E.00.03, Clock rate: 2430)
  • NVIDIA Blackwell NVIDIA RTX PRO 6000 Blackwell Server Edition (Memory amount: 97887, Firmware version: 590.48.01, BIOS version: 98.02.9E.00.03, Clock rate: 2430)
  • NVIDIA Blackwell NVIDIA RTX PRO 6000 Blackwell Server Edition (Memory amount: 97887, Firmware version: 590.48.01, BIOS version: 98.02.9E.00.03, Clock rate: 2430)
  • NVIDIA Blackwell NVIDIA RTX PRO 6000 Blackwell Server Edition (Memory amount: 97887, Firmware version: 590.48.01, BIOS version: 98.02.9E.00.03, Clock rate: 2430)
STORAGE
Storage Size
7600 GB
Storage Type
nvme ssd
Storages
  • 3800 GB nvme ssd
  • 3800 GB nvme ssd
NETWORK
Network Speed Baseline
400 Gbps
Network Speed Max
400 Gbps
Network Storage Speed Baseline
50 Gbps
Network Storage Speed Max
50 Gbps
Inbound Traffic
0 GB/month
Outbound Traffic
0 GB/month
IPv4
0

CPU and System Topology

Server Description

High-density GPU server featuring four NVIDIA Blackwell GPUs, 1 TB DDR5 memory, and high-speed local NVMe storage for enterprise AI workloads.

GPU AcceleratedMemory OptimizedStorage & Database

Amazon Web Services g7e.24xlarge is a Nitro-based server engineered for intensive accelerated workloads and memory-heavy compute tasks. Powered by an Intel Xeon 8559C processor with 48 physical cores and 96 vCPUs at 2.4 GHz, it features 1024 GB of DDR5 memory and 7600 GB of NVMe SSD storage. Acceleration is handled by four NVIDIA Blackwell RTX PRO 6000 GPUs offering 384 GB of VRAM. High-bandwidth networking reaches 400 Gbps baseline speed. Benchmark results place this instance in the top tier for multi-core CPU execution, ray tracing, static web serving, and large language model inference, achieving 1278.65 prompt tokens per second on a 70B model. The high memory density and dedicated GPU configuration present strong qualitative cost efficiency for resource-intensive artificial intelligence, deep learning, database management, and graphics processing pipelines.

Economics

Average Price per Region

Prices per Zone

Lowest Prices

Performance

Workload Profiles

4.5Score
Precomputed compound score for Cache Intensive workloads. A weighted average (geometric mean) of benchmark scores compared to their medians: score = ∏ (x_i / m_i)^(w_i / Σw). The score of 1.0 represents a synthetic baseline server with the median performance of each component benchmark; 0.5 means roughly half the performance; and 2.0 means twice the performance of that reference profile. Component weights: 50% Redis RPS (pipeline=1, SET), 20% Redis RPS (pipeline=16, SET), 10% PassMark Memory Mark (composite), 10% Memory bandwidth (read, 16 MB ~ L3), 10% PassMark single-thread CPU. Rationale for component selection: In-memory key-value store workload, mixing direct Redis performance metrics with memory speed and latency benchmarks, and single-core CPU performance profiles.
Component Score Weight Impact
Raw Reference Normalized Target Actual
Redis RPS (pipeline=1, SET) 13,767,200 ops/sec 1,930,206 ops/sec 7.4 50.00% 50.00% +170.00%
Redis RPS (pipeline=16, SET) 71,949,579 ops/sec 11,792,140 ops/sec 6 20.00% 20.00% +43.00%
PassMark Memory Mark (composite) 2,810 2,412 1.2 10.00% 10.00% +1.80%
Memory bandwidth (read, 16 MB ~ L3) 280,384 MB/sec 108,490 MB/sec 2.5 10.00% 10.00% +9.60%
PassMark single-thread CPU 3,150 Mops/s 2,365 Mops/s 1.3 10.00% 10.00% +2.70%

GPU Bandwidth and Latency

Node (all GPUs)
Node baseline directional bandwidth
88.6 GB/s
Node GPU-to-host bandwidth
114.3 GB/s
Node host-to-GPU bandwidth
111.4 GB/s
Peer-to-peer
GPU-to-GPU P2P duplex bandwidth
52.3 GB/s
GPU-to-GPU P2P gather bandwidth
54.2 GB/s
GPU-to-GPU P2P latency
1,100 ns
GPU-to-GPU P2P bandwidth
54.2 GB/s
Single GPU slot
Per-GPU GPU-to-host bandwidth
57.2 GB/s
Per-GPU host-to-GPU bandwidth
55.6 GB/s
Per-GPU host-device latency
1,024 ns
Per-GPU device memory copy bandwidth
728.7 GB/s
Benchmark Environment
Driver Version
 590.48.01
CUDA Version (driver)
 13.1
nvbandwidth Version
 v0.8
GPU Count
 4
P2P Supported
Yes
Efficiency
SM/CE copy efficiency
0.93

Memory Bandwidth

Compression

OpenSSL

Geekbench Single-Core

Score: 2,278

Geekbench Multi-Core

Score: 21,470

Passmark CPU Scores

BENCHMARKSCORE
Mark
 91,429
Compression
 1,411,004
Encryption
 88,995
Extended Instructions
 99,970
Floating Point Maths
 288,139
Integer Maths
 407,061
Physics
 12,618
Prime Numbers
 814
Single Threaded
 3,150
String Sorting
 187,473

Passmark Memory Scores

BENCHMARKSCORE
Memory Mark
 2,810
Database Operations
 32,984
Memory Latency
 46
Memory Read Cached
 26,771
Memory Read Uncached
 9,247
Memory Write
 8,894

Stress-ng Raw Scores

Stress-ng Relative Multicore Performance

LLM Inference Speed for Prompt Processing

LLM Inference Speed for Text Generation

Static Web Server

Redis

Alternatives

Servers of the Same Family

INSTANCEvCPUsMEMORYAccelerators
g7e.2xlarge 864 GiB1
g7e.4xlarge 16128 GiB1
g7e.8xlarge 32256 GiB1
g7e.12xlarge 48512 GiB2
g7e.48xlarge 1922048 GiB8

Similar Servers

INSTANCEVENDORvCPUsMEMORYAccelerators

g7e.24xlarge FAQs