g7e.8xlarge by Amazon Web Services

g7e.8xlarge is a Graphics intensive [Extra storage or memory] Gen7 8xlarge server offered by Amazon Web Services with 32 vCPUs, 256 GiB of memory and 1.9 TB of storage. The pricing starts at 0.7999 USD per hour.
32 vCPU
256 GiB Memory
1.9 TB Storage
1 GPU
Spare SCore
35,491
(All-cores)
2,166
(Single-core)

Specifications

Server Metadata

Vendor ID
aws
Name
g7e.8xlarge
Description
Graphics intensive [Extra storage or memory] Gen7 8xlarge
Family
g7e
Hw Virt
Status
active
Observed At
2026-11-04T00:05:29.043367

Availability

REGION / IDSPOTONDEMAND
Northern Virgina (US) / us-east-1
3.2259 USD/h 5.2682 USD/h
Oregon (US) / us-west-2
4.1477 USD/h 5.2682 USD/h
Ohio (US) / us-east-2
2.8669 USD/h 5.2682 USD/h
Aragón (ES) / eu-south-2
3.2801 USD/h 5.5513 USD/h
Seoul (KR) / ap-northeast-2
4.69585 USD/h 6.477 USD/h
Stockholm (SE) / eu-north-1
2.39925 USD/h 7.5999 USD/h
Tokyo (JP) / ap-northeast-1
4.8603 USD/h 7.6405 USD/h
Mumbai (IN) / ap-south-1
8.5435 USD/h 8.6047 USD/h
Frankfurt (DE) / eu-central-1
5.4773 USD/h 8.9589 USD/h
(MY) / ap-southeast-5
- 9.0254 USD/h
(TH) / ap-southeast-7
- 9.0254 USD/h
London (GB) / eu-west-2
5.75825 USD/h 9.1565 USD/h
Jakarta (ID) / ap-southeast-3
4.6573 USD/h 10.0292 USD/h

Processor

vCPUs
32
Hypervisor
nitro
CPU Allocation
Dedicated
CPU Cores
16
CPU Speed
2.4 GHz
CPU Architecture
x86_64
CPU Manufacturer
Intel
CPU Family
Xeon
CPU Model
8559C
CPU L1D Cache
48 KiB
CPU L1D Cache Total
768 KiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
512 KiB
CPU L2 Cache
2 MiB
CPU L2 Cache Total
32 MiB
CPU L3 Cache
320 MiB
CPU L3 Cache Total
320 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, ht, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, arch_perfmon, rep_good, nopl, xtopology, nonstop_tsc, cpuid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pdcm, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, tsc_deadline_timer, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, cpuid_fault, ssbd, ibrs, ibpb, stibp, ibrs_enhanced, fsgsbase, tsc_adjust, bmi1, avx2, smep, bmi2, erms, invpcid, avx512f, avx512dq, rdseed, adx, smap, avx512ifma, clflushopt, clwb, avx512cd, sha_ni, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, avx_vnni, avx512_bf16, wbnoinvd, ida, arat, avx512vbmi, umip, pku, ospke, waitpkg, avx512_vbmi2, gfni, vaes, vpclmulqdq, avx512_vnni, avx512_bitalg, tme, avx512_vpopcntdq, rdpid, cldemote, movdiri, movdir64b, md_clear, serialize, amx_bf16, avx512_fp16, amx_tile, amx_int8, flush_l1d, arch_capabilities
Ecpus
16.4
Scalability
51.25

System Resources and Accelerators

MEMORY
Memory Amount
256 GiB
Memory Amount Actual
256 GiB
Memory Generation
DDR5
Memory Speed
5600 Mhz
ACCELERATORS
Accelerator Count
1
Accelerator Memory Min
96 GiB
Accelerator Memory Total
96 GiB
Accelerator Type
GPU
Accelerator Manufacturer
NVIDIA
Accelerator Family
Blackwell
Accelerator Model
RTX PRO 6000
Accelerators
  • NVIDIA Blackwell NVIDIA RTX PRO 6000 Blackwell Server Edition (Memory amount: 97887, Firmware version: 590.48.01, BIOS version: 98.02.9E.00.03, Clock rate: 2430)
STORAGE
Storage Size
1900 GB
Storage Type
nvme ssd
Storages
  • 1900 GB nvme ssd
NETWORK
Network Speed Baseline
100 Gbps
Network Speed Max
100 Gbps
Network Storage Speed Baseline
16 Gbps
Network Storage Speed Max
16 Gbps
Inbound Traffic
0 GB/month
Outbound Traffic
0 GB/month
IPv4
0

Server Description

High-density GPU cloud instance with 96 GB VRAM, Intel Xeon AMX capabilities, 256 GB DDR5 memory, and fast NVMe storage for AI workloads.

GPU AcceleratedMemory OptimizedCompute Optimized

Amazon Web Services g7e.8xlarge is a GPU-accelerated cloud instance powered by a 16-core Intel Xeon 8559C processor running 32 vCPUs at 2.4 GHz alongside 256 GB of high-speed DDR5 memory. The server integrates a dedicated NVIDIA Blackwell RTX PRO 6000 GPU featuring 96 GB of VRAM, supported by 1900 GB of local NVMe SSD storage and a 100 Gbps baseline network capacity. Benchmark evaluations highlight top-tier performance in large language model inference across small, medium, and large parameter sizes, as well as strong single-core and image processing throughput. Uncached memory read bandwidth and static web serving demonstrate robust execution speeds. Designed with a 1:8 vCPU-to-RAM ratio and hardware matrix instructions, g7e.8xlarge offers resource density suited for AI model inference, 3D graphics rendering pipelines, and analytical data science workloads.

Economics

Average Price per Region

Prices per Zone

Lowest Prices

Performance

Workload Profiles

2.5Score
Precomputed compound score for Cache Intensive workloads. A weighted average (geometric mean) of benchmark scores compared to their medians: score = ∏ (x_i / m_i)^(w_i / Σw). The score of 1.0 represents a synthetic baseline server with the median performance of each component benchmark; 0.5 means roughly half the performance; and 2.0 means twice the performance of that reference profile. Component weights: 50% Redis RPS (pipeline=1, SET), 20% Redis RPS (pipeline=16, SET), 10% PassMark Memory Mark (composite), 10% Memory bandwidth (read, 16 MB ~ L3), 10% PassMark single-thread CPU. Rationale for component selection: In-memory key-value store workload, mixing direct Redis performance metrics with memory speed and latency benchmarks, and single-core CPU performance profiles.
Component Score Weight Impact
Raw Reference Normalized Target Actual
Redis RPS (pipeline=1, SET) 5,925,104 ops/sec 1,930,206 ops/sec 3.1 50.00% 50.00% +76.00%
Redis RPS (pipeline=16, SET) 30,481,678 ops/sec 11,792,140 ops/sec 2.5 20.00% 20.00% +20.00%
PassMark Memory Mark (composite) 2,806 2,412 1.2 10.00% 10.00% +1.80%
Memory bandwidth (read, 16 MB ~ L3) 320,756 MB/sec 108,490 MB/sec 2.9 10.00% 10.00% +11.00%
PassMark single-thread CPU 3,180 Mops/s 2,365 Mops/s 1.3 10.00% 10.00% +2.70%

GPU Bandwidth and Latency

Node (all GPUs)
Node baseline directional bandwidth
50.2 GB/s
Node GPU-to-host bandwidth
57.2 GB/s
Node host-to-GPU bandwidth
55.5 GB/s
Single GPU slot
Per-GPU GPU-to-host bandwidth
57.2 GB/s
Per-GPU host-to-GPU bandwidth
55.6 GB/s
Per-GPU host-device latency
1,029 ns
Per-GPU device memory copy bandwidth
728.5 GB/s
Benchmark Environment
Driver Version
 590.48.01
CUDA Version (driver)
 13.1
nvbandwidth Version
 v0.8
GPU Count
 1
P2P Supported
No
Efficiency
SM/CE copy efficiency
0.93

Memory Bandwidth

Compression

OpenSSL

Geekbench Single-Core

Score: 2,278

Geekbench Multi-Core

Score: 18,492

Passmark CPU Scores

BENCHMARKSCORE
Mark
 47,681
Compression
 548,971
Encryption
 33,685
Extended Instructions
 42,914
Floating Point Maths
 108,204
Integer Maths
 152,797
Physics
 7,042
Prime Numbers
 305
Single Threaded
 3,180
String Sorting
 75,706

Passmark Memory Scores

BENCHMARKSCORE
Memory Mark
 2,806
Database Operations
 18,153
Memory Latency
 46
Memory Read Cached
 27,188
Memory Read Uncached
 9,516
Memory Write
 9,367

Stress-ng Raw Scores

Stress-ng Relative Multicore Performance

LLM Inference Speed for Prompt Processing

LLM Inference Speed for Text Generation

Static Web Server

Redis

Alternatives

Servers of the Same Family

INSTANCEvCPUsMEMORYAccelerators
g7e.2xlarge 864 GiB1
g7e.4xlarge 16128 GiB1
g7e.12xlarge 48512 GiB2
g7e.24xlarge 961024 GiB4
g7e.48xlarge 1922048 GiB8

Similar Servers

INSTANCEVENDORvCPUsMEMORYAccelerators

g7e.8xlarge FAQs