g7e.48xlarge by Amazon Web Services
(All-cores)
(Single-core)
Specifications
Server Metadata
Vendor ID | aws |
Name | g7e.48xlarge |
Description | Graphics intensive [Extra storage or memory] Gen7 48xlarge |
Family | g7e |
Hw Virt | |
Status | active |
Observed At | 2026-11-04T17:41:59.943417 |
Availability
| REGION / ID | SPOT | ONDEMAND |
|---|---|---|
Oregon (US) / us-west-2 | 24.26595 USD/h | 33.1443 USD/h |
Northern Virgina (US) / us-east-1 | 16.2297 USD/h | 33.1443 USD/h |
Ohio (US) / us-east-2 | 18.071367 USD/h | 33.1443 USD/h |
Aragón (ES) / eu-south-2 | 11.5932 USD/h | 34.9254 USD/h |
Seoul (KR) / ap-northeast-2 | 36.6743 USD/h | 40.7492 USD/h |
Stockholm (SE) / eu-north-1 | 24.5931 USD/h | 47.8133 USD/h |
Tokyo (JP) / ap-northeast-1 | 34.40305 USD/h | 48.0691 USD/h |
Mumbai (IN) / ap-south-1 | 54.1351 USD/h | 54.1351 USD/h |
Frankfurt (DE) / eu-central-1 | 25.0729 USD/h | 56.3635 USD/h |
(MY) / ap-southeast-5 | - | 56.7822 USD/h |
(TH) / ap-southeast-7 | - | 56.7822 USD/h |
London (GB) / eu-west-2 | 16.10025 USD/h | 57.6069 USD/h |
Jakarta (ID) / ap-southeast-3 | 10.6858 USD/h | 63.097 USD/h |
Processor
vCPUs | 192 |
Hypervisor | nitro |
CPU Allocation | Dedicated |
CPU Cores | 96 |
CPU Speed | 2.4 GHz |
CPU Architecture | x86_64 |
CPU Manufacturer | Intel |
CPU Family | Xeon |
CPU Model | 8559C |
CPU L1D Cache | 48 KiB |
CPU L1D Cache Total | 5 MiB |
CPU L1I Cache | 32 KiB |
CPU L1I Cache Total | 3 MiB |
CPU L2 Cache | 2 MiB |
CPU L2 Cache Total | 192 MiB |
CPU L3 Cache | 320 MiB |
CPU L3 Cache Total | 640 MiB |
CPU Flags | fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, ht, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, arch_perfmon, rep_good, nopl, xtopology, nonstop_tsc, cpuid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pdcm, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, tsc_deadline_timer, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, cpuid_fault, ssbd, ibrs, ibpb, stibp, ibrs_enhanced, fsgsbase, tsc_adjust, bmi1, avx2, smep, bmi2, erms, invpcid, avx512f, avx512dq, rdseed, adx, smap, avx512ifma, clflushopt, clwb, avx512cd, sha_ni, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, avx_vnni, avx512_bf16, wbnoinvd, ida, arat, avx512vbmi, umip, pku, ospke, waitpkg, avx512_vbmi2, gfni, vaes, vpclmulqdq, avx512_vnni, avx512_bitalg, tme, avx512_vpopcntdq, rdpid, cldemote, movdiri, movdir64b, md_clear, serialize, amx_bf16, avx512_fp16, amx_tile, amx_int8, flush_l1d, arch_capabilities |
Ecpus | 80.7 |
Scalability | 42.03 |
System Resources and Accelerators
| MEMORY | |
|---|---|
Memory Amount | 2 TB |
Memory Amount Actual | 2 TB |
Memory Generation | DDR5 |
Memory Speed | 5600 Mhz |
| ACCELERATORS | |
|---|---|
Accelerator Count | 8 |
Accelerator Memory Min | 96 GiB |
Accelerator Memory Total | 768 GiB |
Accelerator Type | GPU |
Accelerator Manufacturer | NVIDIA |
Accelerator Family | Blackwell |
Accelerator Model | RTX PRO 6000 |
Accelerators |
|
| STORAGE | |
|---|---|
Storage Size | 15200 GB |
Storage Type | nvme ssd |
Storages |
|
| NETWORK | |
|---|---|
Network Speed Baseline | 400 Gbps |
Network Speed Max | 400 Gbps |
Network Storage Speed Baseline | 100 Gbps |
Network Storage Speed Max | 100 Gbps |
Inbound Traffic | 0 GB/month |
Outbound Traffic | 0 GB/month |
IPv4 | 0 |
CPU and System Topology
Server Description
High-density GPU server delivering eight Blackwell GPUs, 192 vCPUs, 2 TB DDR5 memory, and 400 Gbps network bandwidth for enterprise AI workloads.
Amazon Web Services g7e.48xlarge is an accelerator-optimized instance built on the AWS Nitro hypervisor, designed for compute-intensive and graphics-heavy enterprise workloads. It incorporates 192 vCPUs across 96 physical Intel Xeon 8559C cores operating at 2.4 GHz with 320 MB L3 cache and AMX acceleration, paired with 2048 GB of DDR5 memory. The server is equipped with eight NVIDIA Blackwell RTX PRO 6000 GPUs supplying 768 GB of VRAM, along with 15.2 TB of local NVMe SSD storage and a baseline 400 Gbps network bandwidth. Benchmark results confirm top-tier multi-core execution, fast uncached memory read bandwidth of 447.23 GB/sec, and exceptional throughput in Redis operations and LLM inference. This system trades small-scale modularity for massive per-node processing density, making it well suited for large language model deployment, real-time ray tracing, distributed data science, and high-performance database execution.
Economics
Performance
GPU Bandwidth and Latency
| Node (all GPUs) | |
|---|---|
Node baseline directional bandwidth | 175.6 GB/s |
Node GPU-to-host bandwidth | 228.3 GB/s |
Node host-to-GPU bandwidth | 222.7 GB/s |
| Peer-to-peer | |
|---|---|
GPU-to-GPU P2P duplex bandwidth | 52.3 GB/s |
GPU-to-GPU P2P gather bandwidth | 54.3 GB/s |
GPU-to-GPU P2P latency | 1,099 ns |
GPU-to-GPU P2P bandwidth | 54.2 GB/s |
| Single GPU slot | |
|---|---|
Per-GPU GPU-to-host bandwidth | 57.2 GB/s |
Per-GPU host-to-GPU bandwidth | 55.6 GB/s |
Per-GPU host-device latency | 1,028 ns |
Per-GPU device memory copy bandwidth | 728.6 GB/s |
| Benchmark Environment | |
|---|---|
Driver Version | 590.48.01 |
CUDA Version (driver) | 13.1 |
nvbandwidth Version | v0.8 |
GPU Count | 8 |
P2P Supported | Yes |
| Efficiency | |
|---|---|
SM/CE copy efficiency | 0.93 |
Memory Bandwidth
Compression
OpenSSL
Geekbench Single-Core
Geekbench Multi-Core
Passmark CPU Scores
| BENCHMARK | SCORE |
|---|---|
Mark | 131,267 |
Compression | 2,884,126 |
Encryption | 178,714 |
Extended Instructions | 210,731 |
Floating Point Maths | 575,483 |
Integer Maths | 812,648 |
Physics | 24,986 |
Prime Numbers | 1,602 |
Single Threaded | 3,147 |
String Sorting | 373,771 |
Passmark Memory Scores
| BENCHMARK | SCORE |
|---|---|
Memory Mark | 2,828 |
Database Operations | 37,389 |
Memory Latency | 46 |
Memory Read Cached | 27,623 |
Memory Read Uncached | 9,238 |
Memory Write | 8,894 |
Stress-ng Raw Scores
Stress-ng Relative Multicore Performance
LLM Inference Speed for Prompt Processing
LLM Inference Speed for Text Generation
Static Web Server
Redis
Alternatives
Servers of the Same Family
| INSTANCE | vCPUs | MEMORY | Accelerators |
|---|---|---|---|
| g7e.2xlarge | 8 | 64 GiB | 1 |
| g7e.4xlarge | 16 | 128 GiB | 1 |
| g7e.8xlarge | 32 | 256 GiB | 1 |
| g7e.12xlarge | 48 | 512 GiB | 2 |
| g7e.24xlarge | 96 | 1024 GiB | 4 |
Similar Servers
| INSTANCE | VENDOR | vCPUs | MEMORY | Accelerators |
|---|