g6e.48xlarge by Amazon Web Services

g6e.48xlarge is a Graphics intensive [Extra storage or memory] Gen6 48xlarge server offered by Amazon Web Services with 192 vCPUs, 1536 GiB of memory and 7.6 TB of storage. The pricing starts at 8.9202 USD per hour.
192 vCPU
1536 GiB Memory
7.6 TB Storage
8 GPU
Spare SCore
287,029
(All-cores)
2,991
(Single-core)

Specifications

Server Metadata

Vendor ID
aws
Name
g6e.48xlarge
Description
Graphics intensive [Extra storage or memory] Gen6 48xlarge
Family
g6e
Hw Virt
Status
active
Observed At
2026-10-24T22:03:23.055724

Availability

REGION / IDSPOTONDEMAND
Northern Virgina (US) / us-east-1
20.689 USD/h 30.1312 USD/h
Ohio (US) / us-east-2
15.7368 USD/h 30.1312 USD/h
Oregon (US) / us-west-2
28.2497 USD/h 30.1312 USD/h
Aragón (ES) / eu-south-2
24.1179 USD/h 31.7503 USD/h
Stockholm (SE) / eu-north-1
27.3111 USD/h 31.9608 USD/h
Hyderabad (IN) / ap-south-2
19.3999 USD/h 36.1866 USD/h
Mumbai (IN) / ap-south-1
32.15375 USD/h 36.1866 USD/h
United Arab Emirates / me-central-1
15.1321 USD/h 36.9637 USD/h
Seoul (KR) / ap-northeast-2
18.14995 USD/h 37.0447 USD/h
Frankfurt (DE) / eu-central-1
37.6761 USD/h 37.6761 USD/h
Tokyo (JP) / ap-northeast-1
21.17715 USD/h 43.6991 USD/h
Osaka (JP) / ap-northeast-3
32.7611 USD/h 43.6991 USD/h

Processor

vCPUs
192
Hypervisor
nitro
CPU Allocation
Dedicated
CPU Cores
96
CPU Speed
3.4 GHz
CPU Architecture
x86_64
CPU Manufacturer
AMD
CPU Family
EPYC
CPU Model
7R13
CPU L1D Cache
32 KiB
CPU L1D Cache Total
3 MiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
3 MiB
CPU L2 Cache
512 KiB
CPU L2 Cache Total
48 MiB
CPU L3 Cache
32 MiB
CPU L3 Cache Total
384 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ht, syscall, nx, mmxext, fxsr_opt, pdpe1gb, rdtscp, lm, constant_tsc, rep_good, nopl, nonstop_tsc, cpuid, extd_apicid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, cmp_legacy, cr8_legacy, abm, sse4a, misalignsse, 3dnowprefetch, topoext, perfctr_core, ssbd, ibrs, ibpb, stibp, vmmcall, fsgsbase, bmi1, avx2, smep, bmi2, invpcid, rdseed, adx, smap, clflushopt, clwb, sha_ni, xsaveopt, xsavec, xgetbv1, clzero, xsaveerptr, rdpru, wbnoinvd, arat, npt, nrip_save, vaes, vpclmulqdq, rdpid
Ecpus
96
Scalability
50

System Resources and Accelerators

MEMORY
Memory Amount
2 TB
Memory Amount Actual
2 TB
Memory Generation
DDR4
Memory Speed
3200 Mhz
ACCELERATORS
Accelerator Count
8
Accelerator Memory Min
45 GiB
Accelerator Memory Total
358 GiB
Accelerator Type
GPU
Accelerator Manufacturer
NVIDIA
Accelerator Family
Ada Lovelace
Accelerator Model
L40S
Accelerators
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
STORAGE
Storage Size
7600 GB
Storage Type
nvme ssd
Storages
  • 1900 GB nvme ssd
  • 1900 GB nvme ssd
  • 1900 GB nvme ssd
  • 1900 GB nvme ssd
NETWORK
Network Speed Baseline
400 Gbps
Network Speed Max
400 Gbps
Network Storage Speed Baseline
60 Gbps
Network Storage Speed Max
60 Gbps
Inbound Traffic
0 GB/month
Outbound Traffic
0 GB/month
IPv4
0

CPU and System Topology

Server Description

A high-density accelerator platform featuring eight GPUs, massive system memory, and high-speed local NVMe storage for demanding machine learning workloads.

GPU AcceleratedCompute OptimizedStorage & Database

Amazon Web Services g6e.48xlarge is a high-density, graphics-intensive server powered by the Nitro hypervisor. It features 192 vCPUs from an AMD EPYC 7R13 processor running at 3.4 GHz, 1536.0 GB of DDR4 memory, and 7600 GB of local NVMe SSD storage. The server is equipped with eight NVIDIA L40S GPUs providing 358 GB of total VRAM. Benchmark results show top-tier multi-core CPU performance, exceptional ray tracing capabilities, and top-tier LLM inference speeds across small, medium, and large models. It also delivers top-tier Redis SET operations and strong database performance. With a baseline network bandwidth of 400 Gbps, this server is optimized for demanding workloads such as large-scale LLM inference, graphics rendering, and high-throughput database applications.

Economics

Average Price per Region

Prices per Zone

Lowest Prices

Performance

Workload Profiles

4.9Score
Precomputed compound score for Cache Intensive workloads. A weighted average (geometric mean) of benchmark scores compared to their medians: score = ∏ (x_i / m_i)^(w_i / Σw). The score of 1.0 represents a synthetic baseline server with the median performance of each component benchmark; 0.5 means roughly half the performance; and 2.0 means twice the performance of that reference profile. Component weights: 50% Redis RPS (pipeline=1, SET), 20% Redis RPS (pipeline=16, SET), 10% PassMark Memory Mark (composite), 10% Memory bandwidth (read, 16 MB ~ L3), 10% PassMark single-thread CPU. Rationale for component selection: In-memory key-value store workload, mixing direct Redis performance metrics with memory speed and latency benchmarks, and single-core CPU performance profiles.
Component Score Weight Impact
Raw Reference Normalized Target Actual
Redis RPS (pipeline=1, SET) 15,328,506 ops/sec 1,919,289 ops/sec 7.9 50.00% 50.00% +180.00%
Redis RPS (pipeline=16, SET) 107,028,486 ops/sec 11,728,058 ops/sec 9.2 20.00% 20.00% +56.00%
PassMark Memory Mark (composite) 2,815 2,416 1.2 10.00% 10.00% +1.80%
Memory bandwidth (read, 16 MB ~ L3) 257,688 MB/sec 108,466 MB/sec 2.4 10.00% 10.00% +9.10%
PassMark single-thread CPU 2,639 Mops/s 2,365 Mops/s 1.1 10.00% 10.00% +0.96%

GPU Bandwidth and Latency

Node (all GPUs)
Node baseline directional bandwidth
88.6 GB/s
Node GPU-to-host bandwidth
105.7 GB/s
Node host-to-GPU bandwidth
107.7 GB/s
Single GPU slot
Per-GPU GPU-to-host bandwidth
13.2 GB/s
Per-GPU host-to-GPU bandwidth
13.5 GB/s
Per-GPU host-device latency
799 ns
Benchmark Environment
Driver Version
 535.183.01
CUDA Runtime Version
 12.6
nvbandwidth Version
 v0.5
GPU Count
 8
P2P Supported
No
Efficiency
SM/CE copy efficiency
1.00

Memory Bandwidth

Compression

OpenSSL

Geekbench Single-Core

Score: 1,685

Geekbench Multi-Core

Score: 16,100

Passmark CPU Scores

BENCHMARKSCORE
Mark
 114,679
Compression
 2,989,967
Encryption
 220,150
Extended Instructions
 153,717
Floating Point Maths
 484,532
Integer Maths
 882,436
Physics
 15,129
Prime Numbers
 1,032
Single Threaded
 2,639
String Sorting
 376,384

Passmark Memory Scores

BENCHMARKSCORE
Memory Mark
 2,815
Database Operations
 29,894
Memory Latency
 68
Memory Read Cached
 26,517
Memory Read Uncached
 17,000
Memory Write
 17,244

Stress-ng Raw Scores

Stress-ng Relative Multicore Performance

LLM Inference Speed for Prompt Processing

LLM Inference Speed for Text Generation

Static Web Server

Redis

Alternatives

Servers of the Same Family

INSTANCEvCPUsMEMORYAccelerators
g6e.xlarge 432 GiB1
g6e.2xlarge 864 GiB1
g6e.4xlarge 16128 GiB1
g6e.8xlarge 32256 GiB1
g6e.12xlarge 48384 GiB4
g6e.16xlarge 64512 GiB1
g6e.24xlarge 96768 GiB4

Similar Servers

INSTANCEVENDORvCPUsMEMORYAccelerators

g6e.48xlarge FAQs