g6e.24xlarge by Amazon Web Services

g6e.24xlarge is a Graphics intensive [Extra storage or memory] Gen6 24xlarge server offered by Amazon Web Services with 96 vCPUs, 768 GiB of memory and 3.8 TB of storage. The pricing starts at 4.3587 USD per hour.
96 vCPU
768 GiB Memory
3.8 TB Storage
4 GPU
Spare SCore
143,527
(All-cores)
2,992
(Single-core)

Specifications

Server Metadata

Vendor ID
aws
Name
g6e.24xlarge
Description
Graphics intensive [Extra storage or memory] Gen6 24xlarge
Family
g6e
Hw Virt
Status
active
Observed At
2026-11-08T06:47:13.256022

Availability

REGION / IDSPOTONDEMAND
Northern Virgina (US) / us-east-1
12.386425 USD/h 15.0656 USD/h
Ohio (US) / us-east-2
7.6338 USD/h 15.0656 USD/h
Oregon (US) / us-west-2
15.0656 USD/h 15.0656 USD/h
Aragón (ES) / eu-south-2
15.75575 USD/h 15.8751 USD/h
Stockholm (SE) / eu-north-1
13.5102 USD/h 15.9804 USD/h
Hyderabad (IN) / ap-south-2
4.9576 USD/h 18.0933 USD/h
Mumbai (IN) / ap-south-1
12.9639 USD/h 18.0933 USD/h
United Arab Emirates / me-central-1
7.9312 USD/h 18.4819 USD/h
Seoul (KR) / ap-northeast-2
8.48835 USD/h 18.5223 USD/h
Frankfurt (DE) / eu-central-1
18.8381 USD/h 18.8381 USD/h
Osaka (JP) / ap-northeast-3
9.0605 USD/h 21.8496 USD/h
Tokyo (JP) / ap-northeast-1
10.06535 USD/h 21.8496 USD/h

Processor

vCPUs
96
Hypervisor
nitro
CPU Allocation
Dedicated
CPU Cores
48
CPU Speed
3.4 GHz
CPU Architecture
x86_64
CPU Manufacturer
AMD
CPU Family
EPYC
CPU Model
7R13
CPU L1D Cache
32 KiB
CPU L1D Cache Total
2 MiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
2 MiB
CPU L2 Cache
512 KiB
CPU L2 Cache Total
24 MiB
CPU L3 Cache
32 MiB
CPU L3 Cache Total
192 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ht, syscall, nx, mmxext, fxsr_opt, pdpe1gb, rdtscp, lm, constant_tsc, rep_good, nopl, nonstop_tsc, cpuid, extd_apicid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, cmp_legacy, cr8_legacy, abm, sse4a, misalignsse, 3dnowprefetch, topoext, perfctr_core, ssbd, ibrs, ibpb, stibp, vmmcall, fsgsbase, bmi1, avx2, smep, bmi2, invpcid, rdseed, adx, smap, clflushopt, clwb, sha_ni, xsaveopt, xsavec, xgetbv1, clzero, xsaveerptr, rdpru, wbnoinvd, arat, npt, nrip_save, vaes, vpclmulqdq, rdpid
Ecpus
48
Scalability
50

System Resources and Accelerators

MEMORY
Memory Amount
768 GiB
Memory Amount Actual
768 GiB
Memory Generation
DDR4
Memory Speed
3200 Mhz
ACCELERATORS
Accelerator Count
4
Accelerator Memory Min
45 GiB
Accelerator Memory Total
179 GiB
Accelerator Type
GPU
Accelerator Manufacturer
NVIDIA
Accelerator Family
Ada Lovelace
Accelerator Model
L40S
Accelerators
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
  • NVIDIA Ada Lovelace NVIDIA L40S (Memory amount: 46068, Firmware version: 590.48.01, BIOS version: 95.02.66.00.15, Clock rate: 2520)
STORAGE
Storage Size
3800 GB
Storage Type
nvme ssd
Storages
  • 1900 GB nvme ssd
  • 1900 GB nvme ssd
NETWORK
Network Speed Baseline
200 Gbps
Network Speed Max
200 Gbps
Network Storage Speed Baseline
30 Gbps
Network Storage Speed Max
30 Gbps
Inbound Traffic
0 GB/month
Outbound Traffic
0 GB/month
IPv4
0

CPU and System Topology

Server Description

An accelerated computing platform featuring quad NVIDIA L40S GPUs, 96 AMD EPYC vCPUs, and high-speed local NVMe storage.

GPU AcceleratedCompute OptimizedStorage & Database

Amazon Web Services g6e.24xlarge is a graphics-intensive instance designed for demanding compute and acceleration workloads. Powered by the Nitro hypervisor, it features 96 vCPUs from an AMD EPYC 7R13 processor running at 3.4 GHz, 768.0 GB of DDR4 memory, and 3800 GB of local NVMe SSD storage. The hardware configuration includes four NVIDIA Ada Lovelace L40S GPUs with 179 GB of total VRAM, supported by a 200 Gbps baseline network bandwidth. Benchmark results show top-tier performance in multi-core CPU execution, cryptographic operations, and large language model inference across various model sizes. Conversely, single-core processing and large-block memory bandwidth perform in the average to strong ranges. This resource-dense profile is designed for multi-GPU machine learning inference, complex simulations, and data-intensive applications requiring high local storage throughput.

Economics

Average Price per Region

Prices per Zone

Lowest Prices

Performance

Workload Profiles

2.9Score
Precomputed compound score for Cache Intensive workloads. A weighted average (geometric mean) of benchmark scores compared to their medians: score = ∏ (x_i / m_i)^(w_i / Σw). The score of 1.0 represents a synthetic baseline server with the median performance of each component benchmark; 0.5 means roughly half the performance; and 2.0 means twice the performance of that reference profile. Component weights: 50% Redis RPS (pipeline=1, SET), 20% Redis RPS (pipeline=16, SET), 10% PassMark Memory Mark (composite), 10% Memory bandwidth (read, 16 MB ~ L3), 10% PassMark single-thread CPU. Rationale for component selection: In-memory key-value store workload, mixing direct Redis performance metrics with memory speed and latency benchmarks, and single-core CPU performance profiles.
Component Score Weight Impact
Raw Reference Normalized Target Actual
Redis RPS (pipeline=1, SET) 7,833,511 ops/sec 1,922,940 ops/sec 4.1 50.00% 50.00% +100.00%
Redis RPS (pipeline=16, SET) 54,983,215 ops/sec 11,797,257 ops/sec 4.6 20.00% 20.00% +36.00%
PassMark Memory Mark (composite) 2,850 2,406 1.2 10.00% 10.00% +1.80%
Memory bandwidth (read, 16 MB ~ L3) 128,223 MB/sec 108,657 MB/sec 1.2 10.00% 10.00% +1.80%
PassMark single-thread CPU 2,638 Mops/s 2,365 Mops/s 1.1 10.00% 10.00% +0.96%

GPU Bandwidth and Latency

Node (all GPUs)
Node baseline directional bandwidth
44.3 GB/s
Node GPU-to-host bandwidth
52.9 GB/s
Node host-to-GPU bandwidth
53.9 GB/s
Single GPU slot
Per-GPU GPU-to-host bandwidth
13.2 GB/s
Per-GPU host-to-GPU bandwidth
13.5 GB/s
Per-GPU host-device latency
794 ns
Benchmark Environment
Driver Version
 535.183.01
CUDA Version (driver)
 12.6
nvbandwidth Version
 v0.5
GPU Count
 4
P2P Supported
No
Efficiency
SM/CE copy efficiency
1.00

Memory Bandwidth

Compression

OpenSSL

Geekbench Single-Core

Score: 1,677

Geekbench Multi-Core

Score: 17,756

Passmark CPU Scores

BENCHMARKSCORE
Mark
 81,877
Compression
 1,506,621
Encryption
 110,627
Extended Instructions
 77,436
Floating Point Maths
 242,296
Integer Maths
 441,521
Physics
 7,664
Prime Numbers
 526
Single Threaded
 2,638
String Sorting
 186,498

Passmark Memory Scores

BENCHMARKSCORE
Memory Mark
 2,850
Database Operations
 25,959
Memory Latency
 66
Memory Read Cached
 26,408
Memory Read Uncached
 17,141
Memory Write
 17,652

Stress-ng Raw Scores

Stress-ng Relative Multicore Performance

LLM Inference Speed for Prompt Processing

LLM Inference Speed for Text Generation

Static Web Server

Redis

Alternatives

Servers of the Same Family

INSTANCEvCPUsMEMORYAccelerators
g6e.xlarge 432 GiB1
g6e.2xlarge 864 GiB1
g6e.4xlarge 16128 GiB1
g6e.8xlarge 32256 GiB1
g6e.12xlarge 48384 GiB4
g6e.16xlarge 64512 GiB1
g6e.48xlarge 1921536 GiB8

Similar Servers

INSTANCEVENDORvCPUsMEMORYAccelerators

g6e.24xlarge FAQs