g6e.16xlarge is a Graphics intensive [Extra storage or memory] Gen6 16xlarge server offered by Amazon Web Services with 64 vCPUs, 512 GiB of memory and 1.9 TB of storage.
64 vCPU
512 GiB Memory
1.9 TB Storage
1 GPU
Spare SCore
95,699
(All-cores)
(All-cores)
2,992
(Single-core)
(Single-core)
Specifications
Server Metadata
Vendor ID | aws |
Name | g6e.16xlarge |
Description | Graphics intensive [Extra storage or memory] Gen6 16xlarge |
Family | g6e |
Hw Virt | |
Status | active |
Observed At | 2026-10-30T08:25:11.839980 |
Availability
| REGION / ID | SPOT | ONDEMAND |
|---|---|---|
Northern Virgina (US) / us-east-1 | 3.63855 USD/h | 7.5772 USD/h |
Oregon (US) / us-west-2 | 3.435225 USD/h | 7.5772 USD/h |
Ohio (US) / us-east-2 | 3.699433 USD/h | 7.5772 USD/h |
Aragón (ES) / eu-south-2 | 2.41235 USD/h | 7.9844 USD/h |
Stockholm (SE) / eu-north-1 | 1.72615 USD/h | 8.0373 USD/h |
Hyderabad (IN) / ap-south-2 | 1.3421 USD/h | 9.1 USD/h |
Mumbai (IN) / ap-south-1 | 3.2867 USD/h | 9.1 USD/h |
United Arab Emirates / me-central-1 | 3.8053 USD/h | 9.2954 USD/h |
Seoul (KR) / ap-northeast-2 | 4.4073 USD/h | 9.3157 USD/h |
Frankfurt (DE) / eu-central-1 | 3.021467 USD/h | 9.4745 USD/h |
Osaka (JP) / ap-northeast-3 | 3.205 USD/h | 10.9892 USD/h |
Tokyo (JP) / ap-northeast-1 | 5.12295 USD/h | 10.9892 USD/h |
Processor
vCPUs | 64 |
Hypervisor | nitro |
CPU Allocation | Dedicated |
CPU Cores | 32 |
CPU Speed | 3.4 GHz |
CPU Architecture | x86_64 |
CPU Manufacturer | AMD |
CPU Family | EPYC |
CPU Model | 7R13 |
CPU L1D Cache | 32 KiB |
CPU L1D Cache Total | 1 MiB |
CPU L1I Cache | 32 KiB |
CPU L1I Cache Total | 1 MiB |
CPU L2 Cache | 512 KiB |
CPU L2 Cache Total | 16 MiB |
CPU L3 Cache | 32 MiB |
CPU L3 Cache Total | 128 MiB |
CPU Flags | fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ht, syscall, nx, mmxext, fxsr_opt, pdpe1gb, rdtscp, lm, constant_tsc, rep_good, nopl, nonstop_tsc, cpuid, extd_apicid, aperfmperf, tsc_known_freq, pni, pclmulqdq, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, cmp_legacy, cr8_legacy, abm, sse4a, misalignsse, 3dnowprefetch, topoext, ssbd, ibrs, ibpb, stibp, vmmcall, fsgsbase, bmi1, avx2, smep, bmi2, invpcid, rdseed, adx, smap, clflushopt, clwb, sha_ni, xsaveopt, xsavec, xgetbv1, clzero, xsaveerptr, rdpru, wbnoinvd, arat, npt, nrip_save, vaes, vpclmulqdq, rdpid |
Ecpus | 32 |
Scalability | 50 |
System Resources and Accelerators
| MEMORY | |
|---|---|
Memory Amount | 512 GiB |
Memory Amount Actual | 512 GiB |
Memory Generation | DDR4 |
Memory Speed | 3200 Mhz |
| ACCELERATORS | |
|---|---|
Accelerator Count | 1 |
Accelerator Memory Min | 45 GiB |
Accelerator Memory Total | 45 GiB |
Accelerator Type | GPU |
Accelerator Manufacturer | NVIDIA |
Accelerator Family | Ada Lovelace |
Accelerator Model | L40S |
Accelerators |
|
| STORAGE | |
|---|---|
Storage Size | 1900 GB |
Storage Type | nvme ssd |
Storages |
|
| NETWORK | |
|---|---|
Network Speed Baseline | 35 Gbps |
Network Speed Max | 35 Gbps |
Network Storage Speed Baseline | 20 Gbps |
Network Storage Speed Max | 20 Gbps |
Inbound Traffic | 0 GB/month |
Outbound Traffic | 0 GB/month |
IPv4 | 0 |
CPU and System Topology
Server Description
An accelerator-enabled instance combining dedicated AMD EPYC processing, high-capacity system memory, and an NVIDIA L40S GPU for demanding inference workloads.
GPU AcceleratedMemory OptimizedStorage & Database
Amazon Web Services g6e.16xlarge is a graphics-intensive instance featuring 64 dedicated vCPUs from an AMD EPYC 7R13 processor running at 3.4 GHz, paired with 512.0 GB of DDR4 memory. It integrates a single NVIDIA L40S GPU with 45 GB of VRAM and a 1900 GB NVMe SSD for local storage, supported by a 35 Gbps baseline network speed. Benchmark data indicates top-tier performance in large language model inference for prompt processing and text generation. It also demonstrates strong multi-core CPU execution, software compilation, and database operations, placing in the top 25% for these workloads. Uncached memory bandwidth and single-core processing remain in the average tier. This hardware configuration is designed for GPU-accelerated tasks, large-scale database operations, and machine learning inference.
Economics
Performance
GPU Bandwidth and Latency
| Node (all GPUs) | |
|---|---|
Node baseline directional bandwidth | 11.0 GB/s |
Node GPU-to-host bandwidth | 13.2 GB/s |
Node host-to-GPU bandwidth | 13.5 GB/s |
| Single GPU slot | |
|---|---|
Per-GPU GPU-to-host bandwidth | 13.2 GB/s |
Per-GPU host-to-GPU bandwidth | 13.5 GB/s |
Per-GPU host-device latency | 801 ns |
| Benchmark Environment | |
|---|---|
Driver Version | 535.183.01 |
CUDA Version (driver) | 12.6 |
nvbandwidth Version | v0.5 |
GPU Count | 1 |
P2P Supported | No |
| Efficiency | |
|---|---|
SM/CE copy efficiency | 1.00 |
Memory Bandwidth
Compression
OpenSSL
Geekbench Single-Core
Score: 1,693
Geekbench Multi-Core
Score: 16,621
Passmark CPU Scores
| BENCHMARK | SCORE |
|---|---|
Mark | 67,139 |
Compression | 1,111,368 |
Encryption | 75,869 |
Extended Instructions | 58,900 |
Floating Point Maths | 161,603 |
Integer Maths | 294,469 |
Physics | 6,636 |
Prime Numbers | 367 |
Single Threaded | 2,646 |
String Sorting | 143,390 |
Passmark Memory Scores
| BENCHMARK | SCORE |
|---|---|
Memory Mark | 2,852 |
Database Operations | 26,163 |
Memory Latency | 65 |
Memory Read Cached | 26,254 |
Memory Read Uncached | 17,054 |
Memory Write | 17,355 |
Stress-ng Raw Scores
Stress-ng Relative Multicore Performance
LLM Inference Speed for Prompt Processing
LLM Inference Speed for Text Generation
Static Web Server
Redis
Alternatives
Servers of the Same Family
| INSTANCE | vCPUs | MEMORY | Accelerators |
|---|---|---|---|
| g6e.xlarge | 4 | 32 GiB | 1 |
| g6e.2xlarge | 8 | 64 GiB | 1 |
| g6e.4xlarge | 16 | 128 GiB | 1 |
| g6e.8xlarge | 32 | 256 GiB | 1 |
| g6e.12xlarge | 48 | 384 GiB | 4 |
| g6e.24xlarge | 96 | 768 GiB | 4 |
| g6e.48xlarge | 192 | 1536 GiB | 8 |
Similar Servers
| INSTANCE | VENDOR | vCPUs | MEMORY | Accelerators |
|---|