g6.16xlarge by Amazon Web Services
(All-cores)
(Single-core)
Specifications
Server Metadata
Vendor ID | aws |
Name | g6.16xlarge |
Description | Graphics intensive Gen6 16xlarge |
Family | g6 |
Hw Virt | |
Status | active |
Observed At | 2026-07-06T17:48:43.251151 |
Availability
| REGION / ID | SPOT | ONDEMAND |
|---|---|---|
Ohio (US) / us-east-2 | 1.0162 USD/h | 3.3968 USD/h |
Oregon (US) / us-west-2 | 1.735775 USD/h | 3.3968 USD/h |
Northern Virgina (US) / us-east-1 | 1.3962 USD/h | 3.3968 USD/h |
Aragón (ES) / eu-south-2 | 0.835467 USD/h | 3.5791 USD/h |
Stockholm (SE) / eu-north-1 | 1.0376 USD/h | 3.6028 USD/h |
Quebec (CA) / ca-central-1 | 1.633833 USD/h | 3.7716 USD/h |
Mumbai (IN) / ap-south-1 | 0.9299 USD/h | 4.0789 USD/h |
United Arab Emirates / me-central-1 | 1.5919 USD/h | 4.171 USD/h |
Seoul (KR) / ap-northeast-2 | 1.0918 USD/h | 4.1768 USD/h |
Frankfurt (DE) / eu-central-1 | 1.574167 USD/h | 4.2477 USD/h |
(MY) / ap-southeast-5 | 0.7957 USD/h | 4.2789 USD/h |
Paris (FR) / eu-west-3 | 1.33495 USD/h | 4.3118 USD/h |
London (GB) / eu-west-2 | 1.481667 USD/h | 4.3118 USD/h |
Sydney (AU) / ap-southeast-2 | 1.842133 USD/h | 4.4165 USD/h |
Zurich (CH) / eu-central-2 | 1.1583 USD/h | 4.5794 USD/h |
Tokyo (JP) / ap-northeast-1 | 1.63445 USD/h | 4.9264 USD/h |
Sao Paulo (BR) / sa-east-1 | 1.7432 USD/h | 5.7739 USD/h |
Processor
vCPUs | 64 |
Hypervisor | nitro |
CPU Allocation | Dedicated |
CPU Cores | 32 |
CPU Speed | 3.4 GHz |
CPU Architecture | x86_64 |
CPU Manufacturer | AMD |
CPU Family | EPYC |
CPU Model | 7R13 |
CPU L1D Cache | 32 KiB |
CPU L1D Cache Total | 1 MiB |
CPU L1I Cache | 32 KiB |
CPU L1I Cache Total | 1 MiB |
CPU L2 Cache | 512 KiB |
CPU L2 Cache Total | 16 MiB |
CPU L3 Cache | 32 MiB |
CPU L3 Cache Total | 128 MiB |
CPU Flags | fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ht, syscall, nx, mmxext, fxsr_opt, pdpe1gb, rdtscp, lm, constant_tsc, rep_good, nopl, nonstop_tsc, cpuid, extd_apicid, aperfmperf, tsc_known_freq, pni, pclmulqdq, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, cmp_legacy, cr8_legacy, abm, sse4a, misalignsse, 3dnowprefetch, topoext, ssbd, ibrs, ibpb, stibp, vmmcall, fsgsbase, bmi1, avx2, smep, bmi2, invpcid, rdseed, adx, smap, clflushopt, clwb, sha_ni, xsaveopt, xsavec, xgetbv1, clzero, xsaveerptr, rdpru, wbnoinvd, arat, npt, nrip_save, vaes, vpclmulqdq, rdpid |
Ecpus | 32 |
Scalability | 100 |
System Resources and Accelerators
| MEMORY | |
|---|---|
Memory Amount | 256 GiB |
Memory Amount Actual | 256 GiB |
Memory Generation | DDR4 |
Memory Speed | 3200 Mhz |
| GPU | |
|---|---|
GPU Count | 1 |
GPU Memory Min | 22 GiB |
GPU Memory Total | 22 GiB |
GPU Manufacturer | NVIDIA |
GPU Family | Ada Lovelace |
GPU Model | L4 |
GPUs |
|
| STORAGE | |
|---|---|
Storage Size | 1880 GB |
Storage Type | nvme ssd |
Storages |
|
| NETWORK | |
|---|---|
Network Speed Baseline | 25 Gbps |
Network Speed Max | 25 Gbps |
Network Storage Speed Baseline | 20 Gbps |
Network Storage Speed Max | 20 Gbps |
Inbound Traffic | 0 GB/month |
Outbound Traffic | 0 GB/month |
IPv4 | 0 |
CPU and System Topology
Server Description
A GPU-accelerated instance featuring dedicated AMD EPYC processors, local NVMe storage, and NVIDIA Ada Lovelace graphics for efficient machine learning inference.
Amazon Web Services g6.16xlarge is a GPU-accelerated server instance designed for graphics-intensive and machine learning workloads. Powered by the Nitro hypervisor, it features 64 vCPUs from an AMD EPYC 7R13 processor running at 3.4 GHz, 256.0 GB of DDR4 memory, and a single NVIDIA Ada Lovelace L4 GPU with 22 GB of VRAM. Storage is supported by a local 1880 GB NVMe SSD, and networking baseline is 25 Gbps. Benchmarks show strong multi-core CPU performance and top-tier prompt processing speeds for small to medium LLMs, though text generation speeds drop significantly on 70B models. This instance is well-suited for medium-scale AI inference, database operations, and software compilation.
Economics
Performance
Workload Profiles
Memory Bandwidth
Compression
OpenSSL
Geekbench Single-Core
Geekbench Multi-Core
Passmark CPU Scores
| BENCHMARK | SCORE |
|---|---|
Mark | 60670 |
Compression | 897370 |
Encryption | 65193 |
Extended Instructions | 47745 |
Floating Point Maths | 144669 |
Integer Maths | 269588 |
Physics | 6174 |
Prime Numbers | 341 |
Single Threaded | 2640 |
String Sorting | 119896 |
Passmark Memory Scores
| BENCHMARK | SCORE |
|---|---|
Memory Mark | 2777 |
Database Operations | 24127 |
Memory Latency | 67 |
Memory Read Cached | 26410 |
Memory Read Uncached | 16540 |
Memory Write | 17058 |
Stress-ng Raw Scores
Stress-ng Relative Multicore Performance
LLM Inference Speed for Prompt Processing
LLM Inference Speed for Text Generation
Static Web Server
Redis
Alternatives
Servers of the Same Family
| INSTANCE | vCPUs | MEMORY | GPUs |
|---|---|---|---|
| g6.xlarge | 4 | 16 GiB | 1 |
| g6.2xlarge | 8 | 32 GiB | 1 |
| g6.4xlarge | 16 | 64 GiB | 1 |
| g6.8xlarge | 32 | 128 GiB | 1 |
| g6.12xlarge | 48 | 192 GiB | 4 |
| g6.24xlarge | 96 | 384 GiB | 4 |
| g6.48xlarge | 192 | 768 GiB | 8 |
Similar Servers
| INSTANCE | VENDOR | vCPUs | MEMORY | GPUs |
|---|