g2-standard-96 by Google Cloud Platform

g2-standard-96 is a Graphics Optimized: 8 NVIDIA L4 GPUs, 96 vCPUs, 384GB RAM server offered by Google Cloud Platform with 96 vCPUs, 384 GiB of memory and 0 GB of storage. The pricing starts at 4.0523 USD per hour.
96 vCPU
384 GiB Memory
8 GPU
Spare SCore
75,746
(All-cores)
1,201
(Single-core)

Specifications

Server Metadata

Vendor ID
gcp
Server ID
1600096
Name
g2-standard-96
Description
Graphics Optimized: 8 NVIDIA L4 GPUs, 96 vCPUs, 384GB RAM
Family
g2
Hw Virt
Average Time To Start
20
Status
active
Observed At
2026-10-05T09:20:28.074822

Availability

REGION / IDSPOTONDEMAND
Ashburn (US) / us-east4
4.2561 USD/h 7.9771 USD/h
Council Bluffs (US) / us-central1
4.8013 USD/h 8.0033 USD/h
The Dalles (US) / us-west1
4.8013 USD/h 8.0033 USD/h
Moncks Corner (US) / us-east1
4.8013 USD/h 8.0033 USD/h
Mumbai (IN) / asia-south1
4.2432 USD/h 8.3311 USD/h
Eemshaven (NL) / europe-west4
5.0466 USD/h 8.4119 USD/h
Montréal (CA) / northamerica-northeast1
5.2737 USD/h 8.8125 USD/h
Toronto (CA) / northamerica-northeast2
5.2859 USD/h 8.8125 USD/h
St. Ghislain (BE) / europe-west1
5.2876 USD/h 8.8125 USD/h
Las Vegas (US) / us-west4
5.409 USD/h 9.0142 USD/h
London (GB) / europe-west2
5.4675 USD/h 9.1125 USD/h
Changhua County (TW) / asia-east1
5.5522 USD/h 9.2671 USD/h
Frankfurt (DE) / europe-west3
5.6313 USD/h 9.4322 USD/h
Jurong West (SG) / asia-southeast1
5.9249 USD/h 9.8737 USD/h
Seoul (KR) / asia-northeast3
4.0523 USD/h 10.2779 USD/h
Tokyo (JP) / asia-northeast1
6.1504 USD/h 10.2779 USD/h
Zurich (CH) / europe-west6
6.5131 USD/h 10.8829 USD/h
Dammam (SA) / me-central2
6.8987 USD/h 12.8053 USD/h

Processor

vCPUs
96
CPU Allocation
Dedicated
CPU Cores
48
CPU Speed
2.2 GHz
CPU Architecture
x86_64
CPU Manufacturer
Intel
CPU Family
Xeon
CPU L1D Cache
32 KiB
CPU L1D Cache Total
2 MiB
CPU L1I Cache
32 KiB
CPU L1I Cache Total
2 MiB
CPU L2 Cache
1 MiB
CPU L2 Cache Total
48 MiB
CPU L3 Cache
39 MiB
CPU L3 Cache Total
77 MiB
CPU Flags
fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, ht, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, rep_good, nopl, xtopology, nonstop_tsc, cpuid, tsc_known_freq, pni, pclmulqdq, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, ssbd, ibrs, ibpb, stibp, ibrs_enhanced, fsgsbase, tsc_adjust, bmi1, hle, avx2, smep, bmi2, erms, invpcid, rtm, mpx, avx512f, avx512dq, rdseed, adx, smap, clflushopt, clwb, avx512cd, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, arat, avx512_vnni, md_clear, arch_capabilities
Ecpus
63
Scalability
65.62

System Resources and Accelerators

MEMORY
Memory Amount
384 GiB
Memory Amount Actual
384 GiB
GPU
GPU Count
8
GPU Memory Min
24 GiB
GPU Memory Total
192 GiB
GPU Manufacturer
NVIDIA
GPU Family
Ada Lovelace
GPU Model
L4
GPUs
  • NVIDIA Ada Lovelace NVIDIA L4 (Memory amount: 23034, Firmware version: 590.48.01, BIOS version: 95.04.29.00.07, Clock rate: 2040)
  • NVIDIA Ada Lovelace NVIDIA L4 (Memory amount: 23034, Firmware version: 590.48.01, BIOS version: 95.04.29.00.07, Clock rate: 2040)
  • NVIDIA Ada Lovelace NVIDIA L4 (Memory amount: 23034, Firmware version: 590.48.01, BIOS version: 95.04.29.00.07, Clock rate: 2040)
  • NVIDIA Ada Lovelace NVIDIA L4 (Memory amount: 23034, Firmware version: 590.48.01, BIOS version: 95.04.29.00.07, Clock rate: 2040)
  • NVIDIA Ada Lovelace NVIDIA L4 (Memory amount: 23034, Firmware version: 590.48.01, BIOS version: 95.04.29.00.07, Clock rate: 2040)
  • NVIDIA Ada Lovelace NVIDIA L4 (Memory amount: 23034, Firmware version: 590.48.01, BIOS version: 95.04.29.00.07, Clock rate: 2040)
  • NVIDIA Ada Lovelace NVIDIA L4 (Memory amount: 23034, Firmware version: 590.48.01, BIOS version: 95.04.29.00.07, Clock rate: 2040)
  • NVIDIA Ada Lovelace NVIDIA L4 (Memory amount: 23034, Firmware version: 590.48.01, BIOS version: 95.04.29.00.07, Clock rate: 2040)
STORAGE
Storage Size
0 GB
Storages
    NETWORK
    Inbound Traffic
    0 GB/month
    Outbound Traffic
    0 GB/month
    IPv4
    0

    CPU and System Topology

    Server Description

    A high-density GPU server featuring eight NVIDIA L4 accelerators and ninety-six vCPUs optimized for parallel computing and large language model inference.

    GPU AcceleratedCompute OptimizedGeneral Purpose

    Google Cloud Platform g2-standard-96 is a graphics-optimized server featuring eight NVIDIA L4 GPUs with 192 GB of total VRAM, 96 dedicated Intel Xeon vCPUs, and 384.0 GB of system memory. Built on the x86_64 architecture, this server does not include local storage. While single-core CPU performance and single-threaded tasks are relatively weak, the instance delivers strong multi-core capabilities and top-tier LLM inference speeds, processing up to 11350.23 tokens per second for small models. It also exhibits high memory bandwidth and strong Redis performance. Qualitatively, the high density of GPUs and dedicated vCPUs makes it a cost-efficient choice for parallelized, GPU-bound workloads rather than single-threaded applications. The g2-standard-96 is highly suited for LLM inference, multi-threaded data processing, and GPU-accelerated compute tasks.

    Economics

    Average Price per Region

    Prices per Zone

    Lowest Prices

    Performance

    Workload Profiles

    2.5Score
    Precomputed compound score for Cache Intensive workloads. A weighted average (geometric mean) of benchmark scores compared to their medians: score = ∏ (x_i / m_i)^(w_i / Σw). The score of 1.0 represents a synthetic baseline server with the median performance of each component benchmark; 0.5 means roughly half the performance; and 2.0 means twice the performance of that reference profile. Component weights: 50% Redis RPS (pipeline=1, SET), 20% Redis RPS (pipeline=16, SET), 10% PassMark Memory Mark (composite), 10% Memory bandwidth (read, 16 MB ~ L3), 10% PassMark single-thread CPU. Rationale for component selection: In-memory key-value store workload, mixing direct Redis performance metrics with memory speed and latency benchmarks, and single-core CPU performance profiles.
    Component Score Weight Impact
    Raw Reference Normalized Target Actual
    Redis RPS (pipeline=1, SET) 6,655,418 ops/sec 1,916,704 ops/sec 3.5 50.00% 50.00% +87.00%
    Redis RPS (pipeline=16, SET) 39,460,725 ops/sec 11,642,227 ops/sec 3.2 20.00% 20.00% +26.00%
    PassMark Memory Mark (composite) 2,675 2,417 1.1 10.00% 10.00% +0.96%
    Memory bandwidth (read, 16 MB ~ L3) 221,008 MB/sec 108,361 MB/sec 2 10.00% 10.00% +7.20%
    PassMark single-thread CPU 1,694 Mops/s 2,365 Mops/s 0.71 10.00% 10.00% -3.40%

    Memory Bandwidth

    Compression

    OpenSSL

    Geekbench Single-Core

    Score: 1,072

    Geekbench Multi-Core

    Score: 11,560

    Passmark CPU Scores

    BENCHMARKSCORE
    Mark
    		 49105
    Compression
    		 1032296
    Encryption
    		 31079
    Extended Instructions
    		 65697
    Floating Point Maths
    		 136123
    Integer Maths
    		 253019
    Physics
    		 4904
    Prime Numbers
    		 318
    Single Threaded
    		 1694
    String Sorting
    		 115764

    Passmark Memory Scores

    BENCHMARKSCORE
    Memory Mark
    		 2675
    Database Operations
    		 20576
    Memory Latency
    		 50
    Memory Read Cached
    		 20747
    Memory Read Uncached
    		 10667
    Memory Write
    		 10022

    Stress-ng Raw Scores

    Stress-ng Relative Multicore Performance

    LLM Inference Speed for Prompt Processing

    LLM Inference Speed for Text Generation

    Static Web Server

    Redis

    Alternatives

    Servers of the Same Family

    INSTANCEvCPUsMEMORYGPUs
    g2-standard-4 416 GiB1
    g2-standard-8 832 GiB1
    g2-standard-12 1248 GiB1
    g2-standard-16 1664 GiB1
    g2-standard-24 2496 GiB2
    g2-standard-32 32128 GiB1
    g2-standard-48 48192 GiB4

    Similar Servers

    INSTANCEVENDORvCPUsMEMORYGPUs

    g2-standard-96 FAQs