dl1.24xlarge by Amazon Web Services
(All-cores)
(Single-core)
Specifications
Server Metadata
Vendor ID | aws |
Name | dl1.24xlarge |
Description | Deep Learning Gen1 24xlarge |
Family | dl1 |
Hw Virt | |
Status | inactive |
Observed At | 2026-07-16T23:52:42.256171 |
Availability
| REGION / ID | SPOT | ONDEMAND |
|---|---|---|
Oregon (US) / us-west-2 | 13.109 USD/h | - |
Processor
vCPUs | 96 |
Hypervisor | nitro |
CPU Allocation | Dedicated |
CPU Cores | 48 |
CPU Speed | 3 GHz |
CPU Architecture | x86_64 |
CPU Manufacturer | Intel |
CPU Family | Xeon |
CPU Model | 8275CL |
CPU L1D Cache | 32 KiB |
CPU L1D Cache Total | 2 MiB |
CPU L1I Cache | 32 KiB |
CPU L1I Cache Total | 2 MiB |
CPU L2 Cache | 1 MiB |
CPU L2 Cache Total | 48 MiB |
CPU L3 Cache | 36 MiB |
CPU L3 Cache Total | 72 MiB |
CPU Flags | fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, ht, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, arch_perfmon, rep_good, nopl, xtopology, nonstop_tsc, cpuid, aperfmperf, tsc_known_freq, pni, pclmulqdq, monitor, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, tsc_deadline_timer, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, pti, fsgsbase, tsc_adjust, bmi1, avx2, smep, bmi2, erms, invpcid, mpx, avx512f, avx512dq, rdseed, adx, smap, clflushopt, clwb, avx512cd, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, ida, arat, pku, ospke, avx512_vnni |
Ecpus | 60.3 |
Scalability | 125.62 |
System Resources and Accelerators
| MEMORY | |
|---|---|
Memory Amount | 768 GiB |
Memory Amount Actual | 768 GiB |
Memory Generation | DDR4 |
Memory Speed | 2933 Mhz |
| GPU | |
|---|---|
GPU Count | 8 |
GPU Memory Min | 32 GiB |
GPU Memory Total | 256 GiB |
GPU Manufacturer | Habana |
GPU Family | Gaudi |
GPU Model | HL-205 |
GPUs |
|
| STORAGE | |
|---|---|
Storage Size | 4000 GB |
Storage Type | nvme ssd |
Storages |
|
| NETWORK | |
|---|---|
Network Speed Baseline | 100 Gbps |
Network Speed Max | 100 Gbps |
Network Storage Speed Baseline | 19 Gbps |
Network Storage Speed Max | 19 Gbps |
Inbound Traffic | 0 GB/month |
Outbound Traffic | 0 GB/month |
IPv4 | 0 |
Server Description
An accelerator-dense platform featuring eight specialized GPUs, high-capacity NVMe storage, and strong multi-core processing for parallelized workloads.
Amazon Web Services dl1.24xlarge is a specialized deep learning server instance featuring 96 vCPUs and 48 physical cores powered by Intel Xeon 8275CL processors at 3.0 GHz. It is equipped with 768.0 GB of DDR4 memory, 4000 GB of local NVMe SSD storage, and a baseline network bandwidth of 100 Gbps. The primary acceleration is delivered by eight Habana Gaudi HL-205 GPUs providing 256 GB of total VRAM. Benchmarks indicate strong multi-core CPU performance, high memory bandwidth, and strong database and Redis throughput, though single-core metrics remain in the average tier. This hardware density makes the instance highly efficient for parallelized workloads. It is suited for deep learning model training, large-scale software compilation, database operations, and high-throughput web serving.
Economics
Performance
Memory Bandwidth
Compression
OpenSSL
Geekbench Single-Core
Geekbench Multi-Core
Passmark CPU Scores
| BENCHMARK | SCORE |
|---|---|
Mark | 62653 |
Compression | 1330179 |
Encryption | 41086 |
Extended Instructions | 85226 |
Floating Point Maths | 169673 |
Integer Maths | 317122 |
Physics | 5191 |
Prime Numbers | 366 |
Single Threaded | 2205 |
String Sorting | 150131 |
Passmark Memory Scores
| BENCHMARK | SCORE |
|---|---|
Memory Mark | 2781 |
Database Operations | 23361 |
Memory Latency | 52 |
Memory Read Cached | 26630 |
Memory Read Uncached | 10439 |
Memory Write | 10183 |
Stress-ng Raw Scores
Stress-ng Relative Multicore Performance
Static Web Server
Redis
Alternatives
Servers of the Same Family
| INSTANCE | vCPUs | MEMORY | GPUs |
|---|
Similar Servers
| INSTANCE | VENDOR | vCPUs | MEMORY | GPUs |
|---|