GPU Comparison

NVIDIA A100 PCIevsNVIDIA L40S

Detailed specifications, performance benchmarks, and pricing comparison to help you choose the right GPU for your AI workloads.

NVIDIA

NVIDIA A100 PCIe

Ampere · 2020

VRAM80 GB HBM2e
FP3219.5 TFLOPS
FP1678 TFLOPS
Bandwidth1935 GB/s
TDP300W
Price$0.98/hr
NVIDIA

NVIDIA L40S

Ada Lovelace · 2023

Faster
VRAM48 GB GDDR6
FP3291.6 TFLOPS
FP16183 TFLOPS
Bandwidth864 GB/s
TDP350W
Price$0.85/hr

Specifications · Comparison

Side by side specs.

SpecNVIDIA A100 PCIeNVIDIA L40S
ArchitectureAmpereAda Lovelace
VRAM80 GB+66.7%48 GB
Memory TypeHBM2eGDDR6
Memory Bandwidth1935 GB/s+124.0%864 GB/s
FP32 Performance19.5 TFLOPS91.6 TFLOPS+78.7%
FP16 Performance78 TFLOPS183 TFLOPS+57.4%
INT8 Performance624 TOPS733 TOPS+14.9%
TDP300W350W
Form FactorPCIePCIe
Price (avg/hr)$0.98$0.85

Performance · Analysis

Performance breakdown.

Compute (FP32)

Raw single-precision floating point throughput

NVIDIA A100 PCIe
19.5TFLOPS
NVIDIA L40S
91.6TFLOPSWinner

NVIDIA L40S is 78.7% faster

Training (FP16)

Half-precision performance for deep learning training

NVIDIA A100 PCIe
78TFLOPS
NVIDIA L40S
183TFLOPSWinner

NVIDIA L40S is 57.4% faster

Inference (INT8)

Integer performance for model inference workloads

NVIDIA A100 PCIe
624TOPS
NVIDIA L40S
733TOPSWinner

NVIDIA L40S is 14.9% faster

Memory Bandwidth

Data transfer rate between memory and compute units

NVIDIA A100 PCIe
1935GB/sWinner
NVIDIA L40S
864GB/s

NVIDIA A100 PCIe is 124% faster

Best Compute

NVIDIA L40S

Most Memory

NVIDIA A100 PCIe

Best Training

NVIDIA L40S

Best Value

NVIDIA L40S

Pricing · Cost

Cost comparison.

Hourly

NVIDIA A100 PCIe
$0.98/hr
NVIDIA L40S
$0.85/hr

Save $0.13 with NVIDIA L40S

Daily

NVIDIA A100 PCIe
$23.52/day
NVIDIA L40S
$20.40/day

Save $3.12 with NVIDIA L40S

Monthly

NVIDIA A100 PCIe
$705.60/mo
NVIDIA L40S
$612.00/mo

Save $93.60 with NVIDIA L40S

Use Cases · Workloads

Best for your workload.

NVIDIA

NVIDIA A100 PCIe

ML Training
AI Inference
Edge AI
NVIDIA

NVIDIA L40S

AI Inference
Graphics Rendering
Video Processing

Platform · Benefits

Why Runcrate.

Instant Deployment

Get your GPU instance running in minutes with pre-configured AI environments. No setup complexity.

Pay Per Hour

Only pay for the compute you actually use. Prepaid credits with transparent, per-hour billing.

Reliable Infrastructure

Enterprise-grade reliability with automatic failover and data persistence across sessions.

FAQ · Questions

Common questions.

Start Building Today

Deploy NVIDIA A100 PCIe or NVIDIA L40S

Get started with GPU cloud computing in minutes. No setup complexity, no long-term commitments.

No credit card required
Pay-per-hour billing
Cancel anytime