Compare · prices checked 2026-09-03
RTX A6000 vs RTX 4090: specs, price per hour, which to rent
NVIDIA RTX A6000 (48 GB, $0.281/hr) against NVIDIA RTX 4090 (24 GB, $0.262/hr): public specs side by side, live fixed prices from our sheet, what fits in each card's VRAM, and a verdict written for real workloads — both are rentable right now.
RTX A6000 vs RTX 4090 specifications
Public NVIDIA figures (dense, non-sparsity). The last column is RTX A6000 relative to RTX 4090.
| Spec | RTX A6000 | RTX 4090 | Difference |
|---|---|---|---|
| Architecture | Ampere (2020) | Ada Lovelace (2022) | — |
| VRAM | 48 GB GDDR6 | 24 GB GDDR6X | +100% |
| Memory bandwidth | 768 GB/s | 1,008 GB/s | −24% |
| FP16 tensor (dense) | 155 TFLOPS | 330 TFLOPS | −53% |
| FP32 | 38.7 TFLOPS | 82.6 TFLOPS | −53% |
| CUDA cores | 10,752 | 16,384 | −34% |
| TDP | 300 W | 450 W | −33% |
| PCIe · NVLink | Gen 4.0 · no NVLink | Gen 4.0 · no NVLink | — |
| PowerScore (RTX 3090 = 100) | 109 | 232 | −53% |
| Max GPUs per machine | 4× | 8× | — |
RTX A6000 vs RTX 4090 price per hour
Fixed rates from our sheet — every on-demand price is the marketplace median × 0.70, rounded down. Monthly = 730 hours.
| Rate | RTX A6000 | RTX 4090 | Cheaper |
|---|---|---|---|
| On-demand, per GPU-hour | $0.281 | $0.262 | RTX 4090 (−7%) |
| Interruptible, per GPU-hour | $0.140 | $0.131 | RTX 4090 |
| Reserved (3 mo), per GPU-hour | $0.182 | $0.170 | RTX 4090 |
| On-demand, per month | $205 | $191 | RTX 4090 |
| Market median (reference) | $0.40 | $0.37 | — |
| $ per 1,000 FP16 TFLOP-hours | $1.81 | $0.79 | RTX 4090 (better value) |
| $ per GB of VRAM per hour | $0.0059 | $0.0109 | RTX A6000 (better value) |
Try a full month with storage and bandwidth in the GPU cost calculator.
What fits in VRAM: 48 GB vs 24 GB
| Workload | RTX A6000 | RTX 4090 |
|---|---|---|
| Largest LLM in FP16, one card | ~14B | ~8B |
| Largest LLM at 4-bit, one card | ~72B | ~32B |
| Flux dev (FP8, ~17 GB) | fits | fits |
| Wan 2.x 14B video (offloaded) | yes | yes |
| 70B 4-bit LLM on one card | yes | no |
Rules of thumb: ~2.4 GB per billion parameters in FP16 all-in, ~0.62 GB in 4-bit. Full tables in the VRAM guide.
Verdict: which should you rent?
The A6000 has 48 GB with ECC at a modest rate; the 4090 has 24 GB but about twice the tensor throughput and costs less. VRAM-bound jobs (32B 4-bit, heavy scenes) go A6000; everything that fits in 24 GB runs cheaper on the 4090.
- Cheaper per hour: RTX 4090 ($0.262 vs $0.281, −7%).
- More VRAM: RTX A6000 (48 GB vs 24 GB).
- More FP16 throughput: RTX 4090 (about 2.1×).
- Best value per TFLOP-hour: RTX 4090.
- Best value per GB of VRAM: RTX A6000.
- Multi-GPU: RTX A6000 over PCIe · RTX 4090 over PCIe.
Related comparisons
- RTX 5090 vs RTX 4090 $0.318 vs $0.262 per hour Compare
- RTX 4090 vs RTX 3090 $0.262 vs $0.104 per hour Compare
- RTX 4090 vs A100 PCIE $0.262 vs $0.662 per hour Compare
- RTX 4090 vs L40S $0.262 vs $0.466 per hour Compare
- RTX 6000Ada vs RTX A6000 $0.513 vs $0.281 per hour Compare
- RTX 5080 vs RTX 4090 $0.140 vs $0.262 per hour Compare
RTX A6000 vs RTX 4090: FAQ
Deeper reading: H100 vs H200 vs B200, RTX 4090 vs RTX 5090, how cloud GPU pricing works.
Is the RTX 4090 faster than the RTX A6000?
On dense FP16 tensor throughput the RTX 4090 leads by about 2.1× (330 vs 155 TFLOPS). Memory bandwidth matters as much for inference: RTX A6000 768 GB/s vs RTX 4090 1,008 GB/s.
Which is cheaper to rent, the RTX A6000 or the RTX 4090?
The RTX 4090: $0.262/hr on-demand versus $0.281/hr — 7% less. Interruptible rates are $0.140 (RTX A6000) and $0.131 (RTX 4090). Per TFLOP-hour the better value is the RTX 4090.
Which has more VRAM and what does that change?
The RTX A6000 has 48 GB versus 24 GB. In LLM terms that is roughly a 14B FP16 model (or ~72B in 4-bit) on one card against 8B FP16 (~32B 4-bit). If the model does not fit, speed is irrelevant.
Can I rent both on PowerGPU right now?
Yes — 28 × RTX A6000 and 439 × RTX 4090 are online as this page renders, deployable in about 30 seconds, billed per second, paid in crypto with no KYC.