Cloud GPU Rental Price Index
We track posted cloud GPU rental prices for 17 models across 75 providers, covering on-demand, spot, and reserved rates.
Last released has the largest price increase among the three groups. Its on-demand median rose from $2.12 per GPU-hour in October 2024 to $5.45 in November 2026. Over the same period, Modern moved from $1.35 to $1.60, while Legacy fell from $1.77 to $1.06.
Each median uses the listings present that month. Providers, GPU variants, and available models can change. GPU groups stay fixed for comparison:
Category | GPUs | Role |
|---|---|---|
Last released (2024 and later) | B200, B300, MI300X, RTX 5090 | Newest-generation cohort |
Modern (2020 through 2023) | H100, H200, A100, L40S, RTX 4090, A10G, T4, L4 | Mainstream workload-runners |
Legacy (pre-2020) | V100, P100, K80, M60, P40 | Still rentable, mostly community-tier neoclouds |
These labels identify the index groups. T4 remains in Modern despite its earlier release date. Each GPU contributes equally to its group median, regardless of listing volume.
See our GPU index methodology for how this is computed.
Price trends by GPU model
H100’s November on-demand median is $3.92 per GPU-hour, compared with $4.61 for H200 and $1.94 for A100. Lium‘s H100 on-demand median for November is $1.79 per GPU-hour. L40S is $1.60. RTX 4090 and RTX 5090 are below a dollar, at $0.48 and $0.72 respectively.
IONOS prices H100 and H200 monthly instead of hourly, at a flat $3,990 per dedicated server with EU data residency. Its on-demand catalog covers T4, A10, and RTX PRO 6000 Blackwell.
B200 and B300 have medians of $7.99 and $9.32, respectively. MI300X is $2.92, below H100, while the V100 reference line is $0.99.
These prices combine physical variants sold under the same GPU model name. A100 includes both 40 GB and 80 GB cards. PCIe, SXM, and NVL listings can also differ. The cloud GPU pricing tables separate memory and interconnect variants where the source identifies them.
Hourly price alone does not measure the cost of completing a workload. The multi-GPU benchmark compares measured performance on H100, H200, B200, and MI300X.
Price trends by provider
In the November 5 catalog capture, H200 on-demand listings range from $2.09 per GPU-hour at Beam to $13.78 at Microsoft Azure. The range includes different instance configurations and stock states.
The cloud GPU provider comparison covers the companies behind these listings. Select a provider and billing tier in the explorer; each line shows that provider’s monthly median for one GPU model. Storage, networking, service terms and GPU count still need checking against the actual instance.
Supply and availability
MI300X has no listings marked available in the November 5 capture. Confirmed availability is 10% for B300 and 15% for B200. H100 reaches 30%, while RTX 4090 and RTX 5090 reach 57% and 35%.
Unknown stock status accounts for 84% of MI300X listings, so the snapshot does not establish that all capacity is sold out. The denominator includes available, unknown, waitlisted, and unavailable listings across billing tiers.
These percentages describe catalog entries, not physical GPU inventory. Marketplace listing turnover can change them even without a comparable change in installed capacity.
On-demand and reserved prices
In the November 2 weekly data, B300’s reserved median is $5.02 per GPU-hour against $9.32 on-demand. H100 has a $0.66 gap between its $3.26 reserved and $3.92 on-demand medians.
MI300X also has a lower reserved median: $2.37 against $2.92 on-demand. These medians use separate provider pools. A same-provider quote is needed to establish the discount for an identical instance.
Reservation records include different commitment lengths. The plotted median combines those terms, which need checking against an individual quote.
Spot discounts
November’s spot discount is 46.2% for Modern GPUs, 45.7% for Last released, and 60.5% for Legacy. These percentages pair on-demand and spot prices from the same provider, GPU model, and month.
Pairs need both rates to enter the calculation. Differences in instance variants can remain within a GPU model, and a category with sparse spot coverage represents fewer comparisons. Spot capacity is interruptible. These rates do not include the cost of restarting work.
GPU index methodology
The analysis covers publicly listed GPU rental prices and weekly price history from July 2024 through November 2, 2026. The curated history includes 17 GPU models and 86 providers. Availability uses the catalog captured on November 5, 2026; additional models and providers fall outside the curated selection.
All prices are US dollars per GPU-hour. Monthly trends first take the median of weekly observations for each provider, GPU, and billing tier. The model chart then takes the median across providers. The category chart takes one more median across the GPUs in each group.
The category chart’s Average option is the arithmetic mean of its on-demand, spot, and reserved category medians. Months need all three rates to qualify. It is an analytical summary, not a purchasable rate.
The provider explorer stops before cross-provider aggregation. Lines connect observed months, including gaps. Availability uses the current offerings snapshot. Reservation prices use the latest week and require at least four providers with reservation records for a GPU.
Spot discounts use (on-demand − spot) / on-demand × 100 for each matched provider, GPU, and month. We take the median across providers, then across GPUs within each category.
Contact-sales quotes and negotiated enterprise contracts fall outside the index. It does not measure throughput, regional capacity, or total operating cost.
Add as preferred sourceFAQs
This update uses a November 5, 2026 catalog capture and weekly history through November 2. Monthly medians include the available observations; November is a partial month.
GPU variants, host CPU and RAM, GPU count, networking, region, service terms and stock status can differ. The index compares listed per-GPU rates; it does not isolate the price of each bundled service.
Spot capacity can suit jobs that save checkpoints and tolerate interruption. Compare the listed savings with restart costs and the provider’s interruption rules. Services requiring continuous availability need a suitable failover plan.
The provider chart includes published on-demand, spot and reserved rates where available. Reserved records combine different commitment lengths. Contact-sales quotes and negotiated enterprise terms fall outside the index.
Further reading
- Multi-GPU Benchmark: B200 vs H200 vs H100 vs MI300X
- Cloud GPU Providers & Their GPUs
- GPU Concurrency Benchmark
- Top 25+ AI Chip Makers: NVIDIA & Its Competitors
Cite this research
Pick the format that matches where you're publishing. Pasting the link version into your CMS preserves the backlink.
@misc{sari2026,
author = {Sarı, Ekrem},
title = {{Cloud GPU Rental Price Index}},
year = {2026},
month = nov,
howpublished = {\url{https://aimultiple.com/gpu-index}},
note = {AIMultiple. Retrieved November 6, 2026}
}Results and timestamps of 6.8 thousand data points. Download the summary data shown in this article's charts and tables as a ZIP file containing 7 CSV files.
Want the granular data behind it? Join Premium
Changelog
3 updatesUpdated the GPU index across 63 providers, with new medians, supply-confirmation rates, and reserved discounts, and IONOS added.
Replaced the medians and ranges in the Modern and Last released GPU sections with new values.
Added an "Average" billing tier option to the market summary chart in the methodology section.
Be the first to comment
Your email address will not be published. All fields are required. Comments are left in their original language.