Full disclosure, our tool is geared around GPU rentals, but this is a decision framework, not a sales pitch, and the numbers are checkable. The question of whether you should rent or buy a GPU is becoming more common and most people rely on instinct alone to make their decision, which could cost you thousands - so here's the arithmetic so you can know for sure in three simple steps.
Step 1: Measure your honest duty cycle.
Not the hours you imagine you'll use the card, the hours it's actually computing after idle nights, dev cycles, failed runs, and gaps between experiments. This is the number everything else hinges on, and it's almost always lower than people guess. Most orgs land at 30 - 50% average utilisation while feeling like they're running the card hard.
Step 2: Compare it to your card's break-even.
This is just where owned cost = rental cost:
-
RTX 5090 rig (~$5,700, nets to ~$4,020 after resale): break-even vs a $0.99/hr rental is ~130 hours/month (an 18% duty cycle). Low bar. A hobbyist can clear it, and the always-on, no-cold-start sandbox has real value at that price. Buying a 5090 is often the right call.
-
8-GPU H100 DGX (north of $350k): owned all-in is ~$1.72/GPU-hr at 100% utilisation (A whitebox HGX build runs nearer $250k, pulling all-in to ~$1.36 and break-even to ~40%, but the structural case below doesn't move). Against on-demand cloud at $2.89 - 3.29 that's a 44 - 52% break-even; against spot at $1.03–1.99 it's 82% to... never. At the low end, renting beats owning even if the server never idles, because the renter's idle cost is $0 and yours is the full depreciation.
Step 3: Check the structural gates.
Even above break-even, ownership for more expensive cards only really wins if one of these is true:
-
You own the datacenter. Industrial power (~8.5¢/kWh) and no colo fee drop H100 owned cost to ~$1.37/GPU-hr and break-even to 39 - 45%. This is the single biggest lever in the whole calc.
-
A hard constraint forces your hand: latency-as-the-product (edge/robotics), or data gravity/regulation where renting isn't allowed and the break-even is moot.
-
You can lock a genuinely scarce part, as that's a capacity bet, not a cost bet, and worth naming as such.
After running the three steps the answer for most teams is that they should rent, ideally with a committed/reserved contract if usage is steady. That allows them to capture most of the savings without the depreciation risk. NVIDIA now ships a new generation every year, so an owned card is competitively stale within about a year while you still owe its full depreciation. Renting hands that obsolescence risk to a provider who pools the card across tenants and keeps it busy; a single owner at 30 - 50% utilisation simply can't.
As a side note, we are genuinely curious what duty cycles people here actually measure once dev cycles and failed runs are subtracted; that's the number the whole decision turns on, and it's the one most people never log.
