It’s 2024 and everyone’s going ga-ga for AI.  And to really do AI right, you need GPUs.  Ideally, an entire datacenter full of them and a fleet of PhDs to go along with the gear, but let’s keep with the DIY ethos here.

A good GPU card can set you back close to $2,000, plus the system around it to run.  Now if you’re really doing a project in this space, you’re stuffing Nvidia gear into cases but what if you’re a hobbyist or just working on a short-term project?

You rent a GPU.

Problem is, they’re frightfully expensive.

Here’s a few places where you can look to find cheaper prices.  And keep it reasonable…there’s no $5/month Kimsufi in the GPU space.

These sites work by matching together providers and consumers in an open marketplace.  Let’s try them.  I’l say I want a system with 80GB of VRAM, like an A100.

Tensordock: I found a server in Prague for $1.64/hour that includes the A100 PCIE, 2 AMD Epyc 7513 vCPUs, 16GB of RAM, 200GB NVMe.  That’s pretty cheap for an A100.

RunPod: A PCIE A100 here is about $1.89/hour.  This interface is less granular than Tensordock’s.  You’re essentially picking the GPU without a lot of options for sizing everything else.

Vast: Here a PCIE A100 is as cheap as $1.35/hour.  That’s in Oklahoma.

Do you have any markets you go to when you’re looking for cheap GPUs?  Please share in the comments below!

• Author
• Recent Posts

raindog308

Dread Lord of LowEnd Content at LowEndBox

I'm raindog308, techno polymath and long-time LowEndTalk community Administrator. My technical interests include all things Unix, perl, python, golang, shell scripting, vintage operating systems such as MVS, and relational database systems such as Oracle, PostgreSQL, and MySQL.

I also enjoy using LEBs! I have an empire of little guys for VPNs, larger guys for apps, and big guys for databases and storage. When I'm not in front a screen I'm into German Shepherd dogs, quality knives, target shooting, theology, tabletop roleplaying games, and forest hiking.

I enjoy writing technical articles here on LowEndBox to help people get more out of their systems. You can find me on LowEndTalk @raindog308

Latest posts by raindog308 (see all)

• I Checked And These .ge Domain Hacks Are Still Available!Get a FREE .ge Domain with $9/YEAR Hosting from Worldbus! - April 12, 2025
• How to Poison AI Scrapers With Colorless, Odorless Iocaine: The Current Arms Race Between Billionaires and Hosters - April 12, 2025
• Five Different Ways to Read Any News Article for FREE - April 11, 2025