It’s 2024 and everyone’s going ga-ga for AI.  And to really do AI right, you need GPUs.  Ideally, an entire datacenter full of them and a fleet of PhDs to go along with the gear, but let’s keep with the DIY ethos here.

A good GPU card can set you back close to $2,000, plus the system around it to run.  Now if you’re really doing a project in this space, you’re stuffing Nvidia gear into cases but what if you’re a hobbyist or just working on a short-term project?

You rent a GPU.

Problem is, they’re frightfully expensive.

Here’s a few places where you can look to find cheaper prices.  And keep it reasonable…there’s no $5/month Kimsufi in the GPU space.

These sites work by matching together providers and consumers in an open marketplace.  Let’s try them.  I’l say I want a system with 80GB of VRAM, like an A100.

Tensordock: I found a server in Prague for $1.64/hour that includes the A100 PCIE, 2 AMD Epyc 7513 vCPUs, 16GB of RAM, 200GB NVMe.  That’s pretty cheap for an A100.

RunPod: A PCIE A100 here is about $1.89/hour.  This interface is less granular than Tensordock’s.  You’re essentially picking the GPU without a lot of options for sizing everything else.

Vast: Here a PCIE A100 is as cheap as $1.35/hour.  That’s in Oklahoma.

Do you have any markets you go to when you’re looking for cheap GPUs?  Please share in the comments below!

• Author
• Recent Posts

raindog308

Dread Lord of LowEnd Content at LowEndBox

I'm raindog308, techno polymath and long-time LowEndTalk community Administrator. My technical interests include all things Unix, perl, python, golang, shell scripting, vintage operating systems such as MVS, and relational database systems such as Oracle, PostgreSQL, and MySQL.

I also enjoy using LEBs! I have an empire of little guys for VPNs, larger guys for apps, and big guys for databases and storage. When I'm not in front a screen I'm into German Shepherd dogs, quality knives, target shooting, theology, tabletop roleplaying games, and forest hiking.

I enjoy writing technical articles here on LowEndBox to help people get more out of their systems. You can find me on LowEndTalk @raindog308

Latest posts by raindog308 (see all)

• Let’s Celebrate the Winter Solstice with Awesome Deals and a Free Bonus Code for RackNerd’s Giveaway! - December 22, 2024
• MetWeb has a 30% Off Deal on Cheap VPS Offers in Utah for Our Readers! - December 21, 2024
• Is Your Soul as Dark as a Christmas Stocking’s Coal?Make Your Online World Match - December 20, 2024