Was my $48K GPU server worth it?
This title could be clearer and more informative.Try out Clickbait Shieldfor free (5 uses left this month).
An independent ML researcher shares a detailed cost-benefit analysis of building a $48K custom 6x RTX 6000 Ada GPU server versus renting equivalent cloud compute. After tracking GPU utilization (averaging 76% overall, 85% since Jan 2025) and electricity costs (~$3K total), the equivalent cloud rental would have cost $68K, yielding $17K in savings so far. The post covers GPU selection rationale, apartment power constraints, build pitfalls (slow GPU interconnect due to dual PSU setup, PCIe riser failures), and practical advice including a recommendation to use colocation with a standard datacenter server instead of a custom build.
Table of contents
GPUs as an investmentChoosing the GPUsPower ConstraintsBuilding my own GPU server vs. using a Cloud ProviderGPU usage over time graphFinal CalculationThe Real Final CalculationAdvice/Other notes414 Impressions1 Comment