scripod.com
The state of homelab tech (2025) (Friends)

Overview

Shownote

Highlights

Transcript

Chapters

Pins

The state of homelab tech (2025) (Friends)

The Changelog: Software Development, Open Source

2025/02/07
The Changelog: Software Development, Open Source

The Changelog: Software Development, Open Source

2025/02/07
OverviewShownoteHighlightsTranscriptChaptersPins

Shownote

Techno Tim joins Adam to catch up on the state of Homelab for 2025, the state of AI at home and on-prem (AI Homelab) and where that's heading, building a creator PC, choosing the parts for your build, GPU availability, Windows being user hostile, and why T...

Highlights

In this episode, Techno Tim joins Adam to delve into the evolving landscape of homelab technology for 2025. They explore the integration of AI in home setups, discuss building a creator PC, and examine the challenges and opportunities in GPU availability and operating system choices. The conversation also touches on the growing trend of self-hosted AI solutions and the benefits of using both Windows, Mac, and Linux.
00:14
The episode welcomes listeners to a discussion about AI homelab
00:41
Brex runs around 1,000 Retool apps in production weekly
03:25
Habit started in high school and college due to a rushed morning routine
05:36
Almonds can sometimes be too hard unless roasted
06:36
Accents can differ greatly even within small geographic areas.
08:40
Discussion transitions to homelab tech and AI homelab topics
09:56
Many people start with a media server and expand into complex setups.
11:57
Moving from large, power-hungry setups to efficient alternatives like Silverstone RM4250
13:14
Initially over-indexed on compute power with enterprise servers.
16:57
Content creation started as a hobby and evolved into a passion
20:28
Creating YouTube content requires significant effort, including numerous iterations and A/B testing.
23:09
Cameras should adopt modern interfaces and Ethernet connections for faster data transfer.
30:36
Creator expresses discomfort with constant self-promotion
32:32
Delivering valuable content without overextending introductions
36:12
Host feels compelled to build a more capable AI homelab
41:27
Self-hosting LLMs enables building tools with specific functionalities using REST APIs.
43:30
High costs associated with training AI models can reach billions of dollars.
45:19
Temporal abstracts the complexity of distributed systems, allowing teams to focus on business logic.
55:04
ChatGPT helps avoid online ads and stay focused on tasks
55:49
GPUs are hard to find and expensive, driven by high demand
56:19
Decent used 3090s can be found for $900 to $1,500 on eBay
58:01
OLAMA.com offers easy integration for local AI models
1:04:15
Cloud services like Azure offer flexibility for experimenting with AI
1:06:28
Resistance to AI may lead to being left behind.
1:08:22
AI chat models serve as tools for generating rough drafts and solving niche problems
1:14:49
The guest mentions a video on building the ultimate Linux workstation.
1:17:54
Intel CPUs recommended for better multitasking, low heat, and power consumption
1:22:55
Windows offers better hardware compatibility and flexibility for developers
1:27:10
Apple's premium pricing includes valuable family communication features.
1:30:05
Switching entirely to Apple means giving up certain functionalities
1:31:24
Data brokers sell private information online, leading to identity theft and harassment.
1:35:38
GPU prices can reach $2,000 to $2,500
1:38:34
TechNotim is a valuable resource for hardware selection.
1:41:24
Intel now matches AMD with 24 PCIe lanes
1:45:27
NVIDIA's 3080 GPU prioritized gaming performance over CUDA cores for machine learning.

Chapters

Let's talk!
00:00
Sponsor: Retool
00:37
Skipping breakfast
03:23
Tim snacks
05:36
PEE CAN or Pecan?
06:36
Berdoll Pecans FTW
08:40
Let's talk Homelab
09:53
How Homelab began
11:57
Smaller and less power is the way
13:14
What's motivates Tim?
16:56
Script it OR wing it?
20:26
Cameras for filming
23:09
Content practices and workflows
28:13
Changelog core beliefs
32:29
Homelab stuff that's resonating with Adam
36:12
AI Homelab
38:33
On-prep AI is the future
43:24
Sponsor: Temporal
45:11
Self-hosting AI
47:13
AI at home is the next frontier
55:47
GPUs on eBay
56:19
Local AI and Ollama are the way
58:01
Make Ollama first-class integration
1:04:15
AI as a Service on my LAN (AIaaS)
1:06:26
GPT is the first draft word calculator
1:08:20
AI builds from Tim
1:14:48
Building a creator PC
1:15:20
BUT Windows is user hostile
1:20:33
Paying the Apple tax
1:27:08
Why not BOTH Windows and Mac?
1:30:00
Sponsor: DeleteMe
1:31:24
Adam's creator PC build
1:33:16
Understanding the various GPUs
1:38:34
Planning for PCIe lanes
1:41:19
Gamers pushed the innovation
1:45:27

Transcript

Adam Stacoviak: Welcome to Changelog and Friends, the weekly talk show about AI homelab. Big thank you to our friends and our partners at Fly.io, the public cloud built for developers who ship. that's you, that's me, that's us. Over three million apps have...