scripod.com

How this visually impaired engineer uses Claude Code to make his life more accessible | Joe McCormick

How I AI

Feb 16
How I AI

How I AI

Feb 16

Shownote

Joe McCormick is a principal software engineer at Babylist who lost most of his central vision due to a rare genetic disorder right before starting college. He pivoted from mechanical engineering to computer science and now leads AI enablement at Babylist. Joe demonstrates how he uses AI to build micro Chrome extensions that make his everyday work and life more accessible, showing how personal software can address accessibility needs that mainstream products often overlook. What you’ll learn: 1. How to build custom Chrome extensions in under 25 minutes using Claude Code 2. A practical workflow for creating AI-powered accessibility tools 3. How to use Claude Skills to accelerate repetitive development tasks 4. Techniques for making Claude Code more screen reader accessible 5. Why personal software is becoming increasingly viable with AI assistance 6. How multimodal AI is transforming accessibility for visually impaired users — Brought to you by: Tines [https://tines.com/howiai]—Start building intelligent workflows today — Detailed workflow walkthroughs from this episode: • How I AI: Building Custom AI Accessibility Tools for Slack with Joe McCormick & Claude Code: https://www.chatprd.ai/how-i-ai/custom-ai-accessibility-tools-for-slack-claude-code [https://www.chatprd.ai/how-i-ai/custom-ai-accessibility-tools-for-slack-claude-code] • Build a Slack Link Summarizer from Scratch using Claude Code: https://www.chatprd.ai/how-i-ai/workflows/slack-link-summarizer-using-claude-code [https://www.chatprd.ai/how-i-ai/workflows/slack-link-summarizer-using-claude-code] • Create a Fast, Accessible AI Spell Checker for Any Website: https://www.chatprd.ai/how-i-ai/workflows/accessible-ai-spell-checker-for-any-website [https://www.chatprd.ai/how-i-ai/workflows/accessible-ai-spell-checker-for-any-website] • Build a Custom AI Tool to Describe Images in Slack: https://www.chatprd.ai/how-i-ai/workflows/ai-tool-to-describe-images-in-slack [https://www.chatprd.ai/how-i-ai/workflows/ai-tool-to-describe-images-in-slack] — In this episode, we cover: (00:00) Introduction to Joe and his background (02:34) Joe’s journey into computer science after vision loss (04:50) The concept of personal software for accessibility (06:09) Demo of image description Chrome extension for Slack (10:40) Demo of AI-powered spell checker extension (13:12) The efficiency of keyboard shortcuts for accessibility (14:37) Live building a link summarization extension (20:28) Using Claude Skills to extract common patterns (25:30) Reviewing and modifying the development plan (27:45) Removing cognitive friction for users through repeating patterns (31:40) How to get fluent with AI tools (34:55) Loading the extension into Chrome in developer mode (36:19) Testing and debugging the extension (40:44) Quick recap (42:12) Lightning round and final thoughts — Tools referenced: • Claude Code: https://claude.ai/code [https://claude.ai/code] • VS Code: https://code.visualstudio.com/ [https://code.visualstudio.com/] • Gemini: https://gemini.google.com/ [https://gemini.google.com/] • ChatGPT: https://chat.openai.com/ [https://chat.openai.com/] • Meta Ray-Ban Smart Glasses: https://www.meta.com/smart-glasses/ [https://www.meta.com/smart-glasses/] — Other references: • Chrome Extensions Documentation: https://developer.chrome.com/docs/extensions/ [https://developer.chrome.com/docs/extensions/] • ARIA (Accessible Rich Internet Applications): https://developer.mozilla.org/en-US/docs/Web/Accessibility/ARIA [https://developer.mozilla.org/en-US/docs/Web/Accessibility/ARIA] • Windows Subsystem for Linux: https://learn.microsoft.com/en-us/windows/wsl/ [https://learn.microsoft.com/en-us/windows/wsl/] • Screen Readers: https://www.afb.org/blindness-and-low-vision/using-technology/assistive-technology-products/screen-readers [https://www.afb.org/blindness-and-low-vision/using-technology/assistive-technology-products/screen-readers] • Claude Skills explained: How to create reusable AI workflows:https://www.lennysnewsletter.com/p/claude-skills-explained [https://www.lennysnewsletter.com/p/claude-skills-explained] — Where to find Joe McCormick: LinkedIn: https://www.linkedin.com/in/joemccormickjr/ [https://www.linkedin.com/in/joemccormickjr/] Company: https://www.babylist.com/ [https://www.babylist.com/] — Where to find Claire Vo: ChatPRD: https://www.chatprd.ai/ [https://www.chatprd.ai/] Website: https://clairevo.com/ [https://clairevo.com/] LinkedIn: https://www.linkedin.com/in/clairevo/ [https://www.linkedin.com/in/clairevo/] X: https://x.com/clairevo [https://x.com/clairevo] — Production and marketing by https://penname.co/ [https://penname.co/]. For inquiries about sponsoring the podcast, email jordan@penname.co.

Highlights

This episode features Joe McCormick, a principal software engineer at Babylist who navigated a significant vision loss before college and now leads AI enablement—building custom, accessible tools that empower his daily work and life.
00:00
Joe uses Gemini and ChatGPT to handle images and answer follow-up questions
02:34
With the rise of AI, the gap between sighted and visually-impaired software engineers is closing
04:50
AI allows people to build customized accessibility solutions for themselves
06:10
Image description tool in Slack enables independent visual understanding without relying on others or sight
10:45
Joe built an AI spell checker that works in any web input field, sending text to OpenAI to correct typos
13:12
Keyboard shortcuts enable efficient micro app triggering in AI tools
17:15
Engineers can use AI to write good PRDs without custom prompts, relying on foundational models
20:28
Claude Code now supports editing prompts in a text editor for better screen reader accessibility
25:30
Ctrl G shortcut enables fast plan editing in the editor
27:50
Claude Code standardizes inputs, reducing cognitive friction for users
31:42
Building personal software to automate recurring tasks shrinks the payback period to virtually zero
34:56
Chrome developer mode allows installing extensions from a local computer for easy testing
39:09
Moving JSON out of the prompt ensures the response object is valid JSON for reliable Chrome extension parsing
40:44
The extension parses shared Slack links to extract key takeaways using AI-generated code with minor human tweaks.
44:56
Gemini's live-share feature allows a visually impaired parent to read any physical book with his kids

Chapters

Introduction to Joe and his background
00:00
Joe’s journey into computer science after vision loss
02:34
The concept of personal software for accessibility
04:50
Demo of image description Chrome extension for Slack
06:09
Demo of AI-powered spell checker extension
10:40
The efficiency of keyboard shortcuts for accessibility
13:12
Live building a link summarization extension
14:37
Using Claude Skills to extract common patterns
20:28
Reviewing and modifying the development plan
25:30
Removing cognitive friction for users through repeating patterns
27:45
How to get fluent with AI tools
31:40
Loading the extension into Chrome in developer mode
34:55
Testing and debugging the extension
36:19
Quick recap
40:44
Lightning round and final thoughts
42:12

Transcript

Joe McCormick: Right before I started college, I ended up losing most of my central vision due to a rare genetic disorder called Lieber's Hereditary Optic Neuropathy. I was talking with someone who was losing their sight recently from the same disease, and...