Fitting AI models in your pocket with quantization
A Qualcomm expert breaks down some of the tools and techniques they use to fit GenAI models on a smartphone.


A Qualcomm expert breaks down some of the tools and techniques they use to fit GenAI models on a smartphone.
Ben and senior software engineer Kyle Mitofsky are joined by two people who worked on the launch of Overflow AI: director of data science and data platform Michael Foree and senior software developer Alex Warren. They talk about how and why Stack Overflow launched semantic search, how to ensure a knowledge base is trustworthy, and why user prompts can make LLMs vulnerable to exploits.
Knowledge management and AI, VPN security, and an SVG deep dive.
Large language models seem to possess the ability to reason intelligently, but does that mean they actually know things?
Why replacing programmers with AI won’t be so easy.
The home team unpacks their complicated feelings about AI, the Beyoncé deepfake that got kpop hopes up, and the pandemic’s ripple effects on today’s teenagers. Ben, the world’s worst coder, tells Cassidy and Ceora about building a web app with an AI assistant.