Loading…

Issue 337: Finding the eye in the AI storm

When new technology comes along, the hype can feel like a hurricane. One day we’re told to tokenmax and the next to try to save as many tokens as we can. Finding the eye in a hype storm takes real experience and expertise, which is why we’ve packed this Overflow with conversations with just such experts.

We sat down with Fireworks AI's Benny Chen to explore the open-source protocols setting the standard for evaluating AI applications, and chatted with Snowflake's Vivek Raghunathan about turning the chaos of AI-assisted coding into a structured, five-stage repeatable playbook. Plus, Yobi's Frank Portman joined us to explore why standard LLMs aren't cut out for predicting human intent—and how they are building a "foundation model of behavior" instead.

And AI isn’t the only place on the web that’s full of chaos that people are trying to cut through. From the web, we’ve got the stories of fixing memory leaks, the final frontier of cryptography, and why arguing with people may be fun but not good for your personal growth. And chaos may reign in technology nowadays but knowledge is still king—luckily, we’ve got plenty of that for you in this issue. For instance, what constitutes a full stop? Why won’t clients pay on time? Where do commas technically go? All of that chaos and knowledge is ready for you down below.

From the blog

The good, the bad, and the AI apps

Ryan welcomes Benny Chen, co-founder of Fireworks AI, to the show to explore what actually makes an AI application good or not, how to balance qualitative signals with quantitative metrics when evaluating AI, and how open-source eval protocols and community efforts are setting the standard for AI evaluation.

How do you turn AI coding chaos into a repeatable playbook?

Vivek Raghunathan, SVP of engineering at Snowflake, joins Leaders of Code at Snowflake Summit to break down the five-stage framework his org used to go from "let chaos reign" to a repeatable, org-wide system for AI-assisted engineering.

Why intent prediction needs more than an LLM

Ryan sits down with Frank Portman, CTO at Yobi, to talk about why next-token prediction, though great for language, isn’t the right inductive bias for forecasting human behavior. They discuss how Yobi builds a “foundation model of behavior” using transformers and graph neural networks instead of chat-style LLMs, and what it takes to run millions of personalization decisions per second while keeping consumer data private.

Not Every Engineer Gets to Work on What's Next

Work on advanced technologies that shape tomorrow's capabilities.

Interesting questions

Using a comma before "but"

Misinformation is everywhere, even in your English class.

Avoiding validation logic duplication across app layers

Duplicates? We don’t know anything about that here at Stack.

Client frequently paying late. Manager claiming I make mistakes but doesn't provide specifics

“Chasing clients to pay is unfortunately sometimes just part of the work.”

Full braking before the stop line

Wait till you hear how Californians approach a stop sign.

Links from around the web

Don't make gates optional, make them flexible

Or you could just scream, “Open the gates!” like they did in Gladiator.

Fixing a kubelet Memory Leak in Kubernetes 1.36

Have you tried turning it off and turning it back on?

Obfuscation: building the final boss of cryptography

Let’s see Mythos try to crack this one.

Why I stopped arguing with people

But arguing with strangers online is one of our few modern pleasures!


Our sixteenth Annual Developer Survey is now open and we want to hear your thoughts on all things software. Take the survey now!