Issue 223: Long context

Welcome to ISSUE #223 of The Overflow! This newsletter is by developers, for developers, written and curated by the Stack Overflow team and Cassidy Williams. This week: pair programming with CodeGen assistants, whether using AI means you're smarter now, and when rain improves your Wi-Fi reception.

From the blog

How do mixture-of-experts layers affect transformer models?

This new LLM technique has started improving the results of models without additional training.

Developers with AI assistants need to follow the pair programming model

CodeGen is fast, but you need to be good.

Are long context windows the end of RAG?

The home team is joined by Michael Foree, Stack Overflow’s director of data science and data platform, and occasional cohost Cassidy Williams, CTO at Contenda, for a conversation about long context windows, retrieval-augmented generation, and how Databricks’ new open LLM could change the game for developers. Plus: How will FTX co-founder Sam Bankman-Fried’s sentence of 25 years in prison reverberate in the blockchain and crypto spaces?

Will antitrust suits benefit developers?

Ben and Ryan talk about how tiny nations are making huge money from their domain names, the US government’s antitrust case against Apple, the implications of a four-day work week, Reddit’s IPO, and more.

Build faster with sample AI apps and open source code

Want to build your next computer vision app faster? Build on top of Intel’s Edge AI reference kits with open source code snippets. The kits are designed to work across industries and many real-world scenarios with Intel’s OpenVINO toolkit.

Interesting questions

Does the use of AI make someone more intelligent?

"Is Caesar Octavius as powerful as Rome?"

How do I motivate my PhD students to attend seminars?

Two words: Free food.

In The Martian, Mark keeps the largest potatoes for his food supply and replants the smaller ones. Doesn't this cultivate smaller potatoes?

“This is one of the cool things about potatoes.”

Life on a planet with never-ending rain

Dinosaur: You Seattle punks think it rains a lot here? [smokes cigarette] During the Carnian pluvial event, it rained for two million years, and we didn't complain.

Links from around the web

How to use FFMPEG on Linux

An excellent, straightforward way to use the powerful audio/video library on Linux.

Asking for help is a core developer skill

One of the hardest skills to develop in software is not coding, but being willing to ask for help. *all of the Stack Overflow community nods in agreement*

The state of generative AI, 2024

Everyone's talking about generative AI now, but what's the big picture?

The Wi-Fi only works when it's raining

A hilarious true story about how rain weighed down a tree just enough to make Wi-Fi work well.

Looking for the tools, technologies, and skills your team needs to evolve in the AI era? Stack Overflow's Industry Guide to AI has your answers.