Loading…

Cloudflare Workers have a new skill: AI inference-as-a-service

Rita Kozlov, Senior Director of Product at Cloudflare, joins Ben, Ryan, and veteran cohost Cassidy Williams for a conversation about Cloudflare’s new AI service, what her day-to-day is like, and the mind-blowing “physicality” of the internet.

Article hero image
Credit: Alexandra Francis

Cloudflare is a cloud provider used by almost 20% of all websites. Developers new to Cloudflare can get started here.

Cloudflare recently launched Workers AI, an open, pay-as-you-go AI inference-as-a-service platform that lets developers run machine learning models on the Cloudflare network from their own code. Developers can get started here.

On a related note, read Ryan’s article exploring the infrastructure and code behind edge functions or check out his conversation with Vercel CTO Malte Ubl.

Retrieval augmented generation (RAG) is a strategy that helps address both LLM hallucinations and out-of-date training data.

Connect with Rita on LinkedIn.

Connect with Cassidy through her website.

Shoutout to Stack Overflow user Bamieh, whose answer to What does the function call app.use(cors()) do? earned them a Lifeboat badge.

TRANSCRIPT

Login with your stackoverflow.com account to take part in the discussion.