background July 17, 2009

High Scalability Blog on Stack Overflow

It was quite an honor to see that the High Scalability Blog posted an entry on Stack Overflow! We referred to the HSB, and its exhaustively detailed information about how other websites handle scaling, many times during the course of Stack Overflow development. And I’ve cited it myself when researching what we think is the…
Avatar for Jeff Atwood
Co-Founder (Former)

It was quite an honor to see that the High Scalability Blog posted an entry on Stack Overflow!

We referred to the HSB, and its exhaustively detailed information about how other websites handle scaling, many times during the course of Stack Overflow development. And I’ve cited it myself when researching what we think is the largest public same-stack (Microsoft) website on the internet, Plenty of Fish. It’s an excellent resource.

I don’t know if Stack Overflow has that much traffic relative to many of the other truly giant public websites profiled on the HSB. You can see our public Stack Overflow traffic stats at Quantcast if you’re curious. Still, it’s great to be able to give back to the community and help document our own process of scaling our little corner of the web.

That said, I agree with the overall conclusion that Todd Hoff reaches:

If you need to Google scale then you really have no choice but to go the NoSQL direction. But Stack Overflow is not Google and neither are most sites. When thinking about your design options keep Stack Overflow in mind. In this era of multi-core, large RAM machines and advances in parallel programming techniques, scale up is still a viable strategy and shouldn’t be tossed aside just because it’s not cool anymore. Maybe someday we’ll have the best of both worlds, but for now there’s a big painful choice to be made and that choice decides your fate.

Scaling up is definitely a viable solution, as both Plenty of Fish and we can attest.

Like all of Todd’s pieces, it is exhaustively researched and documented, and well worth your time to read. I was a little stunned how thorough it was, actually — I doubt anyone outside our core development team has thought about our design and scaling this much!

Podcast logo The Stack Overflow Podcast is a weekly conversation about working in software development, learning to code, and the art and culture of computer programming.

Related

company May 7, 2020

A message from our CEO: The Way Forward

This is a key moment in our company’s history, as the whole world is dealing with significant uncertainty. Know that you are not alone. We are facing this situation together. Our goal is to stay focused on living our core values and actively connect with teammates, our community, and our customers.
the-loop May 26, 2020

The Loop, May 2020: Dark Mode

We received a bunch of requests to share how we use our feedback framework on specific features. We got excited about this, and given that we just released Dark Mode (and “Ultra Dark Mode”), we thought this was a great opportunity to show how we arrived at our solution.
Avatar for Sara Chipps
Director of Product, Community