Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
The Architecture of Stack Overflow - Merge Lisb...
Search
Marco Cecconi
September 26, 2014
Programming
4
410
The Architecture of Stack Overflow - Merge Lisbon 2014
The Architecture of Stack Overflow slides from Merge Lisbon 2014
Marco Cecconi
September 26, 2014
Tweet
Share
More Decks by Marco Cecconi
See All by Marco Cecconi
Stack Overflow - It's all about performance - Codemotion Rome 2015
sklivvz
0
880
L'architettura di Stack Overflow, {codemotion} Milano 2014
sklivvz
0
660
Stack Overflow - it's all about performance
sklivvz
2
710
Guerrilla Programming - code.talks 2014
sklivvz
0
660
The Architecture of Stack Overflow - Info Share 2014
sklivvz
3
650
The Architecture of Stack Overflow - Dev Sum 2014
sklivvz
2
630
The Architecture of Stack Overflow - QCon Japan 2014
sklivvz
2
240
The Architecture of StackOverflow - QCon China 2014
sklivvz
1
250
The Localization of Stack Overflow- QCon China 2014
sklivvz
1
400
Other Decks in Programming
See All in Programming
PostgreSQLで手軽にDuckDBを使う!DuckDB&pg_duckdb入門/osk2025-duckdb
takahashiikki
1
230
CSC305 Lecture 02
javiergs
PRO
1
260
AIエージェント時代における TypeScriptスキーマ駆動開発の新たな役割
bicstone
4
1.4k
ててべんす独演会〜Flowの全てを語ります〜
tbsten
1
220
Your Perfect Project Setup for Angular @BASTA! 2025 in Mainz
manfredsteyer
PRO
0
110
議事録の要点整理を自動化! サーバレス Bot 構築術
penpeen
3
1.6k
WebエンジニアがSwiftをブラウザで動かすプレイグラウンドを作ってみた
ohmori_yusuke
0
170
defer f()とdefer fの挙動を 誤解していた話
kogamochiduki
2
160
プロダクト開発をAI 1stに変革する〜SaaS is dead時代で生き残るために〜 / AI 1st Product Development
kobakei
0
450
麻雀点数計算問題生成タスクから学ぶ Single Agentの限界と Agentic Workflowの底力
po3rin
5
2.1k
株式会社 Sun terras カンパニーデック
sunterras
0
190
ポスターセッション: 「まっすぐ行って、右!」って言ってラズパイカーを動かしたい 〜生成AI × Raspberry Pi Pico × Gradioの試作メモ〜
komofr
0
900
Featured
See All Featured
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
3.1k
GraphQLとの向き合い方2022年版
quramy
49
14k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
248
1.3M
Designing Experiences People Love
moore
142
24k
How to Think Like a Performance Engineer
csswizardry
27
2k
Music & Morning Musume
bryan
46
6.8k
Six Lessons from altMBA
skipperchong
28
4k
A better future with KSS
kneath
239
17k
Bootstrapping a Software Product
garrettdimon
PRO
307
110k
The Cost Of JavaScript in 2023
addyosmani
53
9k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
31
2.5k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
285
14k
Transcript
The Architecture Of Marco Cecconi @sklivvz http://sklivvz.com
Sizing up the problem
None
None
None
*source: Quantcast, Alexa #50-‐ish network for traffic* (between imdb.com
and t.co)
#50-‐ish network for traffic* …and #17 in Portugal!?
*source: Quantcast, Alexa much successful very traffic obrigado, yo!
543,255,552 pageviews in the last 30 days* *source: Quantcast
Our datacenter?
None
web servers load balancers redis search database http(s) http rest
http protobuf sql sql protobuf tag engine
None
We are sNll scaling up!
Our development cycle
BAT!CAVE Code-build-test cycle running on home machine feature requests
BAT!CAVE DEV.SO Test on the real servers git push
BAT!CAVE DEV.SO META.SE 1-click deploy Users test on meta.stackexchange.com (“baking”)
git push
BAT!CAVE DEV.SO META.SE 1-click deploy HALP! git revert git push
BAT!CAVE DEV.SO NETWORK META.SE 1-click deploy git push 1-click deploy
It’s live! Tons of users use it…
BAT!CAVE DEV.SO NETWORK META.SE 1-click deploy git push 1-click deploy
…and provide new feature requests
Move fast and break things* * Not the home
page or question page :-)
Move fast and break things* * Not the home
page or question page :-)
Abusing caching
Network Level Caches (CDN, etc.) Server Level Cache (HttpRuntime.Cache) Site
Level Cache (Redis) SQL Server Database Cache (384 gigs of RAM!) Solid State Disk
None
None
None
RisoQo & SpagheS
None
None
None
None
None
Throwing away risotto… one grain at a time!
Abuse caching for GC performance
IRepository<Order> orderRepository = container.Resolve<IRepository<Order>>();
Order order = orderRepository.Get(35); This is what you think you are doing…
…but if you think about it a bit more…
...this is what you are actually doing! IRepository<Order> repository =
new ValidatingOrderRepository ( new SecurityRepository<Order> ( new LoggingRepository<Order> ( new CachingRepository<Order> ( new NHibernateRepository<Order> () ) ) ) ); Order order = repository.Get(35);
Throwing away spaghetti… one strand at a time!
Dependency InjecNon is our version of spagheS code
Our source code
Few projects :-)
Few projects :-) Few lines of code :-)
Few projects :-) Few lines of code :-) Eeek! very
few tests :-S
Few projects :-) Few lines of code :-) Awesome community
to help :-D Eeek! very few tests :-S
YAGNI* * You Ain’t Gonna Need It!
Libraries and open source
None
None
None
Wrap code in libraries and open source it
None
None
None
“SUPERHERO” CODING
HIRE “NINJA” CODERS
TOOLS LEVEL: “NINJA”
• Performance is a feature • Always.
Be. Shipping. • Use your circumstances. • Open source your libraries • 3 obscenely big monitors. KEY TAKEAWAYS
None
Marco Cecconi @sklivvz http://sklivvz.com we are hiring new ninjas from
anywhere in the world!