Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
The Architecture of Stack Overflow - Merge Lisb...
Search
Marco Cecconi
September 26, 2014
Programming
4
400
The Architecture of Stack Overflow - Merge Lisbon 2014
The Architecture of Stack Overflow slides from Merge Lisbon 2014
Marco Cecconi
September 26, 2014
Tweet
Share
More Decks by Marco Cecconi
See All by Marco Cecconi
Stack Overflow - It's all about performance - Codemotion Rome 2015
sklivvz
0
870
L'architettura di Stack Overflow, {codemotion} Milano 2014
sklivvz
0
600
Stack Overflow - it's all about performance
sklivvz
2
690
Guerrilla Programming - code.talks 2014
sklivvz
0
600
The Architecture of Stack Overflow - Info Share 2014
sklivvz
3
630
The Architecture of Stack Overflow - Dev Sum 2014
sklivvz
2
550
The Architecture of Stack Overflow - QCon Japan 2014
sklivvz
2
220
The Architecture of StackOverflow - QCon China 2014
sklivvz
1
240
The Localization of Stack Overflow- QCon China 2014
sklivvz
1
300
Other Decks in Programming
See All in Programming
今インフラ技術をイチから学び直すなら
yuhta28
1
140
Patched fetch did not work
quramy
4
390
大公開!iOS開発の悩みトップ5 〜iOSDC Japan 2024〜
ryunakayama
0
190
GenU導入でCDKに初挑戦し、悪戦苦闘した話
hideg
0
170
Amazon Neptuneで始める初めてのグラフDB ー グラフDBを使う意味を考える ー
satoshi256kbyte
2
260
開発を加速する共有Swift Package実践
elmetal
PRO
0
420
Shinjuku.rb#95:心の技術書紹介
free_world21
1
110
Ebitengineの1vs1ゲーム WebRTCの活用
ponyo877
0
380
仮想ファイルシステムを導入して開発環境のストレージ課題を解消する
segadevtech
2
550
GraphQL あるいは React における自律的なデータ取得について
quramy
11
3k
Prompt Cachingは本当に効果的なのか検証してみた.pdf
ttnyt8701
0
530
2024 컴포즈 정원사
jisungbin
0
150
Featured
See All Featured
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
103
48k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
190
16k
Facilitating Awesome Meetings
lara
49
6k
A Philosophy of Restraint
colly
202
16k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
326
21k
The Cult of Friendly URLs
andyhume
76
6k
The MySQL Ecosystem @ GitHub 2015
samlambert
250
12k
Testing 201, or: Great Expectations
jmmastey
36
7k
Designing the Hi-DPI Web
ddemaree
278
34k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
27
7.4k
Optimising Largest Contentful Paint
csswizardry
31
2.8k
The Brand Is Dead. Long Live the Brand.
mthomps
53
38k
Transcript
The Architecture Of Marco Cecconi @sklivvz http://sklivvz.com
Sizing up the problem
None
None
None
*source: Quantcast, Alexa #50-‐ish network for traffic* (between imdb.com
and t.co)
#50-‐ish network for traffic* …and #17 in Portugal!?
*source: Quantcast, Alexa much successful very traffic obrigado, yo!
543,255,552 pageviews in the last 30 days* *source: Quantcast
Our datacenter?
None
web servers load balancers redis search database http(s) http rest
http protobuf sql sql protobuf tag engine
None
We are sNll scaling up!
Our development cycle
BAT!CAVE Code-build-test cycle running on home machine feature requests
BAT!CAVE DEV.SO Test on the real servers git push
BAT!CAVE DEV.SO META.SE 1-click deploy Users test on meta.stackexchange.com (“baking”)
git push
BAT!CAVE DEV.SO META.SE 1-click deploy HALP! git revert git push
BAT!CAVE DEV.SO NETWORK META.SE 1-click deploy git push 1-click deploy
It’s live! Tons of users use it…
BAT!CAVE DEV.SO NETWORK META.SE 1-click deploy git push 1-click deploy
…and provide new feature requests
Move fast and break things* * Not the home
page or question page :-)
Move fast and break things* * Not the home
page or question page :-)
Abusing caching
Network Level Caches (CDN, etc.) Server Level Cache (HttpRuntime.Cache) Site
Level Cache (Redis) SQL Server Database Cache (384 gigs of RAM!) Solid State Disk
None
None
None
RisoQo & SpagheS
None
None
None
None
None
Throwing away risotto… one grain at a time!
Abuse caching for GC performance
IRepository<Order> orderRepository = container.Resolve<IRepository<Order>>();
Order order = orderRepository.Get(35); This is what you think you are doing…
…but if you think about it a bit more…
...this is what you are actually doing! IRepository<Order> repository =
new ValidatingOrderRepository ( new SecurityRepository<Order> ( new LoggingRepository<Order> ( new CachingRepository<Order> ( new NHibernateRepository<Order> () ) ) ) ); Order order = repository.Get(35);
Throwing away spaghetti… one strand at a time!
Dependency InjecNon is our version of spagheS code
Our source code
Few projects :-)
Few projects :-) Few lines of code :-)
Few projects :-) Few lines of code :-) Eeek! very
few tests :-S
Few projects :-) Few lines of code :-) Awesome community
to help :-D Eeek! very few tests :-S
YAGNI* * You Ain’t Gonna Need It!
Libraries and open source
None
None
None
Wrap code in libraries and open source it
None
None
None
“SUPERHERO” CODING
HIRE “NINJA” CODERS
TOOLS LEVEL: “NINJA”
• Performance is a feature • Always.
Be. Shipping. • Use your circumstances. • Open source your libraries • 3 obscenely big monitors. KEY TAKEAWAYS
None
Marco Cecconi @sklivvz http://sklivvz.com we are hiring new ninjas from
anywhere in the world!