Building ICEPerf.com

A talk given at Januscon 2024 about testing STUN and TURN, more specifically TURN networks like Twilio, Xirsys, Cloudflare, Metered and ExpressTURN

Transcript

1. – Building ICEPerf – JanusCon 2024 Building RelayPerf.com 1
2. – Building ICEPerf – JanusCon 2024 A Little About Us 2
3. – Building ICEPerf – JanusCon 2024 Dan Jenkins 3 Founder of Everycast Labs, Nimble Ape Creator of CommCon Was the f irst "Google Developer Expert" in WebRTC Loves LEGO Loves Real-Time Media Loves developing for "the web" Over 10 years in Open Source RTC @dan_jenkins / @danjenkins@fosstodon.org
4. – Building ICEPerf – JanusCon 2024 Marco Vidonis 4 Software Engineer at Nimble Ape 3 years @ Nimble Ape Leeds, UK OCRs and sailing Half marathon
5. – Building ICEPerf – JanusCon 2024 Nimble Ape 5 Real-Time Communication consultancy Based in the UK Work with Open Source Real- Time Comms VoIP, WebRTC, Broadcast/ Video delivery hello@nimblea.pe
6. – Building ICEPerf – JanusCon 2024 Everycast Labs 6 Creators of Broadcast Bridge (broadcastbridge.app) A Platform as a Service for bringing in remote talent into production AV work f lows We work with WebRTC / SRT / NDI / Decklink & AJA cards and more hello@everycastlabs.uk
7. – Building ICEPerf – JanusCon 2024 CommCon 7 "Open Media" - Real-Time or not 5 Years worth of content on our YouTube Channel commcon.xyz London & San Francisco June 2024 - 1 Day Hackathon, 1 Day Conference
8. – Building ICEPerf – JanusCon 2024 Building RelayPerf.com 8
9. – Building ICEPerf – JanusCon 2024 Building RelayPerf.com 9
10. – Building ICEPerf – JanusCon 2024 Building ICEPerf.com 10
11. – Building ICEPerf – JanusCon 2024 11
12. – Building ICEPerf – JanusCon 2024 What Is It? 12
13. – Building ICEPerf – JanusCon 2024 ICE Is Vital for WebRTC 13
14. – Building ICEPerf – JanusCon 2024 It's How We Make Connections Between WebRTC Peers 14
15. – Building ICEPerf – JanusCon 2024 And so STUN and TURN Are Also Vital 15
16. – Building ICEPerf – JanusCon 2024 What's STUN? 16
17. – Building ICEPerf – JanusCon 2024 "Oi, Server in the Cloud... What's my Public IP and Port?" 17
18. – Building ICEPerf – JanusCon 2024 What's TURN? 18
19. – Building ICEPerf – JanusCon 2024 "Oi, Server, I Want To Send my Traf f ic Through You, How Can I Do That?" 19
20. – Building ICEPerf – JanusCon 2024 ICE Impacts How a WebRTC Peer Connection Is Setup 20
21. – Building ICEPerf – JanusCon 2024 So You Can See Why... 21
22. – Building ICEPerf – JanusCon 2024 Delays in the ICE Process Slow Down Peer Connection Creation 22
23. – Building ICEPerf – JanusCon 2024 What Public Data Is There About the Performance of STUN and TURN Servers? 23
24. – Building ICEPerf – JanusCon 2024 None* 24 *Bold Statement without any hard evidence to back it up
25. – Building ICEPerf – JanusCon 2024 I Looked for 5 Minutes. I Couldn't Find any 25
26. – Building ICEPerf – JanusCon 2024 Enter ICEPerf.com 26
27. – Building ICEPerf – JanusCon 2024 Originally Started Out as RelayPerf.com 27
28. – Building ICEPerf – JanusCon 2024 We Wanted To Test TURN Networks 28
29. – Building ICEPerf – JanusCon 2024 Who's the Best? 29
30. – Building ICEPerf – JanusCon 2024 After Buying Turnperf.Com & Relayperf.Com We Realised That Was Only Half the Story 30
31. – Building ICEPerf – JanusCon 2024 So We Bought ICEPerf.com 31
32. – Building ICEPerf – JanusCon 2024 So What Does It Actually Do? 32
33. – Building ICEPerf – JanusCon 2024 And HOW? 33
34. – Building ICEPerf – JanusCon 2024 Firstly the What. 34
35. – Building ICEPerf – JanusCon 2024 We Test the TURN Network's Abilities 35
36. – Building ICEPerf – JanusCon 2024 As Well as the Google STUN Server 36
37. – Building ICEPerf – JanusCon 2024 And in the Future, Open Source Projects Too. 37
38. – Building ICEPerf – JanusCon 2024 The TURN Networks 38
39. – Building ICEPerf – JanusCon 2024 Who Are They? 39
40. – Building ICEPerf – JanusCon 2024 Twilio, Xirsys, Cloud f lare, Metered and ExpressTURN 40
41. – Building ICEPerf – JanusCon 2024 Cloud f lare's Announcement of a TURN Network Prompted This. 41
42. – Building ICEPerf – JanusCon 2024 Disclosure - I Own Cloud f lare Shares. 42
43. – Building ICEPerf – JanusCon 2024 I Want Cloud f lare To Succeed. 43
44. – Building ICEPerf – JanusCon 2024 I Want the Others To Succeed Just As Much. 44
45. – Building ICEPerf – JanusCon 2024 For a Long Time There Was Twilio & Xirsys 45
46. – Building ICEPerf – JanusCon 2024 Not a Lot of Choice. 46
47. – Building ICEPerf – JanusCon 2024 Then Subspace Entered the Race. 47
48. – Building ICEPerf – JanusCon 2024 And Subsequently Terminated Operations. 48
49. – Building ICEPerf – JanusCon 2024 :Sadface: 49
50. – Building ICEPerf – JanusCon 2024 Back Down to Two Networks. 50
51. – Building ICEPerf – JanusCon 2024 But Now We Have 5 Networks! 51
52. – Building ICEPerf – JanusCon 2024 Which Is Hugely Exciting. 52
53. – Building ICEPerf – JanusCon 2024 ICEPerf.com Tests 3 Things. 53
54. – Building ICEPerf – JanusCon 2024 Time To Receive a Candidate (STUN & TURN) Latency Through a TURN Server Throughput Through a TURN Server 54
55. – Building ICEPerf – JanusCon 2024 1 Process Handling 2 Peer Connections 55
56. – Building ICEPerf – JanusCon 2024 Peer Connections Connect With a Speci f ic STUN/TURN URI 56
57. – Building ICEPerf – JanusCon 2024 TURN Tests Force the IceTransportPolicy of Relay. 57
58. – Building ICEPerf – JanusCon 2024 TURN Tests Connect Out via a TURN Server and Back to the 2nd Local Peer Connection 58
59. – Building ICEPerf – JanusCon 2024 All Tests Are Run From a Home Broadband Connection 59
60. – Building ICEPerf – JanusCon 2024 Cloud Servers Potentially Have Much Better Peering to Other "Clouds" 60
61. – Building ICEPerf – JanusCon 2024 Over to Marco To Explain How It Was Made 61
62. – Building ICEPerf – JanusCon 2024 How It’s Made 62– Building ICEPerf – JanusCon 2024
63. – Building ICEPerf – JanusCon 2024 Written in GO 63– Building ICEPerf – JanusCon 2024
64. – Building ICEPerf – JanusCon 2024 Written in GO 63– Building ICEPerf – JanusCon 2024
65. – Building ICEPerf – JanusCon 2024 Written in GO 63– Building ICEPerf – JanusCon 2024
66. – Building ICEPerf – JanusCon 2024 BYOTSP 64– Building ICEPerf – JanusCon 2024
67. – Building ICEPerf – JanusCon 2024 BYOTSP Bring Your Own TURN Server Providers 65– Building ICEPerf – JanusCon 2024
68. – Building ICEPerf – JanusCon 2024 BYOTSP Bring Your Own TURN Server Providers Plug-in providers 65– Building ICEPerf – JanusCon 2024
69. – Building ICEPerf – JanusCon 2024 BYOTSP Bring Your Own TURN Server Providers Plug-in providers Toggle providers and capabilities on and o f 65– Building ICEPerf – JanusCon 2024
70. – Building ICEPerf – JanusCon 2024 BYOTSP Bring Your Own TURN Server Providers Plug-in providers Toggle providers and capabilities on and o f Save di ff erent con f igs 65– Building ICEPerf – JanusCon 2024
71. – Building ICEPerf – JanusCon 2024 BYOTSP Bring Your Own TURN Server Providers Plug-in providers Toggle providers and capabilities on and o f Save di ff erent con f igs Plan to expand 65– Building ICEPerf – JanusCon 2024
72. – Building ICEPerf – JanusCon 2024 con f ig.yaml 66– Building ICEPerf – JanusCon 2024
73. – Building ICEPerf – JanusCon 2024 Code design Drivers BDD (Learn Go With Tests https:// quii.gitbook.io/learn-go-with- tests) 67– Building ICEPerf – JanusCon 2024
74. – Building ICEPerf – JanusCon 2024 Code 68– Building ICEPerf – JanusCon 2024
75. – Building ICEPerf – JanusCon 2024 69– Building ICEPerf – JanusCon 2024
76. – Building ICEPerf – JanusCon 2024 69– Building ICEPerf – JanusCon 2024
77. – Building ICEPerf – JanusCon 2024 70 Speci f ication – Building ICEPerf – JanusCon 2024
78. – Building ICEPerf – JanusCon 2024 71 Test: Twilio – Building ICEPerf – JanusCon 2024
79. – Building ICEPerf – JanusCon 2024 72 Implementation – Building ICEPerf – JanusCon 2024
80. – Building ICEPerf – JanusCon 2024 73 Implementation – Building ICEPerf – JanusCon 2024
81. – Building ICEPerf – JanusCon 2024 74 Implementation – Building ICEPerf – JanusCon 2024
82. – Building ICEPerf – JanusCon 2024 75 Implementation – Building ICEPerf – JanusCon 2024
83. – Building ICEPerf – JanusCon 2024 76 Speci f ication – Building ICEPerf – JanusCon 2024
84. – Building ICEPerf – JanusCon 2024 77 Test: Cloud f lare – Building ICEPerf – JanusCon 2024
85. – Building ICEPerf – JanusCon 2024 78 Implementation – Building ICEPerf – JanusCon 2024
86. – Building ICEPerf – JanusCon 2024 79 Implementation – Building ICEPerf – JanusCon 2024
87. – Building ICEPerf – JanusCon 2024 80 Client – Building ICEPerf – JanusCon 2024
88. – Building ICEPerf – JanusCon 2024 81 Client – Building ICEPerf – JanusCon 2024
89. – Building ICEPerf – JanusCon 2024 Loki 82– Building ICEPerf – JanusCon 2024
90. – Building ICEPerf – JanusCon 2024 Loki 82– Building ICEPerf – JanusCon 2024
91. – Building ICEPerf – JanusCon 2024 Loki 82– Building ICEPerf – JanusCon 2024
92. – Building ICEPerf – JanusCon 2024 Open Source 83– Building ICEPerf – JanusCon 2024 nimbleape/iceperf-website nimbleape/iceperf-agent
93. – Building ICEPerf – JanusCon 2024 ICEPerf.com Is Live! 84– Building ICEPerf – JanusCon 2024
94. – Building ICEPerf – JanusCon 2024 There Is Much Work To Do. 85– Building ICEPerf – JanusCon 2024
95. – Building ICEPerf – JanusCon 2024 But Everything Has a Beginning. 86– Building ICEPerf – JanusCon 2024
96. – Building ICEPerf – JanusCon 2024 Preliminary Results 87– Building ICEPerf – JanusCon 2024
97. – Building ICEPerf – JanusCon 2024 Disclaimers 88– Building ICEPerf – JanusCon 2024
98. – Building ICEPerf – JanusCon 2024 Cloud f lare, Xirsys & Twilio Gifted Us Credit 89– Building ICEPerf – JanusCon 2024 Metered & ExpressTURN on Their Free Tiers
99. – Building ICEPerf – JanusCon 2024 90 Latency Tests completed over home broadband connection, 1 Gbps down, 100 Mbps up, hardwired – Building ICEPerf – JanusCon 2024
100. – Building ICEPerf – JanusCon 2024 91 Latency TURN UDP – Building ICEPerf – JanusCon 2024
101. – Building ICEPerf – JanusCon 2024 92 Latency TURN TCP – Building ICEPerf – JanusCon 2024
102. – Building ICEPerf – JanusCon 2024 93 Latency TURN TLS – Building ICEPerf – JanusCon 2024
103. – Building ICEPerf – JanusCon 2024 94 First ICE candidate, STUN Tests completed over home broadband connection, 1 Gbps down, 100 Mbps up, hardwired – Building ICEPerf – JanusCon 2024
104. – Building ICEPerf – JanusCon 2024 95 First ICE candidate, TURN Tests completed over home broadband connection, 1 Gbps down, 100 Mbps up, hardwired – Building ICEPerf – JanusCon 2024
105. – Building ICEPerf – JanusCon 2024 96 First ICE candidate, TURN UDP – Building ICEPerf – JanusCon 2024
106. – Building ICEPerf – JanusCon 2024 97 First ICE candidate, TURN TCP – Building ICEPerf – JanusCon 2024
107. – Building ICEPerf – JanusCon 2024 98 First ICE candidate, TURN TLS Tests completed over home broadband connection, 1 Gbps down, 100 Mbps up, hardwired – Building ICEPerf – JanusCon 2024
108. – Building ICEPerf – JanusCon 2024 99 Tests completed over home broadband connection, 1 Gbps down, 100 Mbps up, hardwired Max throughput – Building ICEPerf – JanusCon 2024
109. – Building ICEPerf – JanusCon 2024 100 Tests completed over home broadband connection, 1 Gbps down, 100 Mbps up, hardwired Max throughput TURN UDP – Building ICEPerf – JanusCon 2024
110. – Building ICEPerf – JanusCon 2024 101 Tests completed over home broadband connection, 1 Gbps down, 100 Mbps up, hardwired Max throughput TURN TCP – Building ICEPerf – JanusCon 2024
111. – Building ICEPerf – JanusCon 2024 102 Tests completed over home broadband connection, 1 Gbps down, 100 Mbps up, hardwired Max throughput TURN TLS – Building ICEPerf – JanusCon 2024
112. – Building ICEPerf – JanusCon 2024 But Did You Know if You Just Create a TURN URI for a Network It Might Just Work? 103
113. – Building ICEPerf – JanusCon 2024 104 Max throughput TURN TLS – Building ICEPerf – JanusCon 2024
114. – Building ICEPerf – JanusCon 2024 105 Throughput Tests completed over home broadband connection, 1 Gbps down, 100 Mbps up, hardwired – Building ICEPerf – JanusCon 2024
115. – Building ICEPerf – JanusCon 2024 This Is a Graph From Last Week 106
116. – Building ICEPerf – JanusCon 2024 107 Throughput Tests completed over home broadband connection, 1 Gbps down, 100 Mbps up, hardwired – Building ICEPerf – JanusCon 2024
117. – Building ICEPerf – JanusCon 2024 We Shared Preliminary Data With Cloud f lare 108
118. – Building ICEPerf – JanusCon 2024 109 Throughput Tests completed over home broadband connection, 1 Gbps down, 100 Mbps up, hardwired – Building ICEPerf – JanusCon 2024
119. – Building ICEPerf – JanusCon 2024 We've Already Helped Fix an Issue. 110
120. – Building ICEPerf – JanusCon 2024 So What's Next? 111
121. – Building ICEPerf – JanusCon 2024 Lots of Things! 112
122. – Building ICEPerf – JanusCon 2024 Real-Time Access to Data on the Website 113
123. – Building ICEPerf – JanusCon 2024 More Tests... 114
124. – Building ICEPerf – JanusCon 2024 Sending Media 115
125. – Building ICEPerf – JanusCon 2024 Measure Packet Loss 116
126. – Building ICEPerf – JanusCon 2024 Max Concurrent Throughput 117
127. – Building ICEPerf – JanusCon 2024 Separate Locations for Offerer & Answerer 118
128. – Building ICEPerf – JanusCon 2024 API Response Time for STUN/TURN URIs 119
129. – Building ICEPerf – JanusCon 2024 Other WebRTC Libraries Other Than Pion 120
130. – Building ICEPerf – JanusCon 2024 Browser Based Tests 121
131. – Building ICEPerf – JanusCon 2024 Multiple Locations 122
132. – Building ICEPerf – JanusCon 2024 And More! 123
133. – Building ICEPerf – JanusCon 2024 Cost Analysis 124
134. – Building ICEPerf – JanusCon 2024 Testing OSS Projects 125
135. – Building ICEPerf – JanusCon 2024 Already Started With Rel 126 https://github.com/elixir-webrtc/rel
136. – Building ICEPerf – JanusCon 2024 Adding in WebRTC Metrics 127
137. – Building ICEPerf – JanusCon 2024 That's Going To Be a Lot of Data... 128
138. – Building ICEPerf – JanusCon 2024 Lucky We're Friends With Clever People 129
139. – Building ICEPerf – JanusCon 2024 130
140. – Building ICEPerf – JanusCon 2024 Pushing Data Through TURN Networks Becomes £££/$$$/€€€ 131
141. – Building ICEPerf – JanusCon 2024 We're Going To Need Some Kind of Support To Make It Happen. 132
142. – Building ICEPerf – JanusCon 2024 That's Us 133
143. – Building ICEPerf – JanusCon 2024 Don't Forget To Get a Sel f ie With Us for the Chance of Winning a CommCon UK/SF Ticket 134
144. – Building ICEPerf – JanusCon 2024 Thanks! 135
145. – Building ICEPerf – JanusCon 2024 OH! Want This T-Shirt? 136
146. – Building ICEPerf – JanusCon 2024 137
147. – Building ICEPerf – JanusCon 2024 Thanks! 138 iceperf.com nimblea.pe everycastlabs.uk broadcastbridge.app commcon.xyz @nimbleape@nimblea.pe @everycastlabs@everycastlabs.uk @commcon@commcon.xyz