Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Programming with Kinect for Windows: From Hello...
Search
latish
March 16, 2013
Programming
1
2.4k
Programming with Kinect for Windows: From Hello World to Lightsabers in 60 minutes
Slides for Introduction to Kinect Programming using C# and WPF
latish
March 16, 2013
Tweet
Share
More Decks by latish
See All by latish
Improving Continuously as a Developer
latish
10
1.3k
Other Decks in Programming
See All in Programming
bootcamp2025_バックエンド研修_WebAPIサーバ作成.pdf
geniee_inc
0
120
品質ワークショップをやってみた
nealle
0
620
alien-signals と自作 OSS で実現する フレームワーク非依存な ロジック共通化の探求 / Exploring Framework-Agnostic Logic Sharing with alien-signals and Custom OSS
aoseyuu
2
460
GC25 Recap: The Code You Reviewed is Not the Code You Built / #newt_gophercon_tour
mazrean
0
110
はじめてのDSPy - 言語モデルを『プロンプト』ではなく『プログラミング』するための仕組み
masahiro_nishimi
4
13k
NixOS + Kubernetesで構築する自宅サーバーのすべて
ichi_h3
0
1.2k
タスクの特性や不確実性に応じた最適な作業スタイルの選択(ペアプロ・モブプロ・ソロプロ)と実践 / Optimal Work Style Selection: Pair, Mob, or Solo Programming.
honyanya
3
190
contribution to astral-sh/uv
shunsock
0
520
コード生成なしでモック処理を実現!ovechkin-dm/mockioで学ぶメタプログラミング
qualiarts
0
260
AkarengaLT vol.38
hashimoto_kei
1
120
iOSでSVG画像を扱う
kishikawakatsumi
0
160
PHPに関数型の魂を宿す〜PHP 8.5 で実現する堅牢なコードとは〜 #phpcon_hiroshima / phpcon-hiroshima-2025
shogogg
1
330
Featured
See All Featured
Optimising Largest Contentful Paint
csswizardry
37
3.5k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
16
1.7k
The Power of CSS Pseudo Elements
geoffreycrofte
79
6k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
132
19k
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
27k
Statistics for Hackers
jakevdp
799
220k
It's Worth the Effort
3n
187
28k
What's in a price? How to price your products and services
michaelherold
246
12k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
31
2.6k
StorybookのUI Testing Handbookを読んだ
zakiyama
31
6.2k
Transcript
Programming with Kinect for Windows @latish
Latish Sehgal @latish latish.sehgal@ improvingenterprises.com www.dotnetsurfers.com www.dallas-csharp-sig.com
~ 10 years ago
None
June 2009 Project Natal announced
June 2009 Project Natal announced Nov 2010 Kinect Launched
None
Feb 2012 Windows Hardware, SDK 1.0 Color, Depth & Audio
streams Skeletal Tracking Speech Recognition June 2009 Project Natal announced Nov 2010 Kinect Launched
Feb 2012 Windows Hardware, SDK 1.0 May 2012 SDK 1.5
Kinect Studio Face Tracking Seated Skeletal Tracking June 2009 Project Natal announced Nov 2010 Kinect Launched
Feb 2012 Windows Hardware, SDK 1.0 May 2012 SDK 1.5
Infrared Stream Accelerometer Data Win8, VS2012 support Oct 2012 SDK 1.6 June 2009 Project Natal announced Nov 2010 Kinect Launched
Kinect for Windows
Kinect Sensors
Viewing Angles
Installation •Kinect For Windows SDK •Kinect For Windows Developer Toolkit
Optional •Coding4Fun Toolkit •Kinect Toolbox http://kinectforwindows.org
Demo
Video Stream
Resolutions 640 x 480 @ 30fps (RGB) 1280 x 960
@ 12fps (RGB) 640 x 480 @ 15fps (YUV)
Demo
Depth Stream
640 x 480 320 x 240 80 x 60 @
30 fps Resolutions
None
depth depthPoint >> DepthImageFrame.PlayerIndexBitmaskWidth player depthPoint & DepthImageFrame.PlayerIndexBitmask 0001100100000 010
depth =800mm player 2
Demo
Skeletal Tracking
20 Tracked Points
2 Actively Tracked, 6 Total
Standing vs Seated Tracking
None
•Each joint has associated tracking state
•Each joint has associated tracking state •Tracked, Not tracked or
Inferred
•Each joint has associated tracking state •Tracked, Not tracked or
Inferred •Use TransformSmoothParameters to smooth joint data to reduce jitter
Demo
Audio Stream
Sound Source Angle vs Beam Angle
Grammar <!-‐-‐ Confirmation_Yes._value: string ["Yes"] -‐-‐> <rule id="Confirmation_Yes"
scope="public"> <example> yes </example> <example> yes please </example> <one-‐of> <item> yes </item> <item> yeah </item> <item> yep </item> <item> ok </item> </one-‐of> <item repeat="0-‐1"> please </item> <tag> out._value = "Yes";</tag> var grammar = new Choices(); grammar.Add(“yes please"); grammar.Add(“yes"); grammar.Add(“yeah"); grammar.Add(“ok");
Demo
Face Tracking
100 tracked points
Head Pose Angles
None
•Real-time tracking of multiple faces
•Real-time tracking of multiple faces •2D/3D Mesh and Points
•Real-time tracking of multiple faces •2D/3D Mesh and Points •Animation
Units
Demo
Gestures & Poses Install-Package KinectToolbox
Algorithmic vs Templated
Demo
Kinect as a Service kinectservice.codeplex.com
None
•Available via Nuget
•Available via Nuget •Support for Windows 8, WPF and Windows
Phone
Demo
Kinect Studio
Demo
Usability
None
•Review Microsoft’s Human Interface Guidelines
•Review Microsoft’s Human Interface Guidelines •Don’t torture your users
•Review Microsoft’s Human Interface Guidelines •Don’t torture your users •Best
user experiences are context aware
•Review Microsoft’s Human Interface Guidelines •Don’t torture your users •Best
user experiences are context aware •Complement gestures with speech actions
•Review Microsoft’s Human Interface Guidelines •Don’t torture your users •Best
user experiences are context aware •Complement gestures with speech actions •Keep a logical relationship between gestures and corresponding actions
Watch another Demo, you will
Real world Uses
Barbie Dream Closet mattel.com
Home Automation http://castleos.com/
Alex’s Place (Children’s clinic)
and many more..
Personal Experience
Pros
•Your non-geek family/friends will think that your work is really
cool! Pros
•Your non-geek family/friends will think that your work is really
cool! •Testing will make you move Pros
•Your non-geek family/friends will think that your work is really
cool! •Testing will make you move •This changes everything This changes a few things, but in big ways Pros
Cons
Cons •Upfront hardware investment
Cons •Upfront hardware investment •Testing can make you look awkward
Cons •Upfront hardware investment •Testing can make you look awkward
•Testing will make you move
Resources
Resources •http://channel9.msdn.com/Series/KinectQuickstart
Resources •http://channel9.msdn.com/Series/KinectQuickstart •SDK Samples
Resources •http://channel9.msdn.com/Series/KinectQuickstart •SDK Samples •Book “Programming with the Kinect for
Windows Software Development Kit” by David Catuhe
@latish
[email protected]
www.dotnetsurfers.com github.com/latish