Upgrade to Pro — share decks privately, control downloads, hide ads and more …

CSC570 Lecture 08

Javier Gonzalez-Sanchez
PRO
April 25, 2023
Research
0
140

CSC570 Lecture 08

Applied Affective Computing
Gaze Tracking
(202304)

Javier Gonzalez-Sanchez
PRO

April 25, 2023
Tweet

More Decks by Javier Gonzalez-Sanchez

See All by Javier Gonzalez-Sanchez
CSC308B Lecture 18
javiergs
PRO
0
100
CSC308B Lecture 17
javiergs
PRO
0
49
CSC308B Lecture 16
javiergs
PRO
0
86
CSC308B Lecture 15
javiergs
PRO
0
80
CSC308B Lecture 14
javiergs
PRO
0
240
CSC308B Lecture 13
javiergs
PRO
0
120
CSC308B Lecture 12
javiergs
PRO
0
140
CSC308B Lecture 11
javiergs
PRO
0
76
CSC308B Lecture 10
javiergs
PRO
0
34

Other Decks in Research

See All in Research
音声処理ツールキットESPnetの現在と未来
kanbayashi1125
3
550
説明可能AI：代表的手法と最近の動向 
yuyay
1
610
Equivalence of Geodesics and Importance Weighting from the Perspective of Information Geometry
mkimura
0
140
一般化ランダムフォレストの理論と統計的因果推論への応用
tomoshige_n
10
1.8k
東工大Swallowプロジェクトにおける大規模日本語Webコーパスの構築
aya_se
12
6.7k
Combating Misinformation in the age of LLMs
teacherpeterpan
0
140
Source Code Diff Revolution (JetBrains Open Reading Club)
tsantalis
0
280
How to Perform Manual Classification for Deep Learning Using CloudCompare
kentaitakura
0
660
Refactoring Mining - The key to unlock software evolution
tsantalis
0
270
F0に基づいて伸縮された画像文字からの音声合成 [ASJ2024春]
nehi0615
0
120
Evolutionary Optimization of Model Merging Recipes (2024/04/17, NLPコロキウム)
iwiwi
9
3.1k
Cross-Media Information Spaces and Architectures
signer
PRO
0
120

Featured

See All Featured
ParisWeb 2013: Learning to Love: Crash Course in Emotional UX Design
dotmariusz
104
6.6k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
33
6k
Pencils Down: Stop Designing & Start Developing
hursman
117
11k
In The Pink: A Labor of Love
frogandcode
138
21k
Infographics Made Easy
chrislema
238
18k
Product Roadmaps are Hard
iamctodd
45
9.7k
Why You Should Never Use an ORM
jnunemaker
PRO
51
8.6k
jQuery: Nuts, Bolts and Bling
dougneiner
59
7.2k
Learning to Love Humans: Emotional Interface Design
aarron
267
39k
Robots, Beer and Maslow
schacon
PRO
155
7.9k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
242
1.2M
No one is an island. Learnings from fostering a developers community.
thoeni
16
2.1k

Transcript

  1. jgs CSC 570 Current Topics in Computer Science Applied Affective

    Computing Lecture 08: Gaze Tracking Dr. Javier Gonzalez-Sanchez [email protected] www.javiergs.com Building 14 -227 Office Hours: By appointment

  2. jgs Previously … Lab 01 and Assignment 02

  3. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    3 Assignment 02 • Open or Closed Eyes VS. Brain • 5 diverse stimulation scenarios VS. Brain • 5 diverse stimulation scenarios VS. Affect Follow 2 approaches: a) Clustering as described today (EM, K-means, Density) b) Explore another solution to the best of your knowledge (Machine Learning, Data mining, Statistics) Due: Monday (April 24)

  4. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    4 Lab 01 • 5 diverse stimulation scenarios VS. Brain • 5 diverse stimulation scenarios VS. Affect Follow Random Forest approach Due: Monday (April 26)

  5. jgs Preprocessing the Dataset UCI Emotiv

  6. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    6 1) EEG.AF3 2) EEG.F7 3) EEG.F3 4) EEG.FC5 5) EEG.T7 6) EEG.P7 7) EEG.O1 8) EEG.O2 9) EEG.P8 10)EEG.T8 11)EEG.FC6 12)EEG.F4 13)EEG.F8 14)EEG.AF4 Dataset Attributes | X

  7. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    7 Dataset Attributes | X 1) PM.Engagement.Scaled 2) PM.Excitement.Scaled 3) PM.Stress.Scaled 4) PM.Relaxation.Scaled 5) PM.Interest.Scaled 6) PM.Focus.Scaled

  8. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    8 § EEG.MarkerValueInt Dataset Attributes | Y

  9. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    9 § https://webgazer.cs.brown.edu § eye tracking library using common webcams to infer the eye-gaze locations of web visitors on a page in real-time. § written in JavaScript § can be integrated into a website § runs entirely in the client browser, so no video data needs to be sent to a server, and it requires the user's consent to access their webcam. WebGazer

  10. jgs Assignment 03

  11. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    11 Assignment 03 • Collect EEG Data (Emotiv PRO) • Collect Gaze Tracking Data (WebGazer) • Save the integrated data in a Dataset (CSV or ARFF file)

  12. jgs Assignment 03 | Part 01

  13. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    13 Add Lab 2 into the New Assignment 03 Imagen (photo) Observer 1 minute Record data What was the part that catch attention?

  14. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    14 § https://github.com/brownhci/WebGazer/blob/master/www/calibration.html Callibration

  15. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    15 Example

  16. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    16 <html> <head> <script src="./webgazer.js"></script> </head> <body> <div style="text-align: right;" id="gazeData"></div> <script> webgazer.resume(); webgazer.setGazeListener(function(data, elapsedTime) { if (data != null) { var x = data.x; var y = data.y; document.getElementById("gazeData").innerHTML = "Gaze coordinates: x=" + x + ", y=" + y; } }).begin(); </script> <!-- work here … --> Template

  17. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    17 <!-- work here … --> <style> html, body {height: 100%;margin: 0; padding: 0; } table {width: 100%;height: 100%;border-collapse: collapse;} td {border: 1px solid black;} </style> <table> <tr> <td>Cell 1</td> <td>Cell 2</td> <td>Cell 3</td> </tr> <tr> <td>Cell 4</td> <td>Cell 5</td> <td>Cell 6</td> </tr> <tr> <td>Cell 7</td> <td>Cell 8</td> <td>Cell 9</td> </tr> </table> </body> </html> Template

  18. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    18 Towards This Scenario

  19. jgs Assignment 03 | Part 02

  20. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    20 Emotiv

  21. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    21 Architecture Bluetooth EMOTIV PRO Your App WebSocket (server) WebSocket (client) EMOTIV BrainViz EMOTIV BCI

  22. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    22 Let’s Work

  23. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    23 Questions

  24. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    24 Office Hours Tuesday and Thursday 3 - 5 pm But an appointment required Sent me an email – [email protected]

  25. jgs CSC 570 Applied Affective Computing Javier Gonzalez-Sanchez, Ph.D. [email protected]

    Spring 2023 Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly. They cannot be distributed or used for another purpose.