Course Review - Lecture 12 - Next Generation User Interfaces (4018166FNR)

This lecture forms part of a course on Next Generation User Interfaces given at the Vrije Universiteit Brussel.

Transcript

1. 2 December 2005 Next Generation User Interfaces Course Review Prof. Beat Signer Department of Computer Science Vrije Universiteit Brussel beatsigner.com Department of Computer Science Vrije Universiteit Brussel beatsigner.com
2. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 2 May 19, 2025 Course Summary 1. Introduction ▪ history of human-computer interaction - analogue computers, direct manipulation, mouse, desktop metaphor, innovative forms of interaction ▪ interface types and natural user interfaces ▪ interaction design process (lifecycle model) - establish requirements, design alternatives, prototyping, evaluation ▪ types of requirements - functional requirements, data requirements, environmental requirements, … ▪ user-centred design ▪ prototyping - different forms of low-fidelity prototyping ▪ evaluation - why, what, where and when?
3. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 3 May 19, 2025 Course Summary … 2. Information Architectures ▪ personal information management ▪ memory types ▪ PIM systems ▪ RSL metamodel, cross-media PIM and MindXpres ▪ paper: Towards Cross-Media Information Spaces and Architectures 3. Multimodal Interaction ▪ human senses ▪ Bolt's "Put-that-there" ▪ multimodal fusion and fission ▪ ten myths of multimodal interaction ▪ CARE properties
4. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 4 May 19, 2025 Course Summary … 4. Pen-based Interaction ▪ history and affordances of pen and paper ▪ digital pen and paper solutions ▪ iPaper research ▪ innovative hardware and materials - printed electronics, AR headsets, … 5. Interactive Tabletops and Surfaces ▪ multi-user tabletop interfaces ▪ enabling technologies and frameworks - resistive, surface capacitive and projected capacitive touch panels, SAW ▪ applications
5. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 5 May 19, 2025 Course Summary … 6. Gesture-based Interaction ▪ gesture types - semiotic, ergotic and epistemic gestures ▪ gesture recognition devices ▪ gesture design guidelines ▪ gesture spotting and recognition solutions ▪ paper: Gestural Interfaces: A Step Backward In Usability 7. Tangible, Embedded and Embodied Interaction ▪ history of graspable and tangible user interfaces ▪ applications ▪ tangible bits and radical atoms ▪ tangible holograms (TangHo) ▪ paper: Radical Atoms: Beyond Tangible Bits, Toward Transformable Materials
6. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 6 May 19, 2025 Course Summary … 8. Virtual and Augmented Reality ▪ technologies - large screen, BOOM, CAVE, head-mounted display ▪ VR navigation and interaction techniques ▪ augmented reality techniques - magic lens, magic mirror, magic eyeglass, optical/video see-trough HMDs ▪ applications 9. Data Physicalisation ▪ advantages ▪ enabling technologies ▪ examples ▪ research challenges ▪ dynamic data physicalisation framework
7. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 7 May 19, 2025 Course Summary … 10.Implicit Human-Computer Interaction ▪ context ▪ intelligibility ▪ affective computing ▪ emotion classification models ▪ emotion recognition modalities 11.Human-AI Interaction ▪ challenges ▪ guidelines ▪ human-centred artificial intelligence (HCAI) ▪ HCAI framework ▪ prometheus design principles
8. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 8 May 19, 2025 Exam ▪ Exams will take place on June 10/11, 2025 ▪ Oral exam in English (20 mins slot) ▪ covers content of lectures and exercises ▪ counts for 40% of the overall grade ▪ 5 mins questions about the assignment ▪ 15 mins questions about the course content (no preparation time) ▪ You will have to register for a specific examination slot ▪ Overall grade = oral exam (40%) + assignment (60%) ▪ students have some flexibility in distributing the grades for the assignment (±2 points) - by default all team members get the same grade for assignment - send us an email before June 1, 2025 if you want to change the distribution
9. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 9 May 19, 2025 Exam … ▪ Submission of the assignment, source code and video via email to Maxim (mvdewync@vub.be) ▪ deadline: May 25, 24:00 (UTC+1) ▪ The exam will cover all the content presented in the lectures as well as any additional information from the exercise sessions ▪ includes the videos shown in some of the lectures ▪ Make sure that you understand the basic concepts ▪ however, we might ask questions at any level of detail to evaluate your knowledge ▪ Make sure that you can report about any aspects of the assignment
10. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 10 May 19, 2025 Exam … ▪ Remember to read the following three papers as they form part of the course material ▪ B. Signer, Towards Cross-Media Information Spaces and Architectures, Proceedings of the 13th International Conference on Research Challenges in Information Science (RCIS 2019), Brussels, Belgium, May 2019 - https://beatsigner.com/publications/towards-cross-media-information-spaces- and-architectures.pdf ▪ D.A. Norman and J. Nielsen, Gestural Interfaces: A Step Backward In Usability, interactions, 17(5), September 2010 - https://doi.org/10.1145/1836216.1836228 ▪ H. Ishii, D. Lakatos, L. Bonanni and J.-B. Labrune, Radical Atoms: Beyond Tangible Bits, Toward Transformable Materials, interactions, 19(1), January 2012 - https://doi.org/10.1145/2065327.2065337
11. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 11 May 19, 2025 edfestComponents 01001000100 0101001100010010100010010 0100100010010001000100001001000 100010001100001001000110010101010110 1100010010100010010010010100010101011001 101001100001100 101010100 0010100 100 110101010101 00100 01010101000 1001 1111111111 111 0000000010 0 11111111 0101001011 010101010 111010101 001010010110 splash.gif Next Generation User Interfaces @WISE
12. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 12 May 19, 2025 Prof. Dr. Beat Signer Cross-Media Technology, Interac- tive Paper, Data Physicalisation Dr. Audrey Sanctorum User-defined XDI and IoT Inter- action, Human-AI Interaction CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation logo.wmf WEB INFORMATION SYSTEMS ENGINEERING WEB & INFORMATION SYSTEMS ENGINEERING Maxim Van de Wynckel Interoperable Positioning Systems, Implicit HCI Ingela Rossing Dynamic Data Physicalisation Framework and Guidelines CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) A close-up of a person smiling Description automatically generated
13. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 13 May 19, 2025 logo.wmf WEB INFORMATION SYSTEMS ENGINEERING WEB & INFORMATION SYSTEMS ENGINEERING CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Bingyan Lee Next Generation User Interfaces for Human-Information Interaction Isaac Valadez Knowledge Physicalisation and Augmentation, Tangible UIs Yoshi Malaise Technology-enhanced Learning, Content-driven Presentations Qi Xu Next Generation Scholarly Workflows, Cross-Media PIM A person with glasses and a white background Description automatically generated A person with long hair Description automatically generated with low confidence
14. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 14 May 19, 2025 logo.wmf WEB INFORMATION SYSTEMS ENGINEERING WEB & INFORMATION SYSTEMS ENGINEERING CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Piet Van Der Paelt Julia-based Framework for Simulation and Optimisation Ekene Attoh IoT Middleware, Context-aware Computing, Implicit HCI Xuyao Zhang Extensible Platform for Dynamic Data Physicalisation Patrick Sello Digital Twin for Healthcare, Federated Learning
15. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 15 May 19, 2025 logo.wmf WEB INFORMATION SYSTEMS ENGINEERING WEB & INFORMATION SYSTEMS ENGINEERING CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Arun Sojan Physicalisation for Digital Twins Evan Cole Technology-enhanced Learning, Study Lenses A person wearing glasses Description automatically generated with medium confidence
16. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 16 May 19, 2025 Are You Interested in a Thesis? ▪ Various possibilities for MA and PhD theses ▪ Data Physicalisation - extensible dynamic data physicalisation platform and framework ▪ Personal Information Management (PIM) ▪ Technology-enhanced Learning ▪ Innovative Mixed Reality Interfaces - paper-digital interaction, AR-based human-information interaction, … ▪ Next Generation Presentation Solutions (e.g. MindXpres) ▪ Human-AI Interaction and Digital Twin Solutions ▪ Hybrid Positioning and Implicit Human-Computer Interaction ▪ Smart Environments and Cross-Domain Internet of Things (IoT) ▪ ... ▪ Do you have your own ideas? Come along to discuss them ... - https://wise.vub.ac.be/thesis-proposals
17. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 17 May 19, 2025 Video: Microsoft Productivity Vision (2015)
18. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 18 May 19, 2025 References ▪ Microsoft Productivity Future Vision (2015) ▪ https://www.youtube.com/watch?v=w-tFdreZB94
19. 2 December 2005 Next Generation User Interfaces The End Good Luck with the Exam!