Next Generation User Interfaces

Course Review
Prof. Beat Signer

Department of Computer Science

Vrije Universiteit Brussel

beatsigner.com

2 December 2005
 Course Summary
1. Introduction
▪ history of human-computer interaction
- analogue computers, desktop metaphor, innovative forms of interaction
▪ interface types
▪ natural user interfaces
2. Interaction Design
▪ interaction design process (lifecycle model)
- establish requirements, design alternatives, prototyping, evaluation
▪ usability and user experience goals
▪ design principles
▪ examples of good and poor design
▪ interaction design approaches
- e.g. user-centred design

December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 2

 Course Summary …
3. Requirements Analysis, Prototyping and Evaluation
▪ types of requirements
- functional requirements, data requirements, environmental requirements, …
▪ different forms of data gathering and analysis for requirements
- interviews, focus groups, direct observation, …
▪ prototyping
- low fidelity vs. high fidelity
▪ types of evaluation
- controlled vs. natural setting
▪ DECIDE evaluation framework
▪ usability testing and field studies
▪ inspections and analytics
▪ GOMS model, keystroke level model and Fitts’s law

December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 3

 Course Summary …
4. Information Architectures
▪ personal information management
▪ memory types
▪ PIM systems
▪ RSL metamodel, cross-media PIM and MindXpres
▪ paper: Towards Cross-Media Information Spaces and Architectures
5. Multimodal Interaction
▪ human senses
▪ Bolt's "Put-that-there"
▪ multimodal fusion and fission
▪ ten myths of multimodal interaction
▪ CASE model and CARE properties

December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 4

 Course Summary …
6. Pen-based Interaction
▪ history and affordances of pen and paper
▪ digital pen and paper solutions
▪ iPaper research
▪ innovative hardware and materials
7. Interactive Tabletops and Surfaces
▪ enabling technologies and frameworks
▪ multi-user tabletop interfaces
▪ applications

December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 5

 Course Summary …
8. Gesture-based Interaction
▪ gesture types
▪ gesture recognition devices
▪ gesture design guidelines
▪ gesture spotting and recognition solutions
▪ paper: Gestural Interfaces: A Step Backward In Usability
9. Tangible, Embedded and Embodied Interaction
▪ history of graspable and tangible user interfaces
▪ applications
▪ tangible bits and radical atoms
▪ paper: Radical Atoms: Beyond Tangible Bits, Toward
Transformable Materials

December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 6

 Course Summary …
10.Virtual and Augmented Reality
▪ technologies
▪ VR navigation and interaction techniques
▪ augmented reality techniques
▪ applications
11.Implicit Human-Computer Interaction
▪ context
▪ intelligibility
▪ affective computing
▪ emotion classification models
▪ emotion recognition modalities

December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 7

 Exam
▪ Exams will take place on January 25/29, 2021
▪ Oral exam in English (20 mins slot)
▪ covers content of lectures and exercises
▪ counts 40% for the overall grade
▪ 5 mins questions about the assignment
▪ 15 mins questions about the course content (no preparation time)
▪ You will have to register for a specific examination slot
▪ Overall grade = oral exam (40%) + assignment (60%)
▪ students have some flexibility in distributing the grades for the
assignment (±2 points)
- by default all team members get the same grade for assignment
- send us an email before January 4, 2021 if you want to change the distribution

December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 8

 Exam …
▪ Submission of the assignment, source code and
video via email to Maxim ([email protected])
▪ deadline: December 21, 24:00 (UTC+1)
▪ The exam will cover all the content presented in the
lectures as well as any additional information from the
exercise sessions
▪ includes the videos shown in some of the lectures
▪ Make sure that you understand the basic concepts
▪ however, we might ask questions at any level of detail to evaluate
your knowledge
▪ Make sure that you can report about any aspects of the
assignment
December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 9
 Exam …
▪ Remember to read the following three papers as
they form part of the course material
▪ B. Signer, Towards Cross-Media Information Spaces and
Architectures, Proceedings of the 13th International Conference
on Research Challenges in Information Science (RCIS 2019),
Brussels, Belgium, May 2019
- https://beatsigner.com/publications/towards-cross-media-information-spaces-
and-architectures.pdf
▪ D.A. Norman and J. Nielsen, Gestural Interfaces: A Step
Backward In Usability, interactions, 17(5), September 2010
- https://doi.org/10.1145/1836216.1836228
▪ H. Ishii, D. Lakatos, L. Bonanni and J.-B. Labrune, Radical Atoms:
Beyond Tangible Bits, Toward Transformable Materials,
interactions, 19(1), January 2012
- https://doi.org/10.1145/2065327.2065337
December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 10
 Are You Interested in a Thesis?
▪ Various possibilities for MA and PhD theses
▪ Mixed Reality Solutions
- e.g. for museums, photography etc.
▪ Tangible User Interfaces
▪ Dynamic Data Physicalisation Framework
- big data exploration interfaces
▪ MindXpres Presentation Platform
▪ Cross-Device and Cross-Media Interfaces
▪ Smart Environments and Cross-Domain Internet of Things (IoT)
▪ Hybrid Tracking and Implicit Human-Computer Interaction
▪ Personal Information Management (PIM)
▪ Interactive Paper Solutions
▪ Do you have your own ideas? Come along to discuss them...
- https://beatsigner.com/flyers/ThesesOverview.pdf

December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 11

 WEB & INFORMATION
SYSTEMS ENGINEERING

CROSS-MEDIA INFORMATION SPACES

AND ARCHITECTURES (CISA)

Prof. Dr. Beat Signer Dr. Audrey Sanctorum

Cross-Media Technology, Interac- User-defined XDI and IoT Inter- Information Information
tive Paper, Data Physicalisation action, Human-AI Interaction
Systems & Visualisation
Management & Navigation
CISA

Human-Machine &
Human-Information
Interaction
Maxim Van de Wynckel Payam Ebrahimi
Hybrid Positioning, Implicit Dynamic Data Physicalisation,
Human-Computer Interaction Real-Time Point Cloud Analysis

December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 12

 WEB & INFORMATION
SYSTEMS ENGINEERING

CROSS-MEDIA INFORMATION SPACES

AND ARCHITECTURES (CISA)

Ekene Attoh Xuyao Zhang

IoT Middleware, Context-aware Extensible Platform for Dynamic Information Information
Computing, Implicit HCI Data Physicalisation
Systems & Visualisation
Management & Navigation
CISA

Human-Machine &
Human-Information
Interaction
Dr. Reinout Roels Dr. Ahmed A.O. Tayeh
MindXpres: Extensible Content- Open Cross-Media Authoring,
driven Presentation Tool Fluid Document Formats

December 14, 2020 Beat Signer - Department of Computer Science - [email protected] 13

Next Generation User Interfaces
The End

Good Luck with the Exam!

2 December 2005