Bashar I. Ahmad
ABSTRACT
In this paper, we first give an overview of the predictive display concept, which aims to minimise the demand associated with interacting with in-vehicle displays, such as touchscreens, via free hand pointing gestures. It determines the item the user intends to select, early in the pointing gesture, and accordingly simplifies-expedites the target acquisition. A study to evaluate the impact of using a predictive touchscreen in a car is then presented. The mid-air selection pointing facilitation scheme is applied, such that the user does not have to physically touch the interactive surface. Instead, the predictive display auto-selects the predicted interface icon on behalf of the user, once the required level of inference certainty is achieved. The study results, which are based on data collected from 20 participants under various driving-road conditions, demonstrate that a predictive display can significantly reduce the workload, effort and durations of completing on-screen selection tasks in vehicles.
- Bashar I Ahmad, Patrick M Langdon, Simon J Godsill, Robert Hardy, Eduardo Dias, and Lee Skrypchuk. 2014. Interactive Displays in Vehicles: Improving Usability with a Pointing Gesture Tracker and Bayesian Intent Predictors. In Proc. of International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 14). 1--8.Google Scholar
Digital Library
- Bashar I Ahmad, Patrick M Langdon, Simon J Godsill, Robert Hardy, Lee Skrypchuk, and Richard Donkor. 2015. Touchscreen Usability and Input Performance in Vehicles Under Different Road Conditions: An Evaluative Study. In Proc. of the Int. Conf. on Automotive User Interfaces and Interactive Veh. Apps. (AutomotiveUI). 47--54.Google ScholarDigital Library
- Bashar I Ahmad, James K Murphy, Patrick M Langdon, and Simon J Godsill. 2014. Filtering Perturbed In-Vehicle Pointing Gesture Trajectories: Improving the Reliability of Intent Inference. In Proc. of IEEE International Workshop on Machine Learning for Signal Processing (MLSP '14).Google ScholarCross Ref
- Bashar I Ahmad, James K Murphy, Patrick M Langdon, and Simon J Godsill. 2017. Bayesian Intent Prediction in Object Tracking Using Bridging Distributions. IEEE Transactions on Cybernetics (2017).Google Scholar
- Bashar I Ahmad, James K Murphy, Patrick M Langdon, Simon J Godsill, Robert Hardy, and Lee Skrypchuk. 2016. Intent Inference for Pointing Gesture Based Interactions in Vehicles. IEEE Transactions on Cybernetics 46 (2016), 878--889.Google ScholarCross Ref
- Richard Bishop. 2005. Intelligent Vehicle Technology and Trends. Artech House, Inc.Google Scholar
- BMW. Innovative functionality in the BMW 7 Series: Gesture Control. Accessed on 04 May 2016: http://www.bmw.com/com/en/newvehicles/7series/sedan/2015/showroom/innovative_functionality.html.Google Scholar
- Gary E Burnett and J Mark Porter. 2001. Ubiquitous Computing Within Cars: Designing Controls for Non-visual Use. International Journal of Human-Computer Studies 55, 4 (2001), 521--531.Google ScholarDigital Library
- Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. UltraHaptics: Multi-point Mid-air Haptic Feedback for Touch Surfaces. In Proc. of the Annual ACM Sym. on User Interface Software and Technology. 505--514.Google ScholarDigital Library
- Delphi. Delphi Showcases the Technology Trends Driving Future Mobility and Automated Driving. Accessed on 12 May 2016: http://delphi-events.com/newsrelease.do?id=3751mid=1283.Google Scholar
- Paul M Fitts and James R Peterson. 1964. Information Capacity of Discrete Motor Responses. Journal of Experimental Psychology 67, 2 (1964), 103.Google ScholarCross Ref
- Natassia Goode, Michael G Lenné, and Paul Salmon. 2012. The Impact of On-road Motion on BMS Touch Screen Device Operation. Ergonomics 55, 9 (2012), 986--996. Google ScholarCross Ref
- Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Advances in Psychology 52 (1988), 139--183. Google ScholarCross Ref
- Catherine Harvey and Neville A Stanton. 2013. Usability Evaluation for In-vehicle Systems. CRC Press.Google Scholar
- Liberty Hoekstra-Atwood, Huei-Yen Winnie Chen, Wayne Chi Wei Giang, and Birsen Donmez. 2014. Measuring Inhibitory Control in Driver Distraction. In Proc. of the 6th Int. Conf. on Automotive User Interfaces and Interactive Veh. App. (AutomotiveUI 2014). 1--4.Google ScholarDigital Library
- Heejin Kim, Sunghyuk Kwon, Jiyoon Heo, Hojin Lee, and Min K Chung. 2014. The Effect of Touch-key Size on the Usability of In-Vehicle Information Systems and Driving Safety During Simulated Driving. Applied Ergonomics 45, 3 (2014), 379--388. Google ScholarCross Ref
- Sheila G Klauer, Thomas A Dingus, Vicki L Neale, Jeremy D Sudweeks, and David J Ramsey. National Highway Traffic Safety Administration, DOT HS 810 5942006, 2006. The Impact of Driver Inattention on Near-crash/Crash Risk: An Analysis Using the 100-car Naturalistic Driving Study Data. (National Highway Traffic Safety Administration, DOT HS 810 5942006, 2006).Google Scholar
- Edward Lank, Yi-Chun Nikko Cheng, and Jaime Ruiz. 2007. Endpoint Prediction Using Motion Kinematics. In Proc. of the SIGCHI Conf. on Human factors in Computing Systems. 637--646. Google ScholarDigital Library
- I Scott MacKenzie and Poika Isokoski. 2008. Fitts' throughput and the speed-accuracy tradeoff. In Proc. of the CHI. 1633--1636. Google ScholarDigital Library
- Michael J McGuffin and Ravin Balakrishnan. 2005. Fitts' Law and Expanding Targets: Experimental Studies and Designs for User Interfaces. ACM Trans. on Computer-Human Interaction 12, 4 (2005), 388--422.Google ScholarDigital Library
- Atsuo Murata. 1998. Improvement of Pointing Time by Predicting Targets in Pointing with a PC Mouse. IJHCI 10, 1 (1998), 23--32. Google ScholarCross Ref
- Eshed Ohn-Bar and Mohan Manubhai Trivedi. 2014. Hand Gesture Recognition in Real Time for Automotive Interfaces: A Multimodal Vision-based Approach and Evaluations. IEEE Trans. on Intelligent Transportation Systems (2014), 1--10. Google ScholarCross Ref
- Phillip T Pasqual and Jacob O Wobbrock. 2014. Mouse Pointing Endpoint Prediction Using Kinematic Template Matching. In Proc. of the SIGCHI Conf. on Human Factors in Comp. Systems (CHI). 743--752.Google ScholarDigital Library
- Matthew J Pitts, Gary Burnett, Lee Skrypchuk, Tom Wellings, Alex Attridge, and Mark A Williams. 2012. Visual--haptic Feedback Interaction in Automotive Touchscreens. Displays 33, 1 (2012), 7--16.Google ScholarCross Ref
- Paul Salmon, Michael Lenné, Tom Triggs, Natassia Goode, Miranda Cornelissen, and Victor Demczuk. 2011. The Effects of Motion on In-vehicle Touch Screen System Operation: A Battle Management System Case Study. Transportation Research: Traffic Psychology and Behaviour 14, 6 (2011), 494--503. Google ScholarCross Ref
- Brian Ziebart, Anind Dey, and J Andrew Bagnell. 2012. Probabilistic Pointing Target Prediction via Inverse Optimal Control. In Proc. of the 2012 ACM Int. Conf. on Intelligent User Interfaces (IUI). 1--10. Google ScholarDigital Library
Index Terms
- You Do Not Have to Touch to Select: A Study on Predictive In-car Touchscreen with Mid-air Selection
Recommendations
Touchscreen usability and input performance in vehicles under different road conditions: an evaluative study
AutomotiveUI '15: Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular ApplicationsWith the proliferation of the touchscreen technology, interactive displays are becoming an integrated part of the modern vehicle environment. However, due to road and driving conditions, the user input on such displays can be perturbed resulting in ...
Selection Facilitation Schemes for Predictive Touch with Mid-air Pointing Gestures in Automotive Displays
AutomotiveUI '18: Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular ApplicationsPredictive touch is an HMI technology that relies on inferring, early in the pointing gesture, the interface item a driver or passenger intends to select on an in-vehicle display [1, 2]. It simplifies and expedites the selection task, thereby reducing ...
Intelligent in-vehicle touchscreen aware of the user intent for reducing distractions: a pilot study
AutomotiveUI '15: Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular ApplicationsIntent-aware displays aim to simplify and expedite the task of selecting an icon displayed on an in-vehicle touchscreen via a free hand pointing gesture, thus, minimise the incurred effort and/or distractions. This is achieved by determining the user ...
Comments