Scholar launches book that redefines the UI/UX process with Artificial Intelligence
The world of UI/UX design is going through a quiet revolution, driven not only by new screens and devices, but mainly by the integration of Artificial Intelligence, human-machine interaction, and immersive systems like XR, AR, and VR. In this context, one of the most complete and recent works comes from researcher Pradipta Biswas, a Gates Cambridge Scholar, who has just released a book aimed at demystifying this new landscape for designers, engineers, and product teams.
The book Intelligent User Interface: Usable Artificial Intelligence and Artificial Intelligence for Usability, published by Taylor & Francis, has a very clear mission: to make the design process of intelligent interfaces accessible, practical, and applicable, without requiring the reader to dive deep into heavy math or excessive theory. The work explains the most up-to-date AI and Machine Learning models and shows, with real case studies, how these technologies are already being applied in interfaces for XR, human-robot interaction, cockpit design, and trajectory prediction.
Instead of treating AI as just a buzzword, Biswas approaches the topic as a structural part of the UI/UX process, connecting academic research, international standards, free tools, and projects that can be used by students, early-career researchers, and industry professionals.
From basic UI to Intelligent Interfaces
The starting point of the book is simple but straightforward: traditional UI/UX alone can no longer handle the kind of systems being built today. When we talk about autonomous navigation, extended reality, collaborative robots, and critical systems in aerospace or space missions, it is no longer enough to think only in terms of screens, buttons, and linear flows. This is where the concept of Intelligent User Interface comes in, which is the book’s central focus.
Biswas shows how AI and Machine Learning models can be used both to improve usability and to make AI itself more usable. This two-way street appears in examples such as:
- Adaptive interfaces that reorganize the screen according to context or the user’s level of experience.
- Trajectory prediction models that anticipate the movement of vehicles, drones, or pedestrians to ensure safety.
- XR systems that use computer vision and eye tracking to update elements in real time.
- Human-robot interaction in which the machine interprets gestures, voice, and behavior to adjust its response.
Instead of seeing UI/UX only as aesthetics or navigation, the book presents a design process where the interface is treated as a living system, powered by data, capable of learning from use and adapting to the situation.
Core idea of the book
Intelligent interfaces use AI not just to automate, but to make interaction safer, more efficient, and more natural, especially in complex contexts like XR, robotics, and aviation.
AI, Machine Learning, and trajectory prediction
One of the strongest topics in the book is trajectory prediction, which is explained in an accessible way, without losing the technical side. Trajectory prediction, as the author defines it, is the process of predicting the future positions of agents such as vehicles, drones, or pedestrians over time. This capability is critical in autonomous driving, traffic control, mobile robotics, and any system that needs to make quick decisions to avoid collisions and ensure safety.
Biswas connects this topic directly to interface design. It is not enough for the model to predict well; the interface needs to:
- Communicate confidence and uncertainty in the predictions.
- Reduce cognitive load in high-pressure scenarios.
- Highlight critical information at the right moment.
- Enable clear and quick human intervention.
This combination of AI to predict what will happen and UI/UX to show what matters, at the right time, is one of the pillars of the book. In cockpit systems, for example, this can mean automatically reorganizing panels, signaling safer routes, or highlighting alerts based not only on system data, but also on the operator’s state.
XR, AR/VR, and interaction in immersive environments
Another strong axis of the work is the use of XR (Extended Reality), which covers virtual, augmented, and mixed reality. The book explains in a practical way what these environments are and how they impact UI/UX work:
- Virtual reality (VR): the user is placed in a fully digital environment, such as flight or space simulations.
- Augmented reality (AR): the real world is complemented with overlaid digital elements, such as panels or instructions in the field of view.
- Mixed reality: virtual elements interact more deeply with the physical environment, anchored to real surfaces and objects.
In the examples presented by Biswas, interfaces for XR appear in applications such as:
- Cockpit simulations in VR for space missions.
- Interfaces projected into the pilot’s or operator’s field of view.
- Control systems for robots and drones integrated into immersive environments.
In these scenarios, design is no longer about where to click and becomes about where to look, how to move the body, what to touch, and how to react to the combination of physical and digital stimuli.
UI/UX challenges in XR
– Avoiding visual overload in 360 degrees
– Positioning elements in depth without eye strain
– Ensuring that critical actions are easy to access and hard to trigger by mistake
– Using visual, audio, and haptic feedback together
Human factors, computer vision, and accessibility standards
The book does not stay only on the futuristic side. It also brings a solid foundation in human factors and usability, showing how aspects like visual perception, attention, reaction time, and motor limitations influence the design of intelligent interfaces. This is especially relevant in critical systems, where a layout detail can affect the safety of an entire mission.
In addition, Biswas covers:
- Computer vision applied to interaction, such as eye tracking and gesture recognition.
- International guidelines and standards relevant to UI/UX, accessibility, and audiovisual media.
- A list of free software that can be used in intelligent interface and XR projects.
This focus is no coincidence. The author has a strong track record of participation in international bodies. He was elected vice-chairman of the ITU Study Group 9 and served as co-chair of the Intersector Rapporteur Group on Audiovisual Media Accessibility, in addition to contributing to the Focus Group on Smart TV at the International Telecommunication Union (ITU). In other words, he is not just doing research: he is helping define global standards that impact smart TV, accessibility, and multimedia interaction formats.
LLMs, language interfaces, and new interaction models
A very up-to-date and interesting point in the book is the discussion of large language models (LLMs) as part of the evolution of interfaces. Instead of treating LLMs as just generic chatbots, Biswas explores how they can be used in human-robot interaction interfaces and in systems where natural language becomes a primary control channel.
This approach includes topics such as:
- Using LLMs to control robots or complex systems through voice or text.
- Challenges of explainability and trust in the model’s responses.
- Integrating language with other signals, such as gestures, gaze, and spatial context.
On top of that, the book comments on cutting-edge technologies such as vision transformers, which improve how computer vision systems interpret images and videos, opening space for interfaces that better understand the environment around the user.
Labs, robots, drones, and hands-on experimentation
A very practical aspect of the work is that it does not stay only in theory. Biswas shows what equipment is needed to build a lab for intelligent interaction design, covering scenarios with robots, drones, and XR systems. He describes:
- Types of sensors and cameras used for eye and gesture tracking.
- Typical hardware setups with drones and robots in controlled environments.
- Basic structure for usability tests in virtual and augmented reality.
Each chapter includes graphic illustrations, quick fact lists for review, and even project ideas that can be explored by students and early-stage researchers. This makes the book useful both as course material and as a reference guide for anyone setting up experiments in practice.
Practical resources in the book
– Case studies in XR, cockpit, and human-robot interaction
– Project suggestions for students and early-career researchers
– List of free software related to intelligent interfaces
– Visual summaries and quick facts per chapter
Who is Pradipta Biswas and why this matters for UI/UX
To understand the weight of the book, it is worth taking a quick look at the author’s background. Pradipta Biswas is an Associate Professor in the Department of Design and Manufacturing at the Indian Institute of Science (IISc), one of India’s most respected institutions. He is also associate faculty at the Robert Bosch Centre for Cyber Physical Systems, working right at the intersection of physical systems, software, and human-machine interaction.
During his PhD in Computer Science at Cambridge, Biswas researched:
- Visual and auditory perception in contexts of interaction with machines.
- Rapid pointing movements and their relationship with interface design.
- Problem-solving strategies in computer-mediated tasks.
During this phase, he developed new algorithms for eye-tracking technology and patented systems such as an interactive Head Up Display controlled by gaze and gestures. In other words, long before this topic became trendy, he was already exploring ways to control complex systems using only gaze and subtle movements.
From research in Cambridge to space and accessibility in India
After returning to India, Biswas continued to expand this work. Some of the most striking initiatives include:
- Collaboration with the Indian Air Force on the use of eye-tracking technology in cockpit systems.
- Leading the design of a virtual reality cockpit for India’s first crewed space mission, focused on simulating and studying human-machine interaction in extreme conditions.
- Being selected as one of five researchers from India to conduct human-machine interaction studies on the International Space Station during the Axiom 4 mission.
- Organizing a pioneering toy hackathon aimed at creating toys and devices that allow children with severe disabilities to communicate through eye-controlled interfaces.
These experiences reinforce an important point: the vision of UI/UX in the book is not limited to everyday apps, but is connected to high-responsibility contexts such as aviation, space, and accessibility. This makes the content especially relevant for those who want to understand how design principles translate into systems where human error can have real impact.
Target audience: from students to product managers
The book is designed for those who want to understand the state of the art in AI-powered UI/UX without having to become full-time researchers. According to its own proposal, the target audience includes:
- Students of engineering and design.
- Professors and researchers in human-machine interaction.
- Interface designers and UX designers interested in AI, XR, and automation.
- Product managers who need to make informed decisions about the use of AI in digital products and physical systems.
The idea is to provide material that bridges theory and practice, showing how modern AI models can be applied in real projects without requiring the reader to master all the mathematical details behind the algorithms.
Why this book matters for the future of design
In a landscape where large language models, computer vision, XR, and robotics are becoming part of everyday product development, works like Pradipta Biswas’s help organize the chaos. Instead of treating each technology as a separate silo, the book weaves everything together through the lens of intelligent interfaces focused on usability.
For those who live and breathe technology, the message is clear: the boundary between AI and UI/UX is getting thinner by the day. Understanding how to design systems that align with the human way of perceiving, deciding, and acting in digital, physical, and hybrid environments is what will separate average products from truly meaningful experiences in the coming years.
