The Sydney UX Research Meetup is back, and this week’s event featured three talks on AI in UX research.
Speakers included Panna Cherukuri, Principal UX Researcher at Nearmap, and Nora Jiang, UX Designer, who discussed “Shaping AI solutions to empower people”; Anahita Jamshidi Fard, UX Researcher at Dovetail, who presented on “Embracing AI in Research: A Rollercoaster Journey”; and Annabel Blake, Principal Design Researcher at Canva, who spoke about “The AI research toolkit: what to Trust, Tweak and Test”.
Despite the current AI hype, these presentations highlighted the continued importance of designers and UX researchers in fast-paced product development processes, as well as the importance of product experience principles when designing AI products.
AI product principles
- Designing features that bring transparency, trust, and feedback into the experience are crucial elements when designing AI products.
- Mechanisms like confidence intervals and feedback loops empower users to enhance the product and flag questionable results to improve the models and the product.
- The goal is to equip users with AI tools to expedite their work not replace them or their expertise.
AI in the UX research process and UX research for AI
- AI streamlines time-consuming tasks like data analysis, allowing researchers to focus on higher-order user goals and strategic decision-making.
- Large Language Models unlock the potential to data mine large datasets, such as product and app reviews. I welcome this capability having done this exercise manually myself.
- An interesting application of this capability involved using a short product feedback pop-up survey to ask customers deeper questions about their experiences, generating volumes of data on user goals.
- Machine learning needs insight. Early user research is an instrumental ingredient to shape data models.
Changing role of UX researchers
- In fast-paced environments, “doing” becomes more important than extensive reporting. AI-driven data analysis automates tasks, allowing researchers to focus on strategic aspects of product development.
- Researchers need to adopt a more hands-on approach and actively participate in product development, working closely with designers, product managers, and engineers.
- Closer working partnerships changes deliverables. A spreadsheet of what looked like user stories or use cases was more relevant to engineers than a research report.
AI’s impact on UX research
While companies in the AI race rush products to market, early usability testing remains essential. The example shown demonstrated how a text prompt was misinterpreted as a quiz, something quick usability testing could have prevented.
We were reminded to conduct literature reviews of available research (a task becoming faster with AI) to inform product development and explore ideas with methods like Wizard of Oz testing to simulate functionality that doesn’t yet exist.
The importance of research in identifying higher-order user goals was emphasised. Beyond usability testing, this is where research demonstrates its value as a strategic capability.
The audience Q&A included a few questions about AI hallucinations. And whether AI was used for research synthesis or insurance claims assessment the speakers each said that engineers, insurance experts and researchers didn’t trust the AI 100% checking the results with their own work to varying extents.
AI is infiltrating commercial, consumer, and UX research products. It doesn’t replace your role but augments it. Continuously test AI tools as they emerge to evaluate their effectiveness because, even if you don’t want to, your stakeholders will be using them.
Find out more about the event at: https://www.meetup.com/uxRESEARCH-Sydney/events/297250096

Post a comment