In our testing, the top three types of question users submitted to the AI platforms were in the areas of:
Looking at differences by generation, we find:
In blinded side-by-side testing, users select their preferred AI response to a series of queries and describe why. As a result, we see how the four platforms compare across hundreds of users and various question types. * Bard stood out for responses that were viewed as most complete, accurate, and relevant.
Across all users, the top three reasons for choosing a preferred AI response in our blinded tests are: 1. Feels accurate 2. Feels relevant 3. Feels complete In addition, among younger users, the attribute “feels human like” increases in importance. This video of a young user asking Bard for a
Microsoft’s investment in OpenAI has resulted in ChatGPT-4 powering Bing. However, looking at Microsoft users (defined by Windows PC or MS Tablet users), when presented with blinded responses from different platforms to the same prompts, they preferred GPT-4 and 3.5 over Bing's responses. The % is calculated
Our study captures hundreds of videos of actual user experiences with the four AI platforms. A unique and powerful aspect of Pulse IQ™️ is the ability to see these interactions in the moment. Two videos were chosen for each AI platform that demonstrate meaningful user insights. See what users see
Five Reasons UX Researchers Should Use Naturalistic Observation
How to truly close the mobile app UX feedback loop between your users and your product teams to ensure you’re focusing on what’s most impactful.
Artificial intelligence is eating the world. The pace at which machines have recently been able to achieve human or even superhuman performance on tasks previously requiring human intelligence has been breathtaking. AI has the potential to become a profoundly useful assistant and tool in almost every aspect of human life,
Key webinar takeaways from a discussion around the intersection of UX and AI. Explore the implications of LLMs and generative AI in UX design.
