In our testing, the top three types of question users submitted to the AI platforms were in the areas of:
Looking at differences by generation, we find:
In blinded side-by-side testing, users select their preferred AI response to a series of queries and describe why. As a result, we see how the four platforms compare across hundreds of users and various question types. * Bard stood out for responses that were viewed as most complete, accurate, and relevant.
Across all users, the top three reasons for choosing a preferred AI response in our blinded tests are: 1. Feels accurate 2. Feels relevant 3. Feels complete In addition, among younger users, the attribute “feels human like” increases in importance. This video of a young user asking Bard for a
Microsoft’s investment in OpenAI has resulted in ChatGPT-4 powering Bing. However, looking at Microsoft users (defined by Windows PC or MS Tablet users), when presented with blinded responses from different platforms to the same prompts, they preferred GPT-4 and 3.5 over Bing's responses. The % is calculated
Our study captures hundreds of videos of actual user experiences with the four AI platforms. A unique and powerful aspect of Pulse IQ™️ is the ability to see these interactions in the moment. Two videos were chosen for each AI platform that demonstrate meaningful user insights. See what users see
As a mobile app product manager, you know the value of understanding your users in real-time. Imagine having the ability to capture high-quality, in-the-moment insights that truly reflect what your users are experiencing and what they’re looking for in your app—all without the challenges of aligning teams or
Continuous Improvement in LLM Applications: Taking a User-Centric Approach Leveraging a Continuous Feedback Loop | Pulse Labs
Five Reasons UX Researchers Should Use Naturalistic Observation
How to truly close the mobile app UX feedback loop between your users and your product teams to ensure you’re focusing on what’s most impactful.
