In our testing, the top three types of question users submitted to the AI platforms were in the areas of:
Looking at differences by generation, we find:
In blinded side-by-side testing, users select their preferred AI response to a series of queries and describe why. As a result, we see how the four platforms compare across hundreds of users and various question types. * Bard stood out for responses that were viewed as most complete, accurate, and relevant.
Across all users, the top three reasons for choosing a preferred AI response in our blinded tests are: 1. Feels accurate 2. Feels relevant 3. Feels complete In addition, among younger users, the attribute “feels human like” increases in importance. This video of a young user asking Bard for a
Microsoft’s investment in OpenAI has resulted in ChatGPT-4 powering Bing. However, looking at Microsoft users (defined by Windows PC or MS Tablet users), when presented with blinded responses from different platforms to the same prompts, they preferred GPT-4 and 3.5 over Bing's responses. The % is calculated
Our study captures hundreds of videos of actual user experiences with the four AI platforms. A unique and powerful aspect of Pulse IQ™️ is the ability to see these interactions in the moment. Two videos were chosen for each AI platform that demonstrate meaningful user insights. See what users see
Generative AI is transforming product development—but not without challenges. It’s enabling teams to work smarter, innovate faster, and enhance user experiences, but navigating its complexities is key to long-term success. Here are five challenges product teams should be aware of when adopting AI: 1) Addressing Bias in AI
Generative AI is revolutionizing the way we design, market, and refine products. It’s giving teams the tools to better understand users, create more meaningful experiences, and connect with audiences in new ways. From improving designs to boosting engagement and expanding your reach, AI is opening up exciting opportunities. Here
As a mobile app product manager, you know the value of understanding your users in real-time. Imagine having the ability to capture high-quality, in-the-moment insights that truly reflect what your users are experiencing and what they’re looking for in your app—all without the challenges of aligning teams or
Continuous Improvement in LLM Applications: Taking a User-Centric Approach Leveraging a Continuous Feedback Loop | Pulse Labs
