In blinded side-by-side testing, users select their preferred AI response to a series of queries and describe why. As a result, we see how the four platforms compare across hundreds of users and various question types. * Bard stood out for responses that were viewed as most complete, accurate, and relevant....
Across all users, the top three reasons for choosing a preferred AI response in our blinded tests are: 1. Feels accurate 2. Feels relevant 3. Feels complete In addition, among younger users, the attribute “feels human like” increases in importance. This video of a young user asking Bard for a...
In our testing, the top three types of question users submitted to the AI platforms were in the areas of: 1. Learning & Education 2. Technology 3. Media & Entertainment Looking at differences by generation, we find: * Millennials more interested in Money, Finance, Insurance * Gen Z more interested in Media,...
Microsoft’s investment in OpenAI has resulted in ChatGPT-4 powering Bing. However, looking at Microsoft users (defined by Windows PC or MS Tablet users), when presented with blinded responses from different platforms to the same prompts, they preferred GPT-4 and 3.5 over Bing's responses. The % is calculated...
Our study captures hundreds of videos of actual user experiences with the four AI platforms. A unique and powerful aspect of Pulse IQ™️ is the ability to see these interactions in the moment. Two videos were chosen for each AI platform that demonstrate meaningful user insights. See what users see...