In our testing, the top three types of question users submitted to the AI platforms were in the areas of:
Looking at differences by generation, we find:
In blinded side-by-side testing, users select their preferred AI response to a series of queries and describe why. As a result, we see how the four platforms compare across hundreds of users and various question types. * Bard stood out for responses that were viewed as most complete, accurate, and relevant.
Across all users, the top three reasons for choosing a preferred AI response in our blinded tests are: 1. Feels accurate 2. Feels relevant 3. Feels complete In addition, among younger users, the attribute “feels human like” increases in importance. This video of a young user asking Bard for a
Microsoft’s investment in OpenAI has resulted in ChatGPT-4 powering Bing. However, looking at Microsoft users (defined by Windows PC or MS Tablet users), when presented with blinded responses from different platforms to the same prompts, they preferred GPT-4 and 3.5 over Bing's responses. The % is calculated
Our study captures hundreds of videos of actual user experiences with the four AI platforms. A unique and powerful aspect of Pulse IQ™️ is the ability to see these interactions in the moment. Two videos were chosen for each AI platform that demonstrate meaningful user insights. See what users see
A practical playbook for UX teams (and PM’s doing it themselves) to run smarter user tests with less overhead. Why Testing Feels Hard in Enterprise (and How to Make it Easier) Small UX teams in enterprise companies often support multiple product managers, competing priorities, and limited bandwidth. The reality:
The New Imperative-Time-to-Right & Trust UX research has long been centered around selecting the right methods to gather, synthesize, and share user insights. But with the accelerating integration of AI, the core focus has shifted. Success is no longer just about speed to market-it's about getting it right
A look at what keeps powerful findings from shaping product decisions There's no shortage of good research. There's just a shortage of good use of research. As a UX researcher, I’ve seen this happen over and over. We spend weeks on a study, pull together
In the fast-evolving world of product development, user experience (UX) research has never been more critical — or more challenging. At Pulse Labs, we’ve supported countless enterprise teams across industries and regions, giving us a unique vantage point on the trends transforming UX research today. As teams grapple with growing
