Skip to content
Sign In Subscribe
Benchmarks — Attitudes — Bard — Bing — GPT — Claude — Human

AI Benchmark: GPT-4 is back on Top!

,   and  Pulse Labs
2 min read

Bard and GPT-3.5 are close behind

As part of our Pulse IQ research, we have users compare prompts and responses from different AI platforms side by side. In the latest round of comparison, 61% of users preferred responses from GPT-4.

Overall

Users picked GPT-4 because they perceived the responses to be well thought out, transparent about the AI's limitations, and overall easy to read. People found the responses easier to comprehend because of the clear way information was presented.

I appreciate the use of buffering language at the beginning to soften the authority of the information.

—Millennial

This post is for subscribers only

Subscribe

Already have an account? Sign In

Related

Finding the Right AI for the Job
Benchmarks

Finding the Right AI for the Job

GPT leads both user's platform choice and in blind side-by-side comparison As part of our Pulse IQ Research, we have users compare prompts and responses from different AI platforms in a blind side-by-side comparison. This time, we asked users to review work-related prompts. In the latest round of

,   and  Pulse Labs
Members Public
Most common user goals: does AI satisfy?
Benchmarks

Most common user goals: does AI satisfy?

To better understand the AI opportunities that are lower-hanging fruit, it is important to understand what consumers are asking and what types of prompts come naturally to them. Our research shows that 3 out of 4 people (75%) begin with prompts that fall into three types: * Factual (34%) ex. “How

,   and  Pulse Labs
Members Public
Where AI becomes first choice over search
Benchmarks

Where AI becomes first choice over search

Search is so dominant that it’s stunning to think it could be replaced by something else. But if you can only start in one place, where would you start? We asked that question of 227 US consumers familiar with AI to see which they would use first in nine

,   and  Pulse Labs
Members Public
Claude Enters the Race, Overtaking Bing In Preference
Benchmarks

Claude Enters the Race, Overtaking Bing In Preference

Claude recently released its platform to the public. Pulse IQ™ results shows a strong initial showing: * Claude receives a 45% preference rate when consumers rate responses to a variety of prompts in our blind side-by-side comparison of 5 leading AI platforms. * Claude overtakes Bing which is preferred of 38% of

,   and  Pulse Labs
Members Public

Latest

Webinar Recording- UX in the Era of AI: Navigating Innovations
UX

Webinar Recording- UX in the Era of AI: Navigating Innovations

Sign in or subscribe for access to the webinar recording and more free UX content from Pulse Labs. This insightful 45-minute conversation hosted by Pulse Labs, is designed for UX researchers looking to navigate the rapidly evolving landscape of AI-driven applications. During the session, we hosted a dynamic, moderated discussion

,   and  Pulse Labs
Members Public