Home Mysterious ‘gpt2-chatbot’ emerges as users claim it to be a top AI model rival

Mysterious ‘gpt2-chatbot’ emerges as users claim it to be a top AI model rival


  • A new AI chatbot, "gpt2-chatbot," comparable to GPT-4, has surfaced on LMSYS Org's benchmarking site.
  • Access is limited to Chatbot Arena with a daily query limit, leading to speculation about its origins and abilities.
  • Initial reception suggests gpt2-chatbot may surpass existing models, with comparisons to GPT-4.5 or GPT-5.

A mysterious new AI chatbot named “gpt2-chatbot” has emerged, following its release on a prominent large language model benchmarking site, LMSYS Org.

Speculation suggests that gpt2-chatbot boasts capabilities comparable to OpenAI’s GPT-4, placing it among a select few AI models that have been able to achieve this.

Ethan Mollick, a Professor researching artificial intelligence at the Wharton School of the University of Pennsylvania, wrote in a social media post: “No one knows who made it or what it is, but I have been playing with it a little and it appears to be in the same rough ability level as GPT-4. A mysterious GPT-4 class model?”

Access to the new model is currently restricted to the Chatbot Arena website, albeit in a restricted capacity. Within the site’s “side-by-side” arena mode, where users deliberately choose the model, gpt2-chatbot is subject to a rate limit of eight queries per day, limiting users’ ability to thoroughly test it.

A post on X from the organization later confirmed that the chatbot had been temporarily removed “due to unexpectedly high traffic.” Nevertheless, LMSYS advises staying tuned for its wider releases.

“Just to clarify, following our policy, we’ve partnered with several model developers to bring their new models to our platform for community preview testing,” said LMSYS Org on X, responding to a thread about gpt2-chatbot. “These models are strictly for testing and won’t be listed on the leaderboard until they go public.”

How has gpt2-chatbot been received?

The LLM was even tested by OpenAI CEO Sam Altman, who said he had a “soft spot” for it. However, there has been no confirmation regarding whether this is a model for ChatGPT-4.5 or ChatGPT-5.

Another user said that it “definitely feels like GPT4.5/GPT5 for me. Gave it some hard prompts where I barely get a right answer in Claude/ GPT4 and it aced it.”

Initial mentions of the model surfaced on 4chan before gaining traction on social media platforms like X. Subsequently, Reddit threads emerged, claiming the new model’s enhanced capabilities, surpassing all other language learning models in the field.

Featured image: Canva

About ReadWrite’s Editorial Process

The ReadWrite Editorial policy involves closely monitoring the tech industry for major developments, new product launches, AI breakthroughs, video game releases and other newsworthy events. Editors assign relevant stories to staff writers or freelance contributors with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.

Suswati Basu
Tech journalist

Suswati Basu is a multilingual, award-winning editor and the founder of the intersectional literature channel, How To Be Books. She was shortlisted for the Guardian Mary Stott Prize and longlisted for the Guardian International Development Journalism Award. With 18 years of experience in the media industry, Suswati has held significant roles such as head of audience and deputy editor for NationalWorld news, digital editor for Channel 4 News and ITV News. She has also contributed to the Guardian and received training at the BBC As an audience, trends, and SEO specialist, she has participated in panel events alongside Google. Her…

Get the biggest tech headlines of the day delivered to your inbox

    By signing up, you agree to our Terms and Privacy Policy. Unsubscribe anytime.

    Tech News

    Explore the latest in tech with our Tech News. We cut through the noise for concise, relevant updates, keeping you informed about the rapidly evolving tech landscape with curated content that separates signal from noise.

    In-Depth Tech Stories

    Explore tech impact in In-Depth Stories. Narrative data journalism offers comprehensive analyses, revealing stories behind data. Understand industry trends for a deeper perspective on tech's intricate relationships with society.

    Expert Reviews

    Empower decisions with Expert Reviews, merging industry expertise and insightful analysis. Delve into tech intricacies, get the best deals, and stay ahead with our trustworthy guide to navigating the ever-changing tech market.