OpenAI has upgraded its ChatGPT-4o model to write in a more “natural, engaging, and tailored” manner. The large language model, or LLM, is the AI company’s flagship, often used as the bar of quality in the industry.
Some have hailed the update as “insane”, posting an Eminem-styled AI-written rap. Others have tried to measure its creativity in a more data-centric way.
The maintainer of EQ-Bench, an “emotional intelligence benchmark for LLMs”, has found that GPT-4o beats out the competition by several points. This places it at the top of its leaderboards.
OpenAI cooked!
Two new creative writing leaders:
gpt-4o-2024-11-20 (tied highest creative writing score)
Mistral-Large-Instruct-2411 (highest slop score)Fun fact: In 3 different stories, mistral-large used "a testament to" 3 times. *Per story*. Yup. pic.twitter.com/da8zKiv7Kx
— Sam Paech (@sam_paech) November 21, 2024
Other benchmarks have now put the update at the top of other leaderboards, clearing Google’s Gemini Experimental model by almost 20 points.
OpenAI doesn’t delve any further than saying that it has been tuned to be more creative. The company’s CEO, Sam Altman, simply stated “good new model out!” in a post on X.
However, how the creativity is being measured or improved is being questioned. One user, an art advocate asked if GPT-4o had started “observing the world [and] finding its own insights… its own non-derivative point of view?”
Hey @OpenAI @sama How did GOT-4o improve its “creativity?” Did it start observing the world & finding its own insights…its own non-derivative point of view? Is it no longer bound by the data in its training sets? Speaking of which, what’s in its data sets? 🤔@ednewtonrex https://t.co/WYmxlKkmez
— neil turkewitz (@neilturkewitz) November 20, 2024
This is about the fact that LLMs cannot create what they don’t already have on hand. When ChatGPT launched, it couldn’t tell you anything after a certain date in 2021. OpenAI, and competing companies, train these models on massive quantities of data. It has led to an outcry over copyright infringement, something which the New York Times is currently suing OpenAI over.
The AI company itself admitted that it couldn’t train its models without infringing on copyright. Other companies in the same arena, like Nvidia, have been caught harvesting hours of Netflix to train video generators.
OpenAI plans to become a for-profit company as it restructures itself. This has led to multiple figures at the company leaving. OpenAI has also raised one of the largest rounds of venture capitalist investment, totaling $6.6 billion, as its value continues to rocket over $150 billion.
Featured image: OpenAI, Pexels/Pixabay