Home Meta will release Llama 3 LLM to compete with GPT-4

Meta will release Llama 3 LLM to compete with GPT-4

Meta has confirmed that it is releasing its new open-source large language model (LLM) within the next month, according to reports.

TechCrunch reported that at an event in London on Tuesday (March 10), Meta’s president of global affairs, Nick Clegg, said, “Within the next month, actually less, hopefully in a very short period of time, we hope to start rolling out our new suite of next-generation foundation models, Llama 3.

“There will be a number of different models with different capabilities, different versatilities [released] during the course of this year, starting really very soon,” he added.

The Information originally claimed that a smaller version of Llama 3 would be released as early as next week, with the complete open-source model still set to launch in July. This version will be capable of competing with Claude 3 and GPT-4.

Chris Cox, Meta’s Chief Product Officer, added that the plan involves using Llama 3 to power a variety of Meta’s products.

The announcement comes as Meta attempts to catch up in the hyper-competitive world of generative AI. Its predecessor, Llama 2, was released in July 2023 and faced criticism for its limitations.

Joelle Pineau, Vice President of AI Research, stated, “Our objective is to evolve a Llama-powered Meta AI into the world’s most useful assistant. However, there’s still a significant amount of work needed to achieve this goal.”

However, Meta’s chief AI scientist Yann LeCun believes that Joint Embedding Predictive Architecture (JEPA) is the answer rather than generative AI. According to Meta, unlike generative approaches that try to fill in every missing pixel, JEPA has the flexibility to discard unpredictable information, which leads to improved training and sample efficiency.

What is Llama 3?

Llama 3, a large language model, will be available in sizes ranging from the very small, designed to compete with models such as Claude Haiku or Gemini Nano, to larger versions fully equipped for responses and reasoning, similar to GPT-4 or Claude Opus.

Details about Llama 3 remain scarce, however, it is expected that it will follow the previous version’s footsteps by being open source and is anticipated to be multimodal, understanding both visual and text inputs.

It is thought that Llama 3 will come in various versions and sizes, with the smallest having 7 billion parameters and the largest having around 140 billion parameters. However, this still falls short of the trillion-plus parameters that were used to train GPT-4.

Featured image: Canva

About ReadWrite’s Editorial Process

The ReadWrite Editorial policy involves closely monitoring the tech industry for major developments, new product launches, AI breakthroughs, video game releases and other newsworthy events. Editors assign relevant stories to staff writers or freelance contributors with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.

Suswati Basu
Tech journalist

Suswati Basu is a multilingual, award-winning editor and the founder of the intersectional literature channel, How To Be Books. She was shortlisted for the Guardian Mary Stott Prize and longlisted for the Guardian International Development Journalism Award. With 18 years of experience in the media industry, Suswati has held significant roles such as head of audience and deputy editor for NationalWorld news, digital editor for Channel 4 News and ITV News. She has also contributed to the Guardian and received training at the BBC As an audience, trends, and SEO specialist, she has participated in panel events alongside Google. Her…

Get the biggest tech headlines of the day delivered to your inbox

    By signing up, you agree to our Terms and Privacy Policy. Unsubscribe anytime.

    Tech News

    Explore the latest in tech with our Tech News. We cut through the noise for concise, relevant updates, keeping you informed about the rapidly evolving tech landscape with curated content that separates signal from noise.

    In-Depth Tech Stories

    Explore tech impact in In-Depth Stories. Narrative data journalism offers comprehensive analyses, revealing stories behind data. Understand industry trends for a deeper perspective on tech's intricate relationships with society.

    Expert Reviews

    Empower decisions with Expert Reviews, merging industry expertise and insightful analysis. Delve into tech intricacies, get the best deals, and stay ahead with our trustworthy guide to navigating the ever-changing tech market.