Home What is Luma AI’s Dream Machine? Why fans are flocking to video generator

What is Luma AI’s Dream Machine? Why fans are flocking to video generator


  • Luma Labs launched Dream Machine, an AI video tool competing with OpenAI's Sora, gaining popularity on social media.
  • Dream Machine uses Neural Radiance Fields (NeRF) to create realistic videos from detailed text prompts in just two minutes.
  • The tool's launch saw high demand, causing server overloads and necessitating a queuing system for access.
  • Users can create 30 videos per month for free, with higher-tier plans offering up to 2,000 generations for $499.
  • Unlike OpenAI's Sora, Dream Machine is accessible to all, with future plans for API and plugin integrations with creative tools.

Luma Labs, the AI company known for creating the Genie generative 3D model, has now ventured into AI-powered video technology with its new offering, Dream Machine — and social media users have been raving about it. Among several new AI video makers on the scene, it is in direct competition with OpenAI’s upcoming Sora tool.

What is Luma AI?

Luma AI is a platform where users can create 3D models using text, images, or video inputs. The tool helps professionals such as those in architecture, product design, content creation, and research and development, dream up abstract concepts. The company streamlines the process of exporting work across various platforms.

The 3D models are also advancing meta-activities such as gaming, virtual reality, and e-commerce by simplifying the creation of 3D online spaces.

Developed by LumaLabs in San Francisco, California, Luma AI uses knowledge of machine learning, augmented reality, and 3D photography to merge AI with the field of 3D modeling.

Using Neural Radiance Fields (NeRF) technology to transform images and videos captured by smartphones into highly realistic 3D models, NeRF alters ordinary scenes and objects by adding an element of realism to them.

Co-founder and CEO Amit Jain, who was previously part of the Apple Vision Pro and Apple’s computer vision team, is currently leading the charge.

Among the various gadgets, Dream Machine is the company’s new contribution, an AI model designed to produce high-quality, realistic videos from text and images. So far, it generates accurate, consistent, and dynamic visuals. The tool moves toward creating a universal imagination engine and is now accessible to all.

In a statement on their blog page, Luma Labs said: “We have built Dream Machine on a scalable, efficient, and multimodal transformer architecture and trained it directly on videos.”

They described the tool as an “imagination engine,” as “we find joy and purpose in making things. At Luma we are building general AI systems that will help people make beautiful, powerful, creative things that are inaccessible or simply impossible.”

How have people reacted to Dream Machine?

The launch of Dream Machine saw such a surge in demand that Luma Labs had to implement a queuing system after their servers were overwhelmed.

Early videos from users with prior access to Dream Machine posted on social media were so polished, they seemed almost too good to be true as if only the best results were chosen.

The text-to-video generation field is intensely competitive, with key players such as OpenAI’s Sora and Lightricks’ LTX Studio, both of which provide decent videos.

Other startups doing something similar include Pika Labs Inc. and Runway Inc., both of which focus on generating video content from text.

How to use Luma AI’s Dream Machine

To make the best use of the tool, users have to type extremely detailed prompts, more so than when using tools like ChatGPT. For example, writing “grazing cows move slowly across an idyllic meadow, the camera tracking alongside them in a smooth side-angle motion” could make a highly realistic five-second video clip showing exactly that scenario, according to the company.

Dream Machine should be able to create such a video within just two minutes, it said.

ReadWrite tested it, and it provided some interesting results. We used the prompt: “Dream sequence of a woman walking up a mountain turning into an eagle and flying away”

While it starts off fairly accurate, it does something strange by creating a clone of itself showing two different women – one standing and the other flying away.

The second prompt had even less success: “Sequence of a sports motorbike riding on Route 66 in the US, transforming into an eagle”

Instead of the motorcyclist changing into an eagle, he appears to speed off to the side, having a mini accident while a bird randomly flies over. What we found is that the text prompts have to be rather specific for the best results.

With the final test, we used the prompt suggested by Dream Machine itself: “An old lady laughing underwater, wearing a scuba diving suit, her expression denotes calm and happiness”

Its own recommendation worked rather well. Although we can’t zoom in to spot the usual wonky eyes as seen with many AI images, it appears to look very realistic.

Is Luma AI’s Dream Machine free?

As mentioned, anyone interested can use it, but you’ll need to register for an account using your email. Once registered, you’re entitled to 30 generations per month on the free plan. More costly plans offer up to 2,000 generations per month for $499.

Currently, the service is in high demand, which may limit accessibility. The Dream Machine website displays a caution stating, “Generations take 120 seconds. However, due to extremely high demand, your request will be queued.” Being able to create 30 videos for free is useful, especially since most people may not require more than that for personal purposes.

One of the biggest benefits of Dream Machine is its open-source framework, courtesy of Luma AI. In contrast, OpenAI’s Sora, though impressive, is only available to a select test audience, with hints from the company that its top features will be exclusive to paying subscribers, similar to its ChatGPT model.

Dream Machine, on the other hand, is currently accessible to anyone interested in exploring its capabilities. Looking ahead, Luma AI plans to release various APIs and plugins that will allow integration with creative software tools, including Adobe.

Featured image: Luma Labs / Canva

About ReadWrite’s Editorial Process

The ReadWrite Editorial policy involves closely monitoring the tech industry for major developments, new product launches, AI breakthroughs, video game releases and other newsworthy events. Editors assign relevant stories to staff writers or freelance contributors with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.

Suswati Basu
Tech journalist

Suswati Basu is a multilingual, award-winning editor and the founder of the intersectional literature channel, How To Be Books. She was shortlisted for the Guardian Mary Stott Prize and longlisted for the Guardian International Development Journalism Award. With 18 years of experience in the media industry, Suswati has held significant roles such as head of audience and deputy editor for NationalWorld news, digital editor for Channel 4 News and ITV News. She has also contributed to the Guardian and received training at the BBC As an audience, trends, and SEO specialist, she has participated in panel events alongside Google. Her…

Get the biggest tech headlines of the day delivered to your inbox

    By signing up, you agree to our Terms and Privacy Policy. Unsubscribe anytime.

    Tech News

    Explore the latest in tech with our Tech News. We cut through the noise for concise, relevant updates, keeping you informed about the rapidly evolving tech landscape with curated content that separates signal from noise.

    In-Depth Tech Stories

    Explore tech impact in In-Depth Stories. Narrative data journalism offers comprehensive analyses, revealing stories behind data. Understand industry trends for a deeper perspective on tech's intricate relationships with society.

    Expert Reviews

    Empower decisions with Expert Reviews, merging industry expertise and insightful analysis. Delve into tech intricacies, get the best deals, and stay ahead with our trustworthy guide to navigating the ever-changing tech market.