Home AI startup Runway releases facial expression motion capture

AI startup Runway releases facial expression motion capture

The AI startup Runway hones in on perfecting video generation as it releases a new AI facial expression motion capture feature.

The company introduced ‘Act-One’ on Tuesday (October 22) describing it as being “a new state-of-the-art tool for generating expressive character performances inside Gen-3 Alpha.”

Runway is an AI startup which has headquarters in New York. It was in June of last year when it raised $141 million from the likes of Google, Nvidia, and other key players in the technology space.

Act-One can be applied to a range of reference images, with the model preserving realistic facial expressions and translating this into characters with proportions different from the original source video.

The belief is this new addition “represents a significant step forward in using generative models for expressive live action and animated content.”

“The model also excels in producing cinematic and realistic outputs, and is remarkably robust across camera angles while maintaining high-fidelity face animations. This capability allows creators to develop believable characters that deliver genuine emotion and expression, enhancing the viewer’s connection to the content.”

Runway says the team has been exploring how Act-One can create the generation of multi-turn, expressive dialogue scenes, which has been challenging to create in the past with generative video models.

“You can now create narrative content using nothing more than a consumer grade camera and one actor reading and performing different characters from a script.

Runway bolsters safety precautions as it launches AI facial expression motion capture

While the world of AI is advancing at a rapid pace, those in the industry have been nervous about its usage. The team behind Runway says they’re “committed to responsible development and deployment,” so the new tool is being released with a suite of content moderation and safety precautions.

These include robust capabilities to detect and block attempts to generate content containing public figures, as well as technical measures to verify that an end user has the right to use the voice that they create using Custom Voices.

There will also be “continuous monitoring to detect and mitigate other potential misuses of our tools and platform.”

Act-One will begin gradually rolling out to users from this week, before soon being available to everyone.

Featured Image: Screenshot of video via Runway news release

About ReadWrite’s Editorial Process

The ReadWrite Editorial policy involves closely monitoring the tech, gambling and blockchain industries for major developments, new product and brand launches, AI breakthroughs, game releases and other newsworthy events. Editors assign relevant stories to in-house staff writers with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.

Sophie Atkinson
Tech Journalist

Sophie Atkinson is a UK-based journalist and content writer, as well as a founder of a content agency which focuses on storytelling through social media marketing. She kicked off her career with a Print Futures Award which champions young talent working in print, paper and publishing. Heading straight into a regional newsroom, after graduating with a BA (Hons) degree in Journalism, Sophie started by working for Reach PLC. Now, with five years experience in journalism and many more in content marketing, Sophie works as a freelance writer and marketer. Her areas of specialty span a wide range, including technology, business,…

Get the biggest tech headlines of the day delivered to your inbox

    By signing up, you agree to our Terms and Privacy Policy. Unsubscribe anytime.

    Tech News

    Explore the latest in tech with our Tech News. We cut through the noise for concise, relevant updates, keeping you informed about the rapidly evolving tech landscape with curated content that separates signal from noise.

    In-Depth Tech Stories

    Explore tech impact in In-Depth Stories. Narrative data journalism offers comprehensive analyses, revealing stories behind data. Understand industry trends for a deeper perspective on tech's intricate relationships with society.

    Expert Reviews

    Empower decisions with Expert Reviews, merging industry expertise and insightful analysis. Delve into tech intricacies, get the best deals, and stay ahead with our trustworthy guide to navigating the ever-changing tech market.