By
Alan Truly
In a few short months, the world of generative AI has evolved from chatbots like ChatGPT to photorealistic images created by Midjourney. In case you thought things were slowing down any time soon, AI-generated videos might be about to have their big moment in the spotlight.
As highlighted by a tweet from Philipp Tsipman, the founder of a marketing platform for such videos, there have been five new AI video generators launched in just the last seven days. The quality varies, but it’s clear that the technology is moving at a relentless pace. So, let’s break down the five AI video generators, which range from janky to seriously impressive.
If you’re having trouble keeping up with Video AI😅, there have been 5 state-of-the-art generative video models released *in last 7 days*: 🤯😎🧵 pic.twitter.com/cki9SMfozr
— Philipp Tsipman (@ptsi) March 26, 2023
Runway
Runway has been leading the pack in publicly available AI editing. Masking, motion-tracking, super slow-motion, and color grading all benefit from AI assistance. This is a subscription-based service, so it has extra incentive to push the limits.
In February, Runway started testing generative video with its Gen-1 update, which lets you restyle a video with words. A video of a walk down the street becomes an animated short that appears to be made with hand-sculpted and posed Claymation characters.
Runway released Gen-1 publicly today and is already testing Gen-2, eliminating the need for a reference video. Soon, Runway will let you create a video with a simple text prompt.
Picsart
You might recognize Picsart as a free photo editor, but it also offers video editing. Text2Video-Zero is a Picsart research tool that uses the Stable Diffusion AI image generator to create multiple frames with enough in common to look cohesive.
This is significant progress. as early experiments at assembling AI images as video frames produced chaotic scenes where every detail constantly shifted. The effect was eye-catching, but distracted from the content.
Video-P2P
Video-P2P is an open-source project similar to Runway Gen-1. It takes video input and uses Stable Diffusion to style it with text prompts. The examples shown look good, with steady backgrounds and consistency in the altered elements.
TemporalNet
TemporalNet is based on ControlNet, an advanced AI image generator that allows more control of the poses of figures that appear in pictures.
The videos have some flicker, but the results are promising. ControlNet took a big step toward producing predictable scenes, and TemporalNet might provide a nice alternative method of creating videos.
Text-to-video
Text-to-video is an AI model created by Alibaba. It’s clear that this model needs a bit more work, but having more options to explore is always a good thing.
fast & longer text-to-video with 🧨 diffusers
you maybe saw fun junky text-to-video from the ModelScope’s research model lately
with diffusers you can control how long the video is – and fit it on smol VRAM GPUs, including free colab. Try out here:https://t.co/uPVd9hEOtr pic.twitter.com/mIFkGnGT5V
— poli from multimodal art (@multimodalart) March 22, 2023
Fast-paced innovation
The rapid pace of AI innovation is phenomenal. Just months ago, we were teased with glimpses of the potential of similar videos created in AI labs. In 2022, one of the first public AI video generators simply superimposed tiny AI images over stock footage.
Those “old school” methods, from a few months ago, are laughable when you see how far AI has progressed in such a short amount of time.
Editors’ Recommendations
-
Canva’s new AI tools might replace your video editor -
ChatGPT vs. Bing Chat: which is the best AI chatbot? -
Bing Image Creator brings DALL-E AI-generated images to your browser -
Midjourney v5 language model update adds realism to human hands -
These are the new AI features coming to Gmail, Google Docs, and Sheets
Jasper AI: how to use the ChatGPT alternative now
Jasper AI is a powerful, new alternative to ChatGPT that offers quick, generative text with no waitlist. You probably haven’t heard of Jasper AI, originally known as Jarvis AI, until Marvel challenged the name that conflicted with Iron Man’s AI companion.
Even with the name change, Jasper AI will still help you tackle your emails, blogs, social media posts, and more with AI information and writing assistance. If ChatGPT isn’t cutting it for you, Jasper AI may be the perfect solution.
What is Jasper AI?
is a software development company founded in 2020 and based in Austin, Texas. The Y Combinator startup launched its new Jasper Chat feature on December 20, 2022, riding the wave of enthusiasm that OpenAI created with ChatGPT.
Microsoft will launch ChatGPT 4 with AI videos next week
ChatGPT has been inescapable in recent months, and it looks like Microsoft is about to upgrade the AI tool with an update that could thrust it into the spotlight once again. That’s because the company is set to launch GPT-4 as early as next week, and it will potentially let you create AI-generated videos from simple text prompts.
The news was revealed by Andreas Braun, Chief Technology Officer at Microsoft Germany, at a recent event titled “AI in Focus — Digital Kickoff” (via Heise). According to Braun, “We will introduce GPT-4 next week … we will have multimodal models that will offer completely different possibilities — for example videos.”
Grammarly’s new ChatGPT-like AI generator can do a lot more than proofread your writing
Grammarly, one of the biggest names in writing tools, is adding AI-generated text to its repertoire on the heels of the wild popularity of ChatGPT. Known as GrammarlyGO, this new tool is focused on improving writing rather than replacing the writer.
GrammarlyGO will roll out in beta form to existing users in April. All tiers, including developers, business, education, and premium users, will have access. You can even use GrammarlyGO with a free account.
