I make a lot of content around art and creative tech. Stay ahead of the curve and subscribe to my weekly newsletter for creatives!
Share
Creative tools for video just keep coming!
Published 2 months agoΒ β’Β 2 min read
β
Welcome,
AI video is showing no signs of slowing down! We have a few updates this week that are just steadily advancing AI video ahead of what I thought and some are slowly really leaning into process and fine-tuning.
"EMO: Emote Portrait Alive" introduces a novel AI framework named EMO by Alibaba. Check out the video above to see how it fuses a vocal source, image source to then create the final output.
What we know:
EMO generates expressive portrait videos from audio inputs without needing 3D models or facial landmarks.
It synthesizes realistic facial expressions and smooth video transitions directly from audio.
Demonstrates enhanced performance in creating lifelike speaking and singing videos.
Offers significant advancements in expressiveness and realism compared to existing technologies.
Why this matters:
This coupled with Sora is moving more and more towards hype-realistic content slowly blurring the lines of what is real and what isn't. Although, you can watch this video a few times and see a weird mouth movement .. you can't deny that it's pretty good. This isn't released yet but you can always read more about in the link below!
Lightricks has launched LTX Studio, an AI-powered filmmaking tool designed to assist creators from ideation to producing AI-powered short clips, illustrating potential storylines. Lightricks, has also made apps such as Facetune and Videoleap. This web-based tool is currently available on a waitlist basis, with plans to make it accessible to everyone soon (free of charge initially).
What we know:
Script and Storyboard Creation: From a typed idea, it generates scripts, storyboards, and characters.
Customization Options: Users can modify scenes, styles (e.g., anime, cinematic), weather, and location settings.
Character Customization: Allows adding, removing, or modifying characters, including importing images to create characters.
Preview and Export: Enables storyline tweaking, shot editing, and exporting the film for feedback.
LTX Studio aims at professionals, including filmmakers and ad agencies, to quickly visualize and iterate on conceptual stories or scene options economically. LTX is not quite out yet as well but you can join the waitlist below!
Pika Labs slowly introduced a new lip syncing feature to its model in partnership with ElevenLabs. This feature is available for Super Collaborators and Pro Users for Pika.
Image Credit: Pika Labs
ππ½ Why I'm not scared about Sora AI but...
With AI video coming into the scene rapidly, I think AI effects artists and society in a few ways. I share my thoughts about Sora, creativity, trends and some important skills I believe are important for this century. Check it out here and let me know if this is more of what you'd like to see!
β
π Morph Studio
Image Credit: Morph Studio
Morph Studio introduces an AI filmmaking platform allowing users to create movies from Stability AI-generated clips.
What we know:
Storyboard-based creation with text prompts for scenes.
Partnership with Stability AI, planning for diverse generative video models
Workflow for generating, editing, and cross-cutting scenes (see the image connecting frames?!)
Emphasis on community sharing and template modification
Aimed at merging filming, editing, and post-production into a seamless process
Sidenote:
This studio looks very interesting and similar to some of the kind of control you'd get with comfy ui (matching nodes and all). It looks pretty promising for creators looking to fine tune their videos! This is another one that isn't quite out yet but you can sign up below to join its waitlist.
That's all for now and thank you for adding me to your inbox π. I hope you found this summary of creative tools to be helpful and informative. If you have suggestions for ideas or topics, feel free to message me!
Welcome back! I know I said AI video will make moves this year but I wasn't expecting AI Video to get this good, this early. However, here we are early in the year and OpenAI just announced their most impressive version of AI Video! What's new this week: Sora by OpenAI is the biggest news and advancement π₯ OpenAI announces Sora AI video model Yesterday, OpenAI announced Sora, which is the most impressive video model to date. This video clip is but a glimpse into this massive update. Visit...
Hello everyone! I'm back! We are back with AI and emerging technologies and creativity. What's new this week: Bard is no longer Bard βHello, Gemini! Brilliant Labs creates AR/AI glasses Midjourney Alpha is here for more users! OpenAI agents π₯ Hello, Gemini from Google Image: Google Bard and Duet AI has officially rebranded as Gemini! Combined, you can collaborate with AI. What we know: Google introduces Gemini, a new app for iOS and Android is rolling out too in the coming weeks Gemini Ultra...
Hey everyoneππ½, I've been absent for a few reasons but I am back and this week certainly is a wild one! Here's what's new this week: Meta releases Emu Video & Edit Google released 'Lyria' Microsoft released Copilot Studio An AI to UI tool that goes viral π¬ Meta - Emu Edit and Emu Video Emu Video This technology creates 512x512 4 second long videos at 16 frames per second in a 2-step process. It will first generate the image from text prompts and then create videos based on the images and...
β
β