Evolving tools redefine AI video

The AI video generation space has evolved dramatically in recent weeks, with several major players introducing groundbreaking tools.

Here’s a comprehensive look at the current landscape:

Veo 2

Veo 2 (Google) has emerged as a frontrunner, demonstrating superior prompt adherence and video quality compared to its competitors. While it’s currently waitlist-only and lacks image upload capabilities, its output quality sets a high benchmark.

Prompt: An emotional farewell at a futuristic spaceport, where a character watches their loved one board a spaceship. photorealistic

Kling AI 1.6

Kling AI Video (v1.6) leads the pack with impressive improvements in natural movement, physics simulation, and prompt interpretation. The latest version showcases enhanced coherence and quality, particularly in physical motion sequences.

Ideogram 2.0 image + Prompt: Dynamic tracking shot following a BMW iX through a futuristic light corridor, geometric frames pulsing with cyan and red energy. Camera starts wide, revealing the full architecture of light, then smoothly pushes in as the vehicle accelerates forward. Hyper-detailed reflections, premium sci-fi commercial quality with ultra-crisp motion.

Pika 2.0

Pika 2.0 marks a significant upgrade from its predecessor, introducing an innovative “Ingredients” feature that allows users to combine uploaded images into cohesive videos with realistic placement. There are new templates to upload a person to replace a character in the scene. The improvement in prompt adherence and overall quality is notable.

My selfie uploaded to a new Pika 2.0 template (unbelievable character consistency, including my glasses!)

Runway Gen-3

Runway’s Gen-3 excels in specialized features, offering unique capabilities like video-to-video transformation and canvas extension options. It’s capable of creating a cinematic look.

Midjourney image + Prompt: Cinematic split panel view, wide-shot underwater view of a majestic sailing ship at sunset with tall masts, silhouetted against a vibrant orange and blue sky. Below the ocean surface, a sunken wooden ship lies illuminated by underwater rays, with mountains and dramatic clouds in the background.

Luma AI Dream Machine

Luma AI Dream Machine combines their Photon image model with video generation, featuring a new Boards system for maintaining consistent visual styles across projects.

Photon image + Dream Machine-generated prompt: Watch as a constellation figure interacts with Van Gogh-inspired starry patterns in a sci-fi corridor, creating a vibrant dance of light.

Hailuo MiniMax

Meanwhile, Hailuo’s MiniMax impresses with realistic human movement, improved textures, and consistent video quality.

Midjourney image + Prompt: A cute couple at the beach

Sora

OpenAI’s Sora, while innovative, remains unavailable in several regions (including the EU/UK) and produces somewhat unpredictable results.

Prompt: POV racing down a snowy mountain slope, powder spraying into lens, weaving between snow-laden pine trees, dramatic mountain peaks ahead. Dynamic motion, natural lighting

Hunyuan Video

Hunyuan Video by Tencent offers a robust open-source alternative with great prompt adherence, natural motion, and quality, but only accessible through platforms like Replicate and Fal or run locally.

Prompt: Rear view shot from inside the car, focusing on the tunnel lights passing by.

A bright future for AI video tools

There are several other video models and platforms, including PixVerse, Haiper, Mochi 1 ( open source ), Higgsfield ReelMagic, LTX Studio, and more.

The landscape continues to evolve, with each platform bringing unique strengths to the table. While accessibility varies, the overall trend points toward more sophisticated, user-friendly tools for video generation.

Thank you for reading.

I cover generative AI tools in more detail on 𝕏, Substack, and my YouTube channel.

If you enjoyed this article, try this next:

OpenAI’s Sora changed AI video forever

It’s beginning to feel like we’re on a rollercoaster of generative AI news (again), but OpenAI’s reveal of their ground-breaking text-to-video tool eclipsed just about everything else!

Meet Sora

OpenAI’s powerful AI video model surprised the world with unbelievable clips generated by simple text descriptions:

What makes Sora unique?

• Videos up to 1 minute

• Complex scenes with multiple characters

• Can maintain character & scene consistency

Open AI’s technical report goes much deeper into the mechanics of Sora’s video generation capabilities. You can read more details here.

How does Sora work?

Sora creates videos by first compressing raw video into a lower-dimensional latent space and then decomposing it into spacetime patches, similar to how large language models use text tokens.

It uses a diffusion transformer approach to predict “clean” patches from noisy input, allowing it to generate videos of various durations, aspect ratios, and resolutions.

You can see the different aspect ratios on the clips in the video below:

Multiple inputs can be used to prompt videos

Sora can be prompted with text, images, or videos to create content that accurately follows user prompts, making it versatile for different videos and giving you more control over output.

Improved language understanding for text input

OpenAI returned to a “re-captioning technique” used with DALL•E 3 in Sora for improved language understanding, after being trained on “highly descriptive video captions.”

Here is an example of the results from this method. You can see the underlined words and phrases can be mixed and matched for different output:

Transforming videos with text prompts

OpenAI used SDEdit to give Sora the ability to change the style and setting of the original video in real time.

The technical report allows you to click the text prompt above the video output on the right side:

Seamless transitions between two videos

Sora can transition between two, separate input videos to create a new output with a combination of styles and composition from each.

This is an example — the middle video is a combination of the first and last video:

When will Sora be available?

Sora is not available to the public, while OpenAI allows “red teamers to assess critical areas for harms or risks.”

But, they have been sharing additional mind-blowing videos, including public requests on 𝕏 and new videos on TikTok. I’ve been posting several of those examples on 𝕏, like this one here, and below:

Heather Cooper on Twitter: "I love this video generated by Sora!I added some background music.Prompt: "cinematic trailer for a group of samoyed puppies learning to become chefs"Credit: @billpeeb pic.twitter.com/p1NAKdkZUe / Twitter"

I love this video generated by Sora!I added some background music.Prompt: "cinematic trailer for a group of samoyed puppies learning to become chefs"Credit: @billpeeb pic.twitter.com/p1NAKdkZUe

Heather Cooper on Twitter: "Sora can generate several videos at the same time.Side-by-side.From @billpeeb pic.twitter.com/FtPwFnFxFG / Twitter"

Sora can generate several videos at the same time.Side-by-side.From @billpeeb pic.twitter.com/FtPwFnFxFG

Sora’s limitations

OpenAI noted several weaknesses with Sora, including difficulty simulating accurate physical movement and characteristics of complex scenes, or misinterpreting specific types of cause and effect.

What does this mean for the future of video and film?

I have no experience in media production, but I do have extensive experience in AI animation and video technology.

I think Sora is incredible and this is just the beginning of a new era of generative AI.

I do not think it can replace human involvement in filmmaking or video production, but I think it opens a world of possibilities for a variety of things most of us can’t imagine.

For regular, everyday people who want to generate a quick video or animate a still image — this technology will allow more people to tell their stories.

I have always been an advocate for increasing access to these tools and making people aware of their existence and how they can use them.

But, I know this technology is improving rapidly and there is a huge potential for misinformation, deep fakes, and untold negative outcomes. I will try to stay informed and share what I know with you, from my perspective.

Thank you for reading.

If you enjoyed this article, try these next:

• How AI transforms emojis to art
• The art of image generation: a prompt’s potential
• AI Brings Images to Life: Runway ML’s Gen-2

I generated the images for this article as a Valentine’s Day-themed gallery of H.R. Giger’s distinctive style with an artificial intelligence (AI) romantic twist.

I used Midjourney for each image included, below. I am a fan of his work in several films, and I wanted to share his unique background with you.

Who is H.R. Giger?

Hans Ruedi Giger, known as H.R. Giger, was a Swiss artist famous for his unique and eerie “biomechanical” style.

Born on February 5, 1940, in Chur, Switzerland, Giger’s talent for blending human forms with mechanical elements captivated the world. His father, a pharmacist, wanted him to pursue a practical career, but Giger’s passion for art led him to study architecture and industrial design in Zurich.

H.R. Giger’s distinctive style

Giger’s art is a mix of science fiction, fantasy, and the macabre.

He started with ink drawings and moved on to airbrush, creating haunting images that often featured human bodies fused with machines. His work extended beyond the canvas, influencing album covers, furniture, and even tattoos.

His big break came with the 1979 film “Alien,” where his design for the iconic creature won an Academy Award for Best Achievement in Visual Effects. Giger’s Alien design was inspired by his painting, “Necronom IV,” and it became a symbol of sci-fi horror.

I asked Midjourney for an example of Giger’s style:

Prompt: How would an eerie H.R. Giger-inspired surrealist artwork look like, with biomechanical elements, otherworldly landscapes, and intricate details that blend organic and mechanical forms to evoke a sense of unsettling beauty?

H.R. Giger’s Legacy

Giger’s art is celebrated worldwide, with a museum in Switzerland dedicated to his work.

He passed away on May 12, 2014, but his legacy lives on, influencing artists and filmmakers with his vision of a world where biology and technology intertwine.

HR Giger Museum

Reimagining Giger’s style with a touch of romance

I love the Alien and Alien vs. Predator films, and I thought this would be a unique way to highlight H.R. Giger’s style for other Sci-Fi fans.

This is the prompt for each of these images:

glowing hearts, metallic textures, soft lighting, futuristic, couple, robots, gentle touch, detailed, shimmering, cybernetic, elegance, emotional, vivid colors, warm tones, digital painting, soft focus, H.R. Giger

Thank you for reading. Hope you enjoyed it 💖

I write about AI tools and visual content creation on 𝕏/Twitter and my Visually AI free newsletter and YouTube channel. And of course, here on Medium.

If you’d like to explore interesting generative AI tools and tips, subscribe to my weekly newsletter here:

Visually AI by Heather Cooper | Substack

Check out prompts, editing, tools, and highlights from my weekly Generative AI Space on my YouTube channel here:

Heather Cooper

You might enjoy these articles, too:

• How AI transforms emojis to art
• The art of image generation: a prompt’s potential

Simple image prompts can produce beautiful results.

In this article, I’ll explore how a simple image prompt can create stunning mountain paintings across 10 platforms.

Prompt: “Stylized painting of a mountain range at sunrise”

10 examples using the same prompt from different image generators:

1. Lexica

2. Midjourney v5

3. ClipDrop Stable Diffusion XL (SDXL)

4. NightCafe SDXL

5. Easy-Peasy AI

6. Prompt Hunt

7. Bing Image Creator

8. Genmo AI

9. Stablecog (Kandinsky Model)

10. DreamStudio SDXL

So there you have it — the magic of a simple image prompt and the variety of beautiful images created as a result.

From Lexica to DreamStudio, each image generator brings a unique touch to the art it creates. I like experimenting with different platforms and models to learn how to get the best output for each prompt.

I didn’t edit the images above for size or effects to show you how each would display on the page. Many AI image generators allow you to change the image dimensions, but some don’t have that option.

Choose what works best for you.

Thank you for reading.

If you enjoyed this article, try these next:

• Experience the Unique Fusion of Traditional Art and Technology with the Vieutopia AI Image App
• I used ChatGPT to write AI art prompts to illustrate a short story.

The art of image generation: a prompt’s potential was originally published in Bootcamp on Medium, where people are continuing the conversation by highlighting and responding to this story.

Save time and boost your productivity with clickable video transcripts

Finding time to learn new things or catch up on your favorite YouTube content can be challenging.

YouTube has tons of helpful information anyone can use if you have the time to watch those videos. But what if there was a way to watch videos quickly, with a completely interactive transcription instead of a summary?

One of my favorite time-savers is YouTube Transcript, a free application that uses artificial intelligence (AI) to help you make the most of your limited time. With YouTube Transcript, you get a clickable transcript for any video, allowing you to jump to specific sections easily. Whether you’re looking to learn a new skill or simply stay updated on your favorite channels, this tool is a game-changer.

To get started, all you need to do is enter the video URL and select the transcript you want to view. Click on any section of the transcript, and you’ll be taken to that exact spot in the video.

It’s a simple way to navigate video content without feeling guilty because you don’t have time.

The video above, created by Bilawal Sidhu, is my screen recording showing you how easy it is to scroll through the transcript, click on any section and the video jumps to that spot.

Bilawal is a friend of mine, and he’s extremely knowledgeable about artificial intelligence (AI) technology for video content creation. His YouTube channel is filled with valuable resources and insights about generative AI, and he simplifies complex topics for any audience.

Don’t let limited time hold you back from learning and growing. Try YouTube Transcript for a smarter, more efficient way to consume video content. It’s easy to use and free!

I’m not an affiliate and don’t get any benefit from writing this article — I have no idea who created this app. But, it’s one of the best tools I’ve used recently and I hope it can help you too.

Thank you for reading. If you found this article useful, try these next:

• 11 ways to use ChatGPT to create your content and save you hours of time
• Unleashing the Future of AI: A Deep Dive into GPT-4

Stay informed without drowning in AI information with my free weekly newsletter:

Subscribe to Visually AI to catch up on the latest tips, tools, and trends for content creation.

Here’s a Smarter Way to Watch Videos in Less Time: YouTube Transcript App was originally published in Anyone Can Write Online on Medium, where people are continuing the conversation by highlighting and responding to this story.