Hey !

Welcome to the very first edition of FutureFrames! 🎉 I’m so excited to have you here. This newsletter is all about sharing the coolest things I come across in the ever-changing world of AI—especially when it comes to AI Filmmaking.

If you’ve discovered something awesome or want me to cover a specific tool or workflow in the future, just shoot me an email at philippsieben@pixel-artistry.com. I’d love to hear from you!

Alright, let’s dive in. Here are five amazing updates happening right now in the world of AI.

1. OpenAI’s Sora Turbo Is Finally Here!

The wait is over—OpenAI just released Sora Turbo, their latest text-to-video AI model! If you remember the hype from February 2024 when we first saw public previews, you know how exciting this is. Now, Sora is going head-to-head with other big names like Runway Gen-3, HailuoAI, and Kling AI.

What makes Sora special? Here are some features that really stand out:

• Replace, remove, or reimagine elements in your video seamlessly.

• Re-cut footage by extending or replacing specific parts.

• Storyboard tool to assemble your custom video sequences.

• Video-to-video style transfer for endless creative possibilities.

I think these tools could be game-changers, especially for creators who want more control over their videos. You can see some examples for yourself on their site: https://openai.com/sora/.

Since I haven’t had the chance to test Sora yet, I’m sharing the pros and cons that Marques Brownlee covered in his review:

What’s great:

• Amazing at abstract scenes and motion graphics.

• Handles fluid dynamics beautifully.

• Solid results for cartoons and 2D animation.

What’s not so great:

• Object permanence needs work (things disappear when they shouldn’t!).

• Physics can feel a bit off.

• Movements of people and objects are still clunky.

If you’re curious, you can check out Marques’ full video here: https://youtu.be/OY2x0TyKzIQ?si=T1VU13hosjxhSf23.

Oh, one bummer: Sora isn’t available in Europe yet due to data restrictions. Fingers crossed that changes soon!

2. What’s Coming in MidJourney v7?

The AI art world is buzzing with rumors about MidJourney v7, and I can’t wait to see what they’ve been cooking up. The most exciting hint so far? A 3D system that could let us generate different angles of the same image. Imagine the creative possibilities!

Here’s a sneak peek of what’s being teased: https://the-decoder.com/midjourney-teases-version-7-3d-system-and-external-image-editor/.

3. Patchwork: Collaborative World-Building with MidJourney

MidJourney just dropped something new: Patchwork. It’s an experimental tool that lets you create entire virtual worlds from scratch and style them however you like. Right now, it’s structured like a massive storyboard where you can sketch out different looks for your world.

To me, it feels like the first step toward that 3D system they’ve been hinting at. Definitely worth checking out if you’re curious yourself.

More details here: https://x.com/midjourney/status/1866964271948763553.

4. WorldLabs: Turning 2D Into 3D

This is a new one I stumbled across recently: WorldLabs. The tool promises to turn a single 2D image into a fully realized 3D world. Pretty wild, right? While it’s not available yet, their early previews are definitely worth a look.

If you’re curious, you can check out their documentation and sign up for the waitlist here: https://www.worldlabs.ai/blog.

With rumors that MidJourney might be working on something similar, the race is on. Let’s see who gets there first!

5. Runway Gen-3’s Keyframe Prototype

Last but definitely not least: Runway is working on a keyframing feature for Gen-3, and it looks like it could be a huge deal. This feature will allow us to define keyframes, giving way more control over AI-generated videos.

What’s even cooler? They’re planning to release this as a node-based system, which means it’ll be super flexible and non-destructive. This is one feature I’m dying to test out as soon as it drops.

Check out the sneak peek here: https://twitter.com/runwayml/status/1863679848092246260.

That’s a wrap for this week!

Thanks for reading the very first edition of FutureFrames. I hope you found something here that sparked your curiosity or got you inspired. Let me know which update you’re most excited about—or if you have a tool or workflow you’d like me to cover next time.

Until next time,

Philipp

FutureFrames

Follow me on youtube to learn more about AI:

https://www.youtube.com/@PixelArtistry_