Images and prompts in ALT

Playing with Runway’s new director mode.

Nick St. Pierre is playing with Runway’s new director mode. Here’s an extremely quick and dirty test edit of a random mobster opening scene. Used:

  • Midjourney images
  • Runway motion
  • Triniti music
  • Eleven Labs voice over
  • ChatGPT script

Capcut edit Took around 45 min in total.

Runway settings

  • Clip 1: Static
  • Clip 2: Static, with a slight zoom to draw viewers into the space.
  • Clip 3: Slow, descending crane shot moving closer to table to immerse viewers in the conversation.
  • Clip 4: Handheld, following the movements of the saxophonist’s hands

For the music, I prompted Triniti with “Smokey new york jazz club with sax”:

I kept the prompts for the images pretty consistent, mostly changing subject and camera angle but keeping everything style/color related the same. Below you can see result video:

RunwayML came in with a couple big updates the past week. xcited and curious to see what Midjourney releases for motion.

Rad related articles: