Can everyone be a director? The video AIGC tool is further evolved, and the cost of 100 frames is reduced to 3 cents

Source: Science and Technology Innovation Board Daily

** "Kechuangban Daily" News on May 12 (Editor Zheng Yuanfang) ** Joe Russo, one of the Russo brothers, the director of "The Avengers", just announced that it is expected that there will be a movie completely produced by AI in 2 years. Stability AI has released a new tool for AI-generated video, which further reduces the difficulty of making movies, at least animated short films.

On May 11 local time, **Stability AI released the Stable Animation SDK, a tool designed for artists and developers, designed to help artists and developers generate animations using the most advanced stable diffusion model. **

With this tool, users can use all Stable Diffusion models, including Stable Diffusion 2.0, Stable Diffusion XL, etc.

More importantly, the ways users generate animations have become more diverse. In short, there are three types: Wensheng Video, Picture-generated Video, and Video-generated Video.

1) Text input: It uses the form of text to generate animation after adjusting various parameters. This function is similar to the previous Stable Diffusion, Midjourney or DALL-E 2.

2) Text input + initial image input: The user provides an initial image as the starting point of the animation, and then cooperates with the text to generate the final animation effect.

3) Initial video input + text input: The user provides an initial video as the animation basis. After parameter adjustment and text guidance, animation can finally be output.

At the same time, Stable Animation can set many parameters, including maximum frame number, height, width, sampler, style, color tone, etc.. Among them, the available style presets include anime, film, manga, digital art, enhanced fantasy art, line, punk, photography and many other forms.

Currently, Stable Animation only offers a software development kit (SDK) and a paid API. And some parameter requirements may affect the price. Stability says quotes range from 3 cents to 18 cents per 100 frames at different settings.

In fact, Stability AI has previously launched an animation tool based on Stable Diffusion. For example, users can generate small animations through interpolation. After this upgrade, Stable Animation's ability to generate videos has become more comprehensive and mature.

It is worth mentioning that in the new trailer of Wes Anderson's "Lord of the Rings" released recently, there are traces of some AI tools. Andrej Karpathy, the former AI director of OpenAI, guessed that tools such as Midjourney/Stable Diffusion, ControlNet, ElevenLabs, D-Id, ChatGPT, and Adobe were used in this trailer.

Soochow Securities pointed out that the film and television industry, as a comprehensive audio, video, and text, is a high-quality landing scene for generative AI; From the perspective of the value and path of AI applications, animated films are expected to be the first to benefit.

Compared with the 1-2 year production cycle of live-action movies, animated movies take longer (3-4 years), the project is more complicated, and the production capacity constraints are more obvious. Generative AI technology is expected to empower animation films in the early script creation, mid-term painting, final video editing/dubbing/video output and other links, breaking the bottleneck of animation film production capacity, and further opening up the market by increasing the supply of high-quality animation films in the industry space.