Deforum Stable Diffusion — official extension script for automatic1111's webui

For now, video-input, 2D, pseudo-2D and 3D animation modes are available. Interpolation and render image batch temporary excluded for simplicity

Before Starting

Read the README file at the original Deforum repo

https://github.com/deforum/stable-diffusion

Getting Started

0. Cover yourself in oil

1. Install Automatic1111's webui

2. Download this repository and put the files deforum.py and the 'deforum' folder into the 'scripts' folder inside your WebUI installation directory

3. Important: If you want to use 3D mode, launch the WebUI with the --disable-safe-unpickle option or else it won't let you to use the depth models! .Open the webui, switch to 'img2img' tab and select 'Deforum v0.5-webui-beta' in the 'Custom scripts' dropdown menu

4. Enter the animation settings. Refer to this general guide and this guide to math keyframing functions in Deforum. However, in this version prompt weights less than zero don't just like in original Deforum! Split the positive and the negative prompt in the json section using --neg argument like this "apple:`where(cos(t)>=0, cos(t), 0)`, snow --neg strawberry:`where(cos(t)<0, -cos(t), 0)`"

5. Run the script and see if you got it working or even got something. In 3D mode a large delay is expected at first as the script downloads the depth models.

6. If it gives errors on missing modules, run pip install requirements.txt with requirements.txt being from this repo.

7. Join our Discord where you can post generated stuff, ask questions and infuriate the devs with 'this feature is in auto's build. When will it be in Deforum? Why can't I launch Deforum on my potato computer?'(not anymore, ha-ha) https://discord.gg/deforum. There's also the 'Issues' tab in the repo.

8. Profit!

Showcase

Proof that it works good enough of automatic1111's build with MATH keyframing and prompt-weighting enabled in 3D mode

'Le Grand Interface' at work:

Math evaluation: