YouTuber LegoEddy, who creates stop-motion animation shorts with LEGOs, typically shoots at 15 frames per second. That's fifteen set-ups for each second of footage. More fanatical stop-motion animators will go for 60 f.p.s., which is why it can take them years to complete a short that runs for mere minutes.
After learning about video frame interpolation, an AI-based technology that renders and fills in the differences between two shots, LegoEddy wondered if it could be applied to stop-motion animation. In other words, could he shoot 15 f.p.s. and have the AI fill in the other 45 frames, to achieve a 60 f.p.s. look with just 25% of the labor?
The answer, stunningly, is yes:
Enter a caption (optional)
Link to download DAIN (for free).
Link to the source code.
Links to LegoEddy's Apollo 11 movie, both original and interpolated.
I’m a lapsed industrial designer. I was born in NYC and figured I’d die there, but a few years ago I abandoned New York to live on a farm in the countryside with my wife. We have six dogs.
Create a Core77 Account
Already have an account? Sign In
By creating a Core77 account you confirm that you accept the Terms of Use
Please enter your email and we will send an email to reset your password.
Turn Stop-Motion Footage Into Smooth Video Using AI Frame Interpolation
I don't know much about this but watching the clip you see the astronauts hand disappear for a couple frames as he's about to wave. But what a great technology!