DeepWarp: Gaze Manipulation
Continuing our infinite series on things you can do with neural nets, DeepWarp is a research project that can change which way the eyes in a photograph are looking. This is more than just tweaking the iris and pupil: because it learned what moving eyes look like from being trained on photographs of real eyes, it also knows how to change the eyelids and the subtle muscle changes around the eyes.
I’d like to see what this could do for game characters, of the old-school character-portrait-in-the-interface type, like Dungeon Master and Doom. Paint a bunch of character portraits, hook them up to a facial-expression generator, and have a wide variety of emoting to react to what happens in the game.
