Neural Photo Editor

I’ve been talking about future artistic tools for a while. Here’s one example of how it might work.

This Neural Photo Editor takes a neural network trained on a dataset of celebrity faces and gives you an interface to edit the displayed image. By painting colors, you can shift the output in the direction you want.

It has its limitations, but it points a way towards a future toolset for image editing. Retouching portraits will probably come first, since that’s a nice restricted dataset, but you could train it on any kind of image. Imagine editing a landscape painting with a tool like this, or quickly enhancing your concept sketches. Or interactively controlling a style transfer on your photos.

It also illustrates flexibility: while some of the images generated aren’t very coherent, most of them are. Having an easy way to explore a mostly valid image-space is a very powerful tool. The low resolution is the biggest barrier to having this be usable right now, and that will be overcome soon enough.

https://github.com/ajbrock/Neural-Photo-Editor