/ Machine Learning

Photorealistic drawings from simple sketches using NVIDIA's GauGAN

Photorealistic drawings from simple sketches using NVIDIA's GauGAN

SmartSketch

Supercharge your creativity with state of the art image synthesis.

Set Up

  • You'll need to install the pretrained generator model for the COCO dataset into checkpoints/coco_pretrained/. Instructions for this can be found on the nvlabs/spade repo.

  • Make sure you need to install all the Python requirements using pip3 install -r requirements.txt. Once you do this, you should be able to run the server using python3 server.py. It will run it on 0.0.0.0 on port 80. Unfortunately these are hardcoded into the server and right now you cannot pass CLI arguments to the server to specify the port and host, as the PyTorch stuff also reads from the command line (will fix this soon).

TODOS

  • [ ] Change how we run the model, make it easier to use (don't use their options object)
  • [ ] Make a seperate frontend server and a backend server (for scaling)
  • [ ] Try to containerize at least the bacckend components

GitHub