We are be investigating a heterogeneous platform for deep learning in which GPUs are applied for training and FPGAs are initially used for inference, and later on will be adapted for training with customizable data types. Ultimately, we will be looking at how to utilize both GPUs and FPGAs for training and inference in a tightly coupled system.