Text this: Spectral domain convolutional neural network optimized for computational workload and memory access cost