Splitting CNN for better efficiency

- split CNNs into tiles across GPUs, less memory on/offloading
- costs in quality of model, changes semantics
- mitigate with stochastic splitting, regularizes data
- some scheduling to see where cost of splitting vs time of offloading

"Split-CNN: Splitting Window-based Operations in Convolutional Neural Networks for Memory System Optimization"

Sign in to participate in the conversation

The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!