Presentation
Unified Agile Accuracy Assessment in Computing-in-Memory Neural Accelerators by Layerwise Dynamical Isometry
DescriptionDeploying neural networks (NN) on computing-in-memory (CIM) neural accelerators incurs additional hardware factors in the test accuracy, which add substantial extra evaluation overhead. This work takes the first step to quantitatively analyze how information propagates in CIM neural accelerators as well as how additional CIM factors influence that information propagation. From our analysis, we propose a new metric called Unified-QCN that is theoretically linked to the test accuracy according to layerwise dynamical isometry, providing us with a compass to avoid direct time-consuming simulations. Our method consistently delivers high correlations with the test accuracy for various NN backbones on different datasets.
Event Type
Research Manuscript
TimeWednesday, July 12th2:10pm - 2:25pm PDT
Location3003, 3rd Floor
Design
AI/ML System and Platform Design