We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
An Energy-efficient and Accuracy-adjustable bfloat16 Multiplier.
- Authors
Pilipović, Ratko; Bulić, Patricio; Lotrič, Uroš
- Abstract
The approximate multipliers have been extensively used in neural network inference, but due to the relatively large error, they have yet to be successfully deployed in neural network learning. Recently, the bfloat16 format has emerged as a viable number representation for neural networks. This paper proposes a novel approximate bfloat16 multiplier with on-the-fly adjustable accuracy for energy-efficient learning in deep neural networks. The size of the proposed multiplier is only 62% of the size of the exact bfloat16 multiplier. Furthermore, its energy footprint is up to five times smaller than the footprint of the exact bfloat16 multiplier. We demonstrate the advantages of the proposed multiplier in deep neural network learning, where we successfully train the ResNet-20 network on the CIFAR-10 dataset from scratch.
- Subjects
ENERGY consumption; ANALOG multipliers; DEEP learning; DATA encryption; ACCURACY
- Publication
Informacije MIDEM: Journal of Microelectronics, Electronic Components & Materials, 2023, Vol 53, Issue 2, p79
- ISSN
0352-9045
- Publication type
Article
- DOI
10.33180/InfMIDEM2023.203