We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Performance–energy trade-offs of deep learning convolution algorithms on ARM processors.
- Authors
Dolz, Manuel F.; Barrachina, Sergio; Martínez, Héctor; Castelló, Adrián; Maciá, Antonio; Fabregat, Germán; Tomás, Andrés E.
- Abstract
In this work, we assess the performance and energy efficiency of high-performance codes for the convolution operator, based on the direct, explicit/implicit lowering and Winograd algorithms used for deep learning (DL) inference on a series of ARM-based processor architectures. Specifically, we evaluate the NVIDIA Denver2 and Carmel processors, as well as the ARM Cortex-A57 and Cortex-A78AE CPUs as part of a recent set of NVIDIA Jetson platforms. The performance–energy evaluation is carried out using the ResNet-50 v1.5 convolutional neural network (CNN) on varying configurations of convolution algorithms, number of threads/cores, and operating frequencies on the tested processor cores. The results demonstrate that the best throughput is obtained on all platforms with the Winograd convolution operator running on all the cores at their highest frequency. However, if the goal is to reduce the energy footprint, there is no rule of thumb for the optimal configuration.
- Subjects
MACHINE learning; ARM microprocessors; DEEP learning; CONVOLUTIONAL neural networks; CONVOLUTION codes
- Publication
Journal of Supercomputing, 2023, Vol 79, Issue 9, p9819
- ISSN
0920-8542
- Publication type
Article
- DOI
10.1007/s11227-023-05050-4