We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Web pages from mockup design based on convolutional neural network and class activation mapping.
- Authors
Cizotto, André Armstrong Janino; de Souza, Rodrigo Clemente Thom; Mariani, Viviana Cocco; dos Santos Coelho, Leandro
- Abstract
The objective of this study is to validate the use of Deep Neural Networks (DNNs) to segment and classify web elements. To achieve this, a dataset of 2200 images was created through screenshots of real web pages, with 10 distinct classes to represent the most common web elements. The contributions of this study encompass the validation of classification-only Convolutional Neural Networks (CNNs) with the support of Class Activation Mapping (CAM), a weakly-supervised semantic segmentation technique that requires no in-image annotation, significantly simplifying the dataset creation process when compared to traditional segmentation models. Multiple networks with distinct hyper-parameter combinations were cross-validated with 10 folds, with a final accuracy rating of 95.71% on the best-performing model. Although the final CNN showed promising results, further improvements on the dataset and architecture are still required for it to be employed as the centerpiece of a real-time dynamic web page building solution, with clear improvements needed on the clarity of the segmentation heatmap.
- Publication
Multimedia Tools & Applications, 2023, Vol 82, Issue 25, p38771
- ISSN
1380-7501
- Publication type
Article
- DOI
10.1007/s11042-023-15108-3