From the perspective of the tactile comfort of underwear fabrics, 179 kinds of underwear fabrics were selected to test tactile related performance indices using the fabric touch tester (FTT), and the relationship between physical indicators and tactile sensation of different fiber types of underwear fabrics was studied to establish a digital regression model by a stepwise regression method. The experimental results show that fabric fiber composition, compression characteristics, surface friction coefficient, surface roughness amplitude, bending characteristics, and maximum thermal conductivity significantly affect the level of tactile comfort of underwear fabrics, the composition of underwear fabrics has a significant effect on soft touch, and the clustering method and the grading method can effectively rate the level of tactile comfort of underwear fabrics.