Rheological behaviors are widely recognized to be induced by the existence of pre-loading conditions, which should be considered in the constitutive models. In this paper, a fractional-order model is proposed to characterize pre-loading dependent rheological behaviors. The loading-dependent fractional order can be physically interpreted by the master curve and modeled by a power law function. The power-law criterion between material parameter and initial loading is also constructed. Experimental data are employed to validate the effectiveness and predictive abilities of the model. Simulation and prediction results reveal that the proposed model effectively describes initial loading-dependent creep and relaxation responses.