Although TiB2 particles improve the wear resistance and hardness of in situ TiB2/Al composites, TiB2 particles bring challenges for machining TiB2/Al composites. In order to study the difference between the cutting performance of aluminum alloys and TiB2/Al composites, the milling experiment of 2024 aluminum alloys, 7075 aluminum alloys, TiB2/2024 composites, and TiB2/7075 composites was conducted. The cutting specific energy, the milling force coefficient, and machined surface roughness are analyzed. The results show that the cutting specific energy and cutting force coefficient of TiB2/Al composites are higher than those of the conventional aluminum alloys. In addition, the machined surface profile and its spectrum are analyzed. The results indicate tool vibration is the main reason for the abnormal high surface roughness, especially for conventional aluminum alloys. The cutting stability of TiB2/Al composites is better than that of conventional aluminum alloys. TiB2 particles hinder the plastic deformation of the matrix alloy, reducing the tool feed marks, which makes the surface roughness of TiB2/Al composites lower.