The recently proposed Reinforced Multicategory Support Vector Machine (RMSVM) has been proven to have desirable theoretical properties as well as competitive numerical accuracy for multi-class classification problems. Currently solving the RMSVM is based on a grid search approach for selecting the tuning parameter