Teaching effect evaluation is the key to deepen the teaching reform and improve the teaching quality of music course. In order to improve the teaching level of music course and realize the rapid popularization of music teaching in colleges and universities, the evaluation method of music teaching effect is studied. According to the application principle of the deep learning algorithm, the artificial neural network is constructed and the relevant learning indexes are combined to solve the Sofhnax regression condition. Based on this, the evaluation system model is perfected and the evaluation network based on deep learning is constructed. Determine the characteristics of music curriculum teaching evaluation and the scope of the teaching object. Through the statistics of the target elements, the evaluation mode is verified and evaluated, and the design of the evaluation method of music teaching effect based on deep learning is completed. The experimental results show that the cognitive load level of music teaching is promoted to 3.5 efficiency values under the effect of deep learning algorithm. In promoting the development of music teaching in colleges and universities can play an obvious role in promoting the impact.