When Does Deep Learning Work Better Than SVMs or Random Forests®? Some advice on when a deep neural network may or may not outperform Support Vector Machines or Random Forests. If we tackle a supervised learning problem, my advice is to start with the simplest hypothesis space first. I.e., try a linear model such as logistic regression. If this doesn't work "well" (i.e., it doesn't meet our expect