Phishing is a common cybercrime that tempts a target to reveal personal and financial information by imitating a legitimate webpage. Classical techniques, such as list-based, and heuristic approaches have focused on identifying the uniform resource locator (URL). However, cybercriminals have uncovered several methods to evade URL-based techniques. Recently, researchers have started developing techniques that are based on visual similarity to detect phishing webpages. However, using visual similarity raises several computer vision-related issues such as webpage segmentation and feature extraction. Deep learning provides a suitable solution to these issues as it integrates feature extraction, feature selection, and classification in an end-to-end system. We have made the first attempt to detect phishing webpages based on visual similarity by modifying and retraining deep neural networks. A comprehensive evaluation on two publicly available databases has shown a marked improvement of around 7% classification accuracy.