To enhance the expression ability of deep features and improve the tracking performance of the fully convolutional siamese network (SiamFC) in the UAV scene, we propose a UAV visual tracking algorithm based on feature fusion of the attention mechanism. By designing the local perception attention module and the global perception attention module to enhance the features extracted from the backbone network, a set of complementary local enhanced features and global enhanced features are obtained. And then, the tracking response map fused with the two features is then located, which effectively improves the tracking robustness of SiamFC in the UAV scene. The algorithm and nine other related algorithms such as SiamFC are tested on the DTB70 dataset. The experiments show that the algorithm has a good tracking performance and can adapt to the visual object tracking task in the UAV scene.