Device-to-Device (D2D) communication is considered as one of the key technologies for the fifth generation wireless communication system (5G) due to certain benefits provided, e.g. traffic offload and low end-to-end latency. A D2D link can reuse resource of a cellular user for its own transmission, while mutual interference in between these two links is introduced. In this paper, we propose a smart radio resource management (RRM) algorithm which enables D2D communication to reuse cellular resource, by taking into account of context information. Besides, signaling schemes with high efficiency are also given in this work to enable the proposed RRM algorithm. Simulation results demonstrate the performance improvement of the proposed scheme in terms of the overall cell capacity.