In emergent scenarios, such as firefighting, the rescuer can be guided to the trapped person efficiently with the knowledge of relative positional relationship. In this paper, we presented a body motion assisted indoor geolocation system using time-of-arrival (TOA) and received-signal-strength (RSS) values of ultra-wide-band (UWB) signal, in which the human body acts as a single reference point. Measurements of TOA and RSS of UWB signal with different settings have been conducted in typical indoor environment. It has been proved that, as the human body rotates, TOA reaches its peak and RSS goes to the valley when the person faces back to the target. Furthermore, theoretical lower bound of the proposed system was derived to investigate the theoretical system limits for direction estimation, with the knowledge of UWB-based ranging estimation and signal strength measurements. In addition to confirm and comprehensively understand the theoretical lower bound, numerical simulation results are provided.