To mitigate inter-carrier interference due to large carrier frequency offset (CFO) in an uplink single-carrier frequency division multiple access (SC-FDMA) system, a three-tap adaptive frequency-domain decision feedback equalizer (AFD-DFE) is designed in this paper. Our design exploits the banded and sparse structure of the equivalent channel matrix. The block recursive least squares (RLS) algorithm is used to adapt the AFD-DFE. Consequently, by exploiting the matrix structure in the frequency-domain, the complexity of the block RLS is reduced substantially when compared to its time-domain counterpart. In addition, the design is extended to space-frequency block coded (SFBC) SC-FDMA systems. We show that our proposed AFD-DFE exhibits significant performance improvement when compared to a one-tap AFD-DFE while still enjoying a low computational complexity.