This study combines two useful methods in recognition: consensus or voting-based approaches and moment-based representations. Matches between image patches are generated using a Gaussian-weighted moment encoding of the patches and a feature indexing process. Each match implies an object 3D position and orientation (pose) and generates a vote for this pose. Recognition is accomplished by detecting significant clusters of votes in pose space. This combined method is an improvement over voting and moment methods in isolation. Using image brightness moments, the idea is demonstrated on examples of human faces undergoing full 3D pose change, as well as changes in features such as talking and blinking. The idea is then extended to moments of local texture orientation and successfully demonstrated under large variations in lighting nature and geometry.