As far as I can tell Krushchev was removed from office because of his erratic policies, and specifically their failures, but did his role in Stalin's purges also play a part in his removal?
From my understanding of Soviet history, it is unlikely that his role in Stalinist purges played any role in his removal. Few of the individuals who ran afoul of the Great Purges in the 1930's returned to political power (or an active social life/living life). At least not those who were implicated enough so as to hold a grudge. Additionally given the scope and chaos of the purges in the late 30's even a high ranking official like Krushchev had little control over the program and was himself a potential target. Krushchev ran a greater risk of offending the old Stalinist guard during his "secret speech" in the 20th congress denouncing Stalin.
Although, neither does the aforementioned speech or the Stalinist minority appear to be the motivation of the Brezhnev conspiracy. The conspirators were far more interested in furthering their political power for the sake of personal gain as opposed to an ideological objective, and neither the purges or Stalin seemed to play pivotal roles in their motivations. There is a good description of the heightened corruption of the nomenklatura in Moshe Lewin's "The Soviet Century" and it is a good general history of the Soviet Union, particularly in terms of political history.