We give a brief review of some ideas in averaging methods for analysing adaptive algorithms. The 3 types of first order averaging result are described and a mention is given as to how averaging can be used to get second order results in particular perturbation expansions for invariant measures.