Quantitative perturbative study of convergence to equilibrium for collisional kinetic models in the torus