Rutherford's experiments use energies of about 5.5 MeV which gives the distance of closest approach of 4.0 x 10^-14 m. 

What happens if the energies of higher than this magnitude are used in the experiment?

distance of closest approach will be smaller

The distance of closest approach will be smaller because the scattering will then be affected by the nuclear forces which will then come into affect.