The other thing it maybe is the backlash on the crownwheel to pinion gear this would be why when you change gears the pressure is reduced and as you let the clutch back out it has to take up the slack on the two gears. No it doesnt nesecarily mean a rebuild but will need to be removed and adjusted any reasonable mechanic should be able to do it and should only cost about $50.
Cheers nev