I agree with ther above comments, however you have to be sensible with the changedown. Extreme example: Going from 6th at 70mph straight into 2nd, don't think you'll get it into 1st, and you bend the valves and possibly see your pistons at very close hand.
But especially in the manner you describe lylej, not a problem engine wise IMO.