I've only ever done trackdays in the wet. It's brilliant as it slows down the rich folk on 1198s so you can get them round the outside!
Unless your tyres are near dead, I wouldn't be fussed about switching them. Tyres won't wear so much if its wet.
Entirely up to you though of course, only you know what your tyres are like!