I can actually honestly say I've only even come off once - but I was about 9 and sneakily nipping over the fence to ride a young chestnut over the other side of the village from my house

...
... so it was unbroken and I had neither saddle or bridle... but it was fine until some rabbit bolted out of a hedge under his feet.