" Both mates I usually race with are alot faster but have both trashed their bikes." and " I've not come off yet"
I think unless you have deep pockets and have a constitution of super man I think you are doing well. So will going faster and trashing your bike make it more enjoyable?
Like with most things I think its learning the theory and just down to the ability to apply it. It might just take a while longer for the application.
I have no problems going slow and know what happens when I try and go fast
But then again I go slow with a smile on my face