Provided you are level headed, I think you run far higher risks of crashing on the road when you start to enjoy the speeds these things are made for.
I've been riding just over 30 years on the road and did my first track day in 96.
In that time I've had 2 decent size road accidents, 1 my fault in which poor obs of gravel in the road caused a high side, and 1 caused by some myopic .... pulling out of a T junction without looking. I must have over 60 trackdays under my belt, the majority in the last 5 years, but have never crashed on track.
Towards the end of this season I finally moved up into the fastest group and am still feeling well within my comfort zone. Sure it can go pear shaped or someone else can take me out, but the track is where to really enjoy these things safely. The roads are far too unpredictable these days and general driving standards are atrocious.