The biggest issue IMHO is the small but very vocal anti cycling lobby who inhabit the Porty People FB page in particular. I honestly would not be surprised if they formed a vigilante group and attacked cyclists or damaged parked bikes!
I've been a 'local' for over 20 years and ride or walk the prom almost daily. I often see inconsiderate riding but can't recall one single instance that I'd consider 'dangerous'
By and large, folk mix well and get on. For every inconsiderate cyclist I see however, I see more inconsiderate pet owners, and even more parents who let their children wander aimlessly on a mixed use path.
A few signs reminding cyclists that the prom gets exceptionally busy on 'nice' days so an alternative route might be better and that on quieter days dog and child walkers should be aware cyclists might be going quicker than they expect, would not go amiss.