There's a ride planned for Sunday.
http://www.meetup.com/Bromptonites/calendar/14611722
I assume other sorts of bike are allowed(?)
I was there earlier this year and it really is a great place to ride. Good views and not too hilly.
As most people live in Rothesay there is surprisingly little traffic on the island.
And you get to visit Wemyss Bay Station.