I went from a 50cc scooter to 750cc inline-4 bike.
Been riding it four years now, and *knocks on wood* never crashed. And believe me I've travelled with it. England, Belgium, Germany, Switzerland, Italy... the Alps!
It doesn't depend on the bike, IMO, it depends on the rider.
Ride it sensibly, calmly, get used to it, respect it, don't act like a fool, don't do wheelies, don't do stoppies, don't do burnouts. If you respect that you won't have a problem.
When I say ride sensibly I also mean it. Stay on low revs at all times. Respect the speed limit. Check your mirrors. Respect other drivers/riders. Don't do traffic filtering or lane splitting for a while, and when you start doing it, do it at a very slow pace first. Wear good gear. Don't go out under too harsh conditions (heavy rain, fog, snow, low temperatures) as they WILL affect your concentration and skills. etc. Keep reminding yourself of that. And ever so slowly ride it a tiny bit harder as *months* go by.
It's a question of how capable you are of controlling yourself.
But then - is there a real point in getting anything bigger than a 650 if you're going to ride it like I said above ? That's for you to decide.