I grew up with an I/O and spent many hours driving it. The first boat I bought, many years later, was a Yamaha 2011 SX210, which we kept for 5 years. In 2016, we bought a v drive MB Sports F22. Frankly, I think all of the talk about this boat or that boat being easier/harder to drive really just comes down to lack of familiarity. Each setup has different characteristics that you have to get used to. There's a learning curve. Once you get through that curve, it's fine. For me, personally, the handling trait I didn't really appreciate about my SX210 was the general lack of natural tracking - it required pretty constant input at the helm to maintain a tight course at any speed. At idle speeds, that is more pronounced. It isn't hard to deal with, just maintain constant attention and input at the helm. At higher speeds, crossing wakes and rollers requires significant steering input to stay on course. Again, it is easily dealt with most of the time but can be alarming to inexperienced operators. On the upside, maneuverability is second to none. Being able to pull the stern in really close to shore without risk of grounding is also a really nice feature. On mine, the handling wasn't really what drove me away - the noise was. Running at 6K - 7K rpm all the time in a boat with minimal sound insulation and an inherently noisy drive & exhaust system just wore on me. I understand the newer boats have dealt with that issue signficantly.
I absolutely LOVE my v drive. It tracks like it is on rails at any speed, is quieter (and the noise it makes is more pleasant to my ears), rides more smoothly than my SX, and is of course amazing for watersports. 5000 pounds of ballast from the factory on top of a boat that already weighs about 5000 pounds ready for the water has a way of helping throw a pretty nice surf wave! The V drive results in the prop being way under the boat so the chance of it accidentally hitting somebody is probably less than on an I/O. It, too, has some drawbacks, though. It has taken me 2 years to figure out how to go backwards without always pulling to starboard. With a very expensive prop and rudder hanging down beneath the boat, I have to stay in deeper water and can't comfortably pull the stern in close to the shore. The boat was more than 2X as expensive as my Yamaha...but Yamaha's keep getting more and more expensive too.
In short, I'd recommend a jet to anybody who boats in fresh water with minimal floating debris who is looking for a great all-around boat that requires minimal (and pretty easy) maintenance. If a particular activity - fishing, surfing, wakeboarding, etc. - is a big part of the reason for your boating, I'd suggest getting something that is designed with that activity as a primary design priority.