The wheels have EVERYTHING to do with the ride. And more...
I'd gauge the purchase more on the roads in your area, or where you intend to drive the vehicle. Short wall tires are a problem where I live due to very poor roads. We traded in a vehicle with large wheels and short side-wall tires, and was very pleased to do so. We had to pay once for replacement of the suspension, wheel and new tire on that old vehicle because of a pot hole. Hitting the hole at only 15 MPH caused damage to the tire, wheel and suspension. The repair guy said if we had the normal wheels and tires then we would not have had this problem.
And, yes, the ride is different. Much smoother and more forgiving with smaller wheels and normal side walls. Personally I like the looks of the larger wheels, but I've come to the conclusion the ride quality loss and risk of damage is not worth it.
If you don't mind a rougher ride (and better cornering BTW..) and your roads are good, then go with the larger rims.