I have a 2DR, and there have been more times that I would like to admit, that I wish I had just gotten the 4DR instead. The ease of getting things/people/dogs/etc into the back of a 4DR is a huge bonus. Not to mention the added cargo capacity, and the towing capacity to boot. Plus, if you want to do a long, multiday trip, pull out the back seats and sleep in the 4DR. (I tried in the 2DR, and it just doesn't work). I have wheeled with both 2DR and 4DRs on the trail, and the only major difference is navigating tight sections. Yes the 2DR excels here, however, if it is not a dedicated trail rig, then the added ride comfort and space will make up for having to do a few extra maneuvers to get around.
I would never let my wife know that I have 2DR regrets, as she jumped through hoops to pick up the 2DR for me while I was away, but, I should have held out a little longer for the extra doors.