I have a 1442 with a 15 hp mercury 4-stroke
I don't duck hunt in it much, but when I do it has always been cruising at slow/moderate speeds through flooded timber, so speed was never really important. If that was going to be your situation, I'd say "don't bother upgrading".
If you think you are going to hunt rivers at all, I would check on the average river flowing speed for the areas you are in and make sure that the extra horsepower wouldn't make a significant difference in your *actual* travel speed. If you are only going up-river at 5 MPH with a loaded-down boat, an extra 2-3 MPH is a giant boost!
The last factor that I consider is weight... A 4-stroke 15-hp weighs around 100 lbs and is not very easy to handle solo due to the weight distribution, so if you think you might ever want to pull your motor off with any regularity, that might also be a consideration (although you might be a big dude who can do it with less problems than me). Obviously the 20 hp is heavier. There are a few times I wish I could just snap my fingers and take the motor off of mine, as I could put a trolling motor on the back and get into some really, really skinny water for hunting and fishing, but it's just not worth the trouble to move it back and forth most of the time.
Whatever you pick, make sure it has the shallow water drive tilt-up. Electronic trim adjustment is also very, very nice (I wish I had it). With smaller motors, that attribute is less important. It's rough picking a heavy motor up manually to tilt it while wearing lots of clothes or being stuck on a log...