@charleeboy Put an ice pack in a dry bag, to keep your normal diaper bag cool for 90% of trips. If you are staying longer just make as needed (which it sounds like you do).
I wouldn’t want to go full pack mule with a diaper bag, and a cooler, and a baby if at all avoidable.