What kind of batteries are they? If they're lead acid, you don't want them outside in below freezing temperatures. Best practice is to remove them and bring them inside.
I'm not 100% certain about AGM, so I won't pretend to know.
Lithium will be ok outside, but expect them to go in to "sleep mode" if they aren't used for a long period - depending on the particular battery and the BMS.