Yes, as long as the rifle is rimfire (or shotgun with size T shot or smaller).
It is closed to centerfire rifles in archery and muzzleloader seasons. It is open to centerfire during the gun season for legal big game hunters (big game gun license and blaze orange).