You really ought to try it. I'm looking forward to it a great deal. My daughter lives in Washington DC, she almost never fishes and doesn't hunt, but she loves going to the Steam Plant with me when she comes home at Christmas time.
If the main lake temps get into the 40's it should be good. The temps at the plant while generating is usually mid to upper 50's. A ten or more degree differential is needed to really turn things on. The best fishing I've had is when it was snowing.
Poor substitute for ice fishing, but it will have to do.