Here are some pictures of water heater and pipe insulation. It takes almost no time to set this stuff up, and anything using duct tape is fun.
For gas water heaters make sure insulation is not too close to too the pilot light or any other open flame, and leave access to the thermostat.