Install storm or thermal (replacement) windows. These tightly fitting windows give the benefit of double-pane glass. Air trapped between the two panes acts as a thermal insulator, keeping your heated air inside where it belongs. Be sure to get windows that have the new super-efficient, low-emissivity glazing.