Do blackout curtains actually insulate a room?

Yes, noticeably. Heavy blackout curtains create a still air pocket against the window, which is one of the main ways heat is lost in winter and gained in summer. Department of Energy estimates suggest thermal curtains can reduce heat loss through windows by 25% or more. You will feel the difference most on drafty old single pane windows.