Can I also heat the living area with my Truma Combi heater if it is not filled with water?

Yes. The Combi heater may be used in pure heating mode even with an empty water container.