If a man, especially a Muslim, has several wives or sexual partners living in his house, they can be referred to as his harem.

A harem is a part of a building where a harem lives.