Answer: Innocent/innocence.
A house with two occupants, sometimes one, rarely three. Break the walls, eat the boarders, then throw away me. What am I?