Get Me if You Can

A house with two occupants, sometimes one, rarely three.

Break the walls, eat the boarders, then throw away me.

What am I?

Check Braingle.com for the answer.