I'd take it up as soon as a piece came off. Those pieces get in the right configuration in the GI tract and could cause a block. Why just not leave him in the yard alone?