It depends on what your puppy is like. Kylie has yet to destroy any of her toys, even the plush toys. I still prefer to only put things like hoofs and bones in her crate. Occasionally I put a loaded Kong in with her.
Kylie is death on mechanical pencils. She's not supposed to get those, but she has destroyed 5-6 of them since we got her 2 months ago.