"No" Is going to become just noise if that is all he hears.
Humans talk too much.
Keep him leashed or tethered, do scheduled naps in the crate, get him an expen with toys he can have, and keep the times when he's with you enjoyable and fun.
I recommend this lady to all new puppy owners. She uses a gentle and very effective approach.
She has a very good and short book on Amazon.
Oh, and I would recommend Patricia McConnell's books too. Dogs hate head pats. As a matter fact, giving a head pat is a good way to get your dog to leave.