Yep, wean off the treats.
Start by hiding them, then by keeping them within easy reach but not on your person (for example, in a jar on a shelf where you can run over and grab one to reward your dog for a performance well done). Markers, like clicks or verbal markers, indicate to your dog when a treat is coming, which buys you a little time to run over and grab the treat without confusing your dog about what exactly is earning the reward.
At the same time, build up alternate rewards: tug, ball tosses, a cued "jump for joy," tag with your hands, or whatever else your puppy enjoys. Some dogs take to this right away (and even prefer toys or play over food treats), while others need some practice and encouragement to think of play as fun. It's okay if your puppy doesn't go nuts for tug or tag right away -- just play and practice in short, lighthearted little sessions to build up your puppy's enjoyment. Then, when your dog is clearly enjoying them, use those as occasional reinforcers instead of treats.
ARCHMX TDCH Pongu the Insane, CD-C, RE, RL1X6, RL2X5, RL3X2 (GSD mix, b. Apr 2010)
Crookytail the Tigerwuff, RL1, ITD (Akita mix, b. Jan 2011)