I'm not a breeder - no experience at all.
But as a puppy buyer I would not want to take my pup home at 4 weeks. All pups grow fast but they need to be with the mother IMO for development and health reasons. I don't know why that would be different for a singleton?
7-8 weeks is a good time to go home. Good luck.