The rescue I volunteer at won't let puppies go until they are twelve weeks and have had their second shots. Some rescues keep them longer.
I personally prefer older pups. Easier to housebreak.
I've been visiting my puppy several times a week at the rescue and we have bonded so I don't feel like I've missed out on anything.