Sounds like fleas, the dirt looking 'stuff' is probably flea poop. If you can get a bit of it off but it on a white surface and then add a drop of water. If it's flea poop it'll be red since flea poop is really just blood
Do you have Advantage or those types of flea prevention options?

Do you have Advantage or those types of flea prevention options?