get a doggie backpack and let him carry stuff, but I dont know why you feel the need to bring a (what looks like) a 6" knife, I would safely say that if your dog doesnt ward off someone or something that may hurt you guys the mace sure would.
Have you thought about a self defence course? I live in an area that is about a 60 minute walk from 'the badlands' so while my area is considered a good area to live...things do happen. I wouldn't carry a knife because it is far too easy for someone to take it from me and use it against me...but that is just me.
My husband taught me a few self defense moves but I do want to get into a class it's one of my long to do list
I live in a bad neighborhood there are freaks everywhere and I believe that taking weapons is being more cautious, of course every attacker wishes that women be weapon free, that would be ideal for them. You have no idea how many stories I heard how a knife saved a life... Not from women though because they are too afraid of weapons
I know you asked for suggestions that are not a purse. I find a purse annoying to walk with, but I bought this bag, which is really convenient because I don't have to hold it or keep it up on my shoulder. I put treats in the front pouch, my personal things are zipped inside, and poop bags are in the other pouch.
Eventually I'll want to run with my pup.. they have a back pack that holds two water bottles (one for you, one for your buddy) and other personal items like your phone. That's pretty much all I'll be taking with me.
I have Ruffwear packs for the dogs, Halo's is an Approach, Keefer's is a Palisades. I only use them on longer hikes though, where we need a lot of water - I use a 1 liter Platypus bottle in each side. Otherwise I have a fanny pack with two water bottles, like this one (same brand, but I'm not sure if this is the exact model as mine): Mountainsmith Buzz TLS
The pack is very small, just big enough for a collapsible water dish, my keys, and a few small items. I usually toss my cell phone into my treat bag, so it's readily accessible, because I use a program to track our distance. If it's really hot I'll wear the fanny pack rather than put a pack on the dog, especially Keefer, who doesn't do as well in hot weather as is also older.
For a quick after work hike (3-4 miles) I usually just put my keys and license in my pockets and don't even bother with water unless it's hot.
In the summer I wear a cargo vest or a waist pack and for the winter/rain season I designed and sewed a coat with similar pockets.
Thank goodness we don't need weapons here on the trails. WD is enough to make me feel safe.
On normal walks... just Zoey and I and of course the leash lol
On hikes.... Backpack with my DSLR camera, 2 water bottles, a couple of yummy treats, 30 foot leash and towel if we want to take a swim, poop bags.. anddd uhmmmm i think thats it.