The arthritis is probably caused by bone grinding against bone. In humans, the docs can inject artificial synovial fluid directly into the joint & it often brings great relief. Don't know if they do it in dogs.
Be sure not to let him get overweight. I would definitely try the glucosamine.
Let your vet be your guide as to his activity level & if surgery is an option in your case.