Sorry, all I can say is you are not alone anyways. I too used my free GV number for over two years as my only home phone line for over two years, southwest Washington State. Then in January 2015 downstream people began complaining the call quality was horrible, even though I could hear them fine from my end.
I asked for help in the thread "choppy downstream call quality". My internet service speed had not changed, I tried moving the phone base away from the router, changed to a brand new phoneset, tried a hardwired old phone, all with no improvement.
I finally resorted to using an Anveo phone number to call out, and immediately downstream people could hear me fine. But I've lost the wonderful full GV phone history on those Anveo outgoing calls.
One piece of advise from Obi tech was to delete Google Voice, and then re-register for GV again. I did not try that as I am not super tech savy, and I was a bit worried I might lose the GV number.