Thanks, Taoman. I should have added that information. As long as the AT&T number is currently active (the customer is paying for service), then LNP rules require AT&T to allow it to be ported out. However...
In this case, re-reading the original post, the description of he issue is too vague to understand the actual root cause.
The OP describes trying to port from an AT&T landline to a T-Mobile account, so no GV yet. What, exactly, in detail, did AT&T say (why did they supposedly claim it couldn't be ported). For all we know, this is a disconnected number or the OP didn't pay their bills, in which case, it's not portable.
The OP didn't describe any steps actually taken to port it into T-Mobile, so we have no idea what's even been attempted.
CFTang: does this AT&T landline number currently work (do you have working, paid service on the line)? If so, it should be portable. You'll need to work with T-Mobile to port it in. It is the responsibility of the gaining carrier (T-Mobile) to request that AT&T port in the number. All you need to do is to give T-Mobile permission to act on your behalf as your agent, and, if necessary, to tell AT&T to remove their carrier lock or freeze if one is present.
None of this is dependent yet on Google Voice, although Taoman's test will tell you if it's worth fighting over it.