I didn't get this issue resolved. I ended up mass editing devices and hand-picking one particular profile that i thought would work.
I think that my issue may have been related to the fact our connection profiles were set to use SNMP for config transfer instead of SSH. I think the login test would work since SSH worked and then actual transfer would fail.