It's come to my attention that Google's alternate, non-ssl requiring server now only sends messages to accounts that google hosts (ie. gmail and hosted domains only).

If you do not use stunnel or a similar SSL-wrapping service, then your direct messages through aspmx.l.google.com will not be delivered unless the recipient happens to live in the google-verse.