Sending mails with PHP and being blocked by Google

Mails sent by my PHP script were blocked by Google, and here is why.