Even after you've blocked spammers from sending spam directly to your server's IP, make sure you close these holes that allow spam to get around the filter.
To get around your spam filter, spammers that have cached your server's IP address or mail server's host name will ignore your domain's current MX records and try to send directly to your mail server.