Does AuthSMTP work with SMIME - S/MIME?

Yes - S/MIME (Secure / Multipurpose Internet Mail Extensions) is a method for public key signing and encryption of e-mail messages.

AuthSMTP does not change the 'body' of the email message - so an email signing / encryption system that signs or encodes the 'body' of the message should work correctly.