One thing you can do is unjar the javamail  api, and
again package em up, in your final application  jar
file.
But checkout licensing issues.

Second one is place the mail.jar and activation.jar in
the lib folder and use some kind of installshield to
install your application.

There is a posibility of remotely downloading the jar
files, i,e. java  extension framework.