Yes you should use that as the server.
owa.domain.com, the owa part stands for "outlook web access". Exchange does not have to be configured to use the url owa.domain.com, it can be configured to use mail.domain.com, but if you can access you email via that link, then you are using OWA, and that is your OWA server.