Does this work?
RewriteEngine onRewriteRule ^sitemap\.php$ /sitemap.xml [R,L]RewriteRule ^sitemap\.xml$ sitemap.php [NC,END]
It blocks the file from being visited and sends a 403 forbidden to the client. I am not 100% sure if it works with the other rewriterule, but just try it and let me know.