On the Build Web Site screen, put ".html" after the package name, e.g.: use "MySite.html" rather than just "MySite", and it will build with .html extensions (actually, you can use this to give the files any extension you want).

There is one caveat, the .html extension is not remembered - the next time you build the site, you'll have to add ".html" to the package name again.