Improve web-deployment scripting and pipeline

Currently, the deployment script and pipeline aren't trivial to understand - they make some assumption about how what files are important for the website, do some artifact handling but also implicitly use other stuff. 

Clarify this and make it more generic