I followed the guide from https://github.com/diafygi/letsencrypt-nosudo
so that I don’t have to trust the letsencrypt script that requires root access.
One caveat is that you need to read through the script from diafygi, or trust it 🙂
Then, I transferred the signed certificate, and the domain private key to the server, and configured my site like this:
ServerName www.hestben.se
ServerAlias hestben.se
ServerAdmin address@to.webmaster
DocumentRoot /var/www/website/
SSLEngine on
SSLCertificateFile "/path/to/signed.crt"
SSLCertificateKeyFile "/path/to/domain.key"