Point the hostname of your service to the IP of the proxy in the DNS.

For the certs you need an internal CA. I use Step CA which has ACME support so the proxy can get certificates easily.

Add the root CA certificate to your computer certificate trust store.

Profit!!