I had my domain removed and then did a fresh install. I was able to successfully install a letsencrypt certificate.
After the install I was unable to access my domain on my local network, but was able to access it when not on my local network. I added the public IP to my /etc/hosts file like this thread Pi-Hole edits /etc/hosts? and everything works.