How to implement certificate based access to self hosted services?

I am hosting few services for my friends and family on my server. Due to devices limitations, I can't install VPN on TVs etc. Is it possible to restrict the access to only those users that have a certificate issued by me?