Block cpanel access from other ip addresses?

I'm curious if there's a way to block ip addresses other than your own from accessing the cpanel of your website:

cpanel.domain.com
domain.com/cpanel
domain.com:2083
...

Is it possible to do this? I've done some research online and most of them require access to internal things (WHM). I've also tried using CloudFlare's page rules but those don't seem to work at all. And of course, .htaccess doesn't help in doing it.

Any ideas?