Restrict direct IP access to site

[Dan11]

I have 5 sites and Let's Encrypt installed and working on all sites. When I access https://vps-ip, it always points to the first site configured in vhosts-ssl-letsencrypt.conf (I've changed the config and put another site at the top of the config to test it).

http://vps-ip is pointing to the right vps welcome page in /usr/local/apache/htdocs
Any ideas?