VNC does not have this functionality.
The solution is to use the firewall app to block port 5900 on the interfaces you don't want VNC to support or to restric the Subnets from which port 5900 would be allowed.
Here is an example for Windows. (I assume you don't need a lunux based solution).