The problem you might run into is if the computer's configuration or an anti-virus application denies running applications from removable devices.
There is a USB boot device that will boot most notebooks/pc and establish a VPN connection to a terminal connection.
http://www.ecos.de/uploads/media/ECOS_-_Secure_Thin_Client_Product_Overview_01.pdf