Its easy enough to test offline mode. Disable your network connection and see what happens. Steam has had bugs with offline, but they've also fixed many bugs. I've tested it, and you do NOT have to go into offline mode while you are online. You do NOT need an internet connection to enter offline mode.