Evolution 2.6.3 contains the fix for: http://bugzilla.gnome.org/show_bug.cgi?id=333821 Which occurs pretty often when using NetworkManager. The offline mode will be automatically on when NetworkManager can't get a connection, and the dialogue saying it can't ping the server will appear (for a reason, it's not connected to the network...)
Already in progress.