A TCP connection to the IMAP server is kept open, with the server sending a packet whenever anything interesting happens (see IMAP IDLE), waking up the client app. This is how all push notifications work nowadays, IIRC, since you can't send information directly to clients without a persistent connection, due to NAT.