The Mail app gets notifications of new emails and/or automatically checks for new email, then downloads all or part of each email. What it does not do is automatically check when an email has been deleted from the server by other apps or methods (like filters and rules).
So, the deleted emails show up for a bit, then disappear as Mail syncs with the server.