Fix RemoteEndpoint with async+DualMode (#4717)