Avoid possible duplicate fds in the list