[sgen] Trim worker gray queue after finishing concurrent mark