Fix parallel-build issues with LIBRARY_USE_INTERMEDIATE_FILE