Save some size in dtype_util when dtype selective build is not in use

Save some size in dtype_util when dtype selective build is not in use #35034