Unfortunately salesforce dx doesn't split custom labels into multiple files, so if you change one label, it packages them all. Implementing this would likely require looking at the actual diff lines and attempting to grab the individual node which have changed...