The duplication of dataset files on Hugging Face

[TtuHamg]

Hi, I noticed that the .parquet files on Hugging Face contain duplicate entries. Could you explain the differences between these files, or were multiple copies of the same file accidentally uploaded?

[NormalUhr]

Hi, thanks for pointing this out. We will look into this and fix any bugs if needed. This is not done intentionally.