Popart bert data path fix

hiteshk-gc · hiteshk-gc · commit 5c6cc7d557c0 · 2022-10-12T17:03:58.000+01:00
diff --git a/nlp/bert/popart/configs/packed/packed_pretrain_tiny_512.json b/nlp/bert/popart/configs/packed/packed_pretrain_tiny_512.json
@@ -47,6 +47,6 @@
     "lr_warmup_start" : 4e-3,
     "learning_rate": 8e-3,
     "weight_decay": 1e-2,
-    "input_files": ["data/jan2020_three_seq_per_pack_with_duplications_v2/*"],
+    "input_files": ["data/packed_sequence_128/duplication_*"],
     "engine_cache": "__cache_mlperf_bert_tiny"
 }

Original file line number	Diff line number	Diff line change
`@@ -47,6 +47,6 @@`
`47`	`47`	`"lr_warmup_start" : 4e-3,`
`48`	`48`	`"learning_rate": 8e-3,`
`49`	`49`	`"weight_decay": 1e-2,`
`50`		`- "input_files": ["data/jan2020_three_seq_per_pack_with_duplications_v2/*"],`
	`50`	`+ "input_files": ["data/packed_sequence_128/duplication_*"],`
`51`	`51`	`"engine_cache": "__cache_mlperf_bert_tiny"`
`52`	`52`	`}`