Skip to content

QuickParquetLoad

Cinchoo edited this page Jun 24, 2020 · 5 revisions

Loading Parquet file

To load Parquet file, use ChoParquetReader component to parse it. Sample below shows how to load Parquet file (Emp.parquet)

Id,Name
1,Tom
2,Carl
3,Mark

Load using iterator

foreach (dynamic e in new ChoParquetReader("Emp.parquet"))
    Console.WriteLine("Id: " + e.Id + " Name: " + e.Name);

Load using loop

var reader = new ChoParquetReader("Emp.parquet");
dynamic rec;
 
while ((rec = reader.Read()) != null)
    Console.WriteLine("Id: " + e.Id + " Name: " + e.Name);

Load using POCO object

public class Employee
{
    public int Id { get; set; }
    public string Name { get; set; }
}
foreach (var e in new ChoParquetReader<Employee>("Emp.parquet"))
    Console.WriteLine("Id: " + e.Id + " Name: " + e.Name);

Please visit below article for detailed walk-through of Parquet reader

Cinchoo ETL - Parquet Reader