Initial roadmap

[tswast]

Features

I'm hoping to provide the following methods in this connector:

• polars_bigquery.read_bigquery -- read from BigQuery table (or query) to Polars DataFrame
• polars_bigquery.scan_bigquery -- read from BigQuery table (or query) to Polars LazyFrame, with push-down support for row/column filters and possibly more in the future.
• polars_bigquery.write_bigquery -- write to a BigQuery table using the BigQuery Storage Write API Arrow support.

Package setup

• Setup code structure -- So far, chore: add split repo templates googleapis/python-bigquery#1 is based on https://marcogorelli.github.io/polars-plugins-tutorial/ but perhaps we should take more inspiration from the https://github.com/pola-rs/polars repo so that we can distribute Rust crates separately from the Python packages?
• Setup test infrastructure. Using https://github.com/google-github-actions/auth to be able to test against the real BigQuery could be helpful.
• Setup release infrastructure.

Related issues

• Support inserting data into BigQuery directly from a Polars DataFrame googleapis/google-cloud-python#15710