Gathering Ideas for WASM web playground design

[qstommyshu]

Hi!

I would like to gather some ideas for what kinds of designs/features people want for the live-playground.

Here are some designs/features I'm thinking about:
Designs:

1. The live-playground needs to be athetic, the UI design should match the datafusion docs page style (i.e. light color theme?)
2. Large input area for long query format
3. Support using arrow key or ctrl + z to go back to previous input state.
4. Syntax highlighting

Features:

1. A side bar like the duckdb live playground where user can easily access to API documentations and simple examples
   
2. parquet and csv file querying support
3. The ability to allow users to load parquet files from their S3 bucket like waynexia/datafusion-wasm or something like parquet-viewer
4. A way to tell the user loaded table and schema (I found it hard to play around with the duckdb playground as terminal style does not give much information, i.e. what are the tables available to query on)

Open to any ideas that can make the wasm live-playground more attractive!

External context:

• [EPIC] A collection of tickets for improved WASM support in DataFusion
• Browser-accessible official DataFusion playground / DataFusion fiddle

[backkem]

IDK if there is broad enough interest for it but I think querying a remote DataFusion instance would be a cool feature. Technically, I think this can be done by adding grpc-web support to datafusion-flight-sql-server.

[qstommyshu]

Thanks for your idea @backkem !

IDK if there is broad enough interest for it but I think querying a remote DataFusion instance would be a cool feature. Technically, I think this can be done by adding grpc-web support to datafusion-flight-sql-server.

That would be pretty cool, querying remote instance would make accessing distributed datafusion possible. Looks like grpc-web is a tool to connect web-client with remote server support grpc.

I think a wasm "playground" should have simpler features, the purpose of it is to lower the bar for users to use datafusion. The actual datafusion-wasm implementation probably could benefit from having the ability to query a remote DataFusion instance.