support rcbinary/rctext/sequence file for external file table in jni connector

[0130w]

Proposed changes

Issue Number: #30669

This change supports reading the contents of external file tables from rcbinary, rctext, and sequence files via the JNI connector.

todo-lists:

• Support Reading Table Structure from Hive Metastore
• Support S3/HDFS File System Types
• Rename commits info

Example:

mysql> select * from local( "file_path" = "ziqitest/row_1.seq", "format" = "sequence", "backend_id" = "10011");
+-------------+--------------+---------+-------------+-----------+------------+-------------+------------+------------+-------------+-------------+----------------------------+------------+-----------------+----------------------+---------------------------+
| col_tinyint | col_smallint | col_int | col_bigint  | col_float | col_double | col_decimal | col_string | col_char   | col_varchar | col_boolean | col_timestamp              | col_date   | col_array       | col_map              | col_struct                |
+-------------+--------------+---------+-------------+-----------+------------+-------------+------------+------------+-------------+-------------+----------------------------+------------+-----------------+----------------------+---------------------------+
|           7 |           13 |      74 | 13000000000 |      6.15 |      4.376 |       57.30 | world      | Char       | Varchar     |           1 | 2022-01-01 10:00:00.000000 | 2022-01-01 | ["A", "B", "C"] | {"key2":2, "key1":1} | {"name":"John", "age":30} |
+-------------+--------------+---------+-------------+-----------+------------+-------------+------------+------------+-------------+-------------+----------------------------+------------+-----------------+----------------------+---------------------------+
1 row in set (1.12 sec)

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[morningman]

No need to move this code

[morningman]

Do not move code that unrelated to your feature

[morningman]

Do you support write sequence/rcfile too?

[morningman]

Do not move code

[morningman]

Could you reuse FileFormatUtils.parseCsvSchema()?
Although it is called "csv schema", but actually it can be used for any file format which need specified schema

[morningman]

I think we don't need to support use_hivemetastore in tvf.

[morningman]

do not remove code