diff --git a/blog/release-note-2.1.8.md b/blog/release-note-2.1.8.md index 429b1f84894a5..821d1aebc7ea3 100644 --- a/blog/release-note-2.1.8.md +++ b/blog/release-note-2.1.8.md @@ -36,6 +36,7 @@ Dear Community, **Apache Doris version 2.1.8 was officially released on January ## Behavior Changes +- When querying a data source with case-insensitive table names (such as Hive) through External Catalog, in previous versions, you can use any case to query the table name, but in version 2.1.8, Doris's own table name case sensitivity policy will be strictly followed. - Add the environment variable `SKIP_CHECK_ULIMIT` to skip the ulimit value verification check within the BE process. This is only available to applications in the Docker quick start scenario. [#45267](https://github.com/apache/doris/pull/45267) - Add the `enable_cooldown_replica_affinity` session variable to control the selection of replica affinity for queries under cold - hot separation. - In FE, add the configurations `restore_job_compressed_serialization` and `backup_job_compressed_serialization` to solve the OOM problem of FE during backup and restore operations when the number of db tablets is extremely large. By default, these configurations are disabled, and once enabled, they cannot be downgraded. @@ -187,4 +188,4 @@ Dear Community, **Apache Doris version 2.1.8 was officially released on January ### Others -- Fix the potential memory leak problem when `enable_jvm_monitor=true` is enabled on the BE side [#44311](https://github.com/apache/doris/pull/44311). \ No newline at end of file +- Fix the potential memory leak problem when `enable_jvm_monitor=true` is enabled on the BE side [#44311](https://github.com/apache/doris/pull/44311). diff --git a/blog/release-note-3.0.4.md b/blog/release-note-3.0.4.md index 2530790d0dd21..9b69675acb4c9 100644 --- a/blog/release-note-3.0.4.md +++ b/blog/release-note-3.0.4.md @@ -44,6 +44,7 @@ Dear community members, the Apache Doris 3.0.4 version was officially released o - For more information, please refer to documentation: [Export Overview - Apache Doris](https://doris.apache.org/docs/3.0/data-operate/export/export-overview) +- When querying a data source with case-insensitive table names (such as Hive) through External Catalog, in previous versions, you can use any case to query the table name, but in version 3.0.4, Doris's own table name case sensitivity policy will be strictly followed. - The Hudi JNI Scanner has been replaced from Spark API to Hadoop API to enhance compatibility. Users can switch by setting the session variable `set hudi_jni_scanner=spark/hadoop`. [#44396](https://github.com/apache/doris/pull/44396) - The use of `auto bucket` in Colocate tables is prohibited. [#44396](https://github.com/apache/doris/pull/44396) - Paimon cache has been added to the Catalog, eliminating real-time data queries. [#44911 ](https://github.com/apache/doris/pull/44911) @@ -230,4 +231,4 @@ Dear community members, the Apache Doris 3.0.4 version was officially released o - When granting `CREATE_PRIV`, the existence of the corresponding resource is no longer checked. [#45125](https://github.com/apache/doris/pull/45125) - Fixed the issue where queries on views with permissions could fail due to missing permissions for referenced tables in extreme scenarios. [#44621](https://github.com/apache/doris/pull/44621) -- Resolved the issue where permission checks for `use db` did not distinguish between internal and external Catalogs. [#45720](https://github.com/apache/doris/pull/45720) \ No newline at end of file +- Resolved the issue where permission checks for `use db` did not distinguish between internal and external Catalogs. [#45720](https://github.com/apache/doris/pull/45720) diff --git a/docs/releasenotes/v3.0/release-3.0.4.md b/docs/releasenotes/v3.0/release-3.0.4.md index 261108f867bb3..43c3effe652ea 100644 --- a/docs/releasenotes/v3.0/release-3.0.4.md +++ b/docs/releasenotes/v3.0/release-3.0.4.md @@ -39,6 +39,7 @@ Dear community members, the Apache Doris 3.0.4 version was officially released o - For more information, please refer to documentation: [Export Overview - Apache Doris](https://doris.apache.org/docs/3.0/data-operate/export/export-overview) +- When querying a data source with case-insensitive table names (such as Hive) through External Catalog, in previous versions, you can use any case to query the table name, but in version 3.0.4, Doris's own table name case sensitivity policy will be strictly followed. - The Hudi JNI Scanner has been replaced from Spark API to Hadoop API to enhance compatibility. Users can switch by setting the session variable `set hudi_jni_scanner=spark/hadoop`. [#44396](https://github.com/apache/doris/pull/44396) - The use of `auto bucket` in Colocate tables is prohibited. [#44396](https://github.com/apache/doris/pull/44396) - Paimon cache has been added to the Catalog, eliminating real-time data queries. [#44911 ](https://github.com/apache/doris/pull/44911) @@ -225,4 +226,4 @@ Dear community members, the Apache Doris 3.0.4 version was officially released o - When granting `CREATE_PRIV`, the existence of the corresponding resource is no longer checked. [#45125](https://github.com/apache/doris/pull/45125) - Fixed the issue where queries on views with permissions could fail due to missing permissions for referenced tables in extreme scenarios. [#44621](https://github.com/apache/doris/pull/44621) -- Resolved the issue where permission checks for `use db` did not distinguish between internal and external Catalogs. [#45720](https://github.com/apache/doris/pull/45720) \ No newline at end of file +- Resolved the issue where permission checks for `use db` did not distinguish between internal and external Catalogs. [#45720](https://github.com/apache/doris/pull/45720) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/v3.0/release-3.0.4.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/v3.0/release-3.0.4.md index 66729e16ba805..bdc6910809cd0 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/v3.0/release-3.0.4.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/v3.0/release-3.0.4.md @@ -38,6 +38,7 @@ under the License. - 导出数据至 Parquet/ORC 格式时,`bitmap`、`quantile_state` 和 `hll` 类型将以 Binary 格式导出。同时新增支持导出 `jsonb` 和 `variant` 类型,导出格式为 `string`。 [#44041](https://github.com/apache/doris/pull/44041) - 更多内容,参考文档:[Export Overview - Apache Doris](https://doris.apache.org/docs/3.0/data-operate/export/export-overview) +- 当通过 External Catalog 查询表名大小写不敏感的数据源(如 Hive)时,在之前版本中,可以使用任意大小写进行表名查询,但是在 3.0.4 版本中,将严格遵循 Doris 自身的表名大小写敏感策略。 - 将 Hudi JNI Scanner 从 Spark API 替换为 Hadoop API,以增强兼容性。用户可以通过设置会话变量 `set hudi_jni_scanner=spark/hadoop` 进行切换。[#44267](https://github.com/apache/doris/pull/44267) - 禁止在 Colocate 表中使用 `auto bucket`。 [#44396](https://github.com/apache/doris/pull/44396) - 为 Catalog 增加 Paimon 缓存,不再进行实时数据查询。 [#44911 ](https://github.com/apache/doris/pull/44911) @@ -224,4 +225,4 @@ under the License. - 赋予 `CREATE_PRIV` 时,不再检查对应资源是否存在。 [#45125](https://github.com/apache/doris/pull/45125) - 修复在极端场景下,可能出现的查询有权限的视图,但报错没有视图中引用的表的权限的问题。 [#44621](https://github.com/apache/doris/pull/44621) -- 修复 `use db` 时检查权限时不区分内外 Catalog 的问题。 [#45720](https://github.com/apache/doris/pull/45720) \ No newline at end of file +- 修复 `use db` 时检查权限时不区分内外 Catalog 的问题。 [#45720](https://github.com/apache/doris/pull/45720) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/releasenotes/v2.1/release-2.1.8.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/releasenotes/v2.1/release-2.1.8.md new file mode 100644 index 0000000000000..b50fa62a7e95e --- /dev/null +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/releasenotes/v2.1/release-2.1.8.md @@ -0,0 +1,199 @@ +--- +{ + "title": "Release 2.1.8", + "language": "zh-CN" +} +--- + + + +亲爱的社区小伙伴们,**Apache Doris 2.1.8 版本已于 2025 年 01 月 24 日正式发布。** 该版本持续在湖仓一体、异步物化视图、查询优化器与执行引擎、存储管理等方面进行改进提升与问题修复,进一步加强系统的性能和稳定性,欢迎大家下载体验。 + +- [立即下载](https://doris.apache.org/download) + +- [GitHub 下载](https://github.com/apache/doris/releases/tag/2.1.8-rc01) + + +## 行为变更 + +- 当通过 External Catalog 查询表名大小写不敏感的数据源(如 Hive)时,在之前版本中,可以使用任意大小写进行表名查询,但是在 2.1.8版本中,将严格遵循 Doris 自身的表名大小写敏感策略。 +- 添加环境变量 `SKIP_CHECK_ULIMIT` 以跳过 BE 进程内关于 ulimit 值校验检查,仅适用于 Docker 快速启动场景中应用。[#45267](https://github.com/apache/doris/pull/45267) +- 添加 `enable_cooldown_replica_affinity session` 变量控制冷热分层下查询选用副本亲和性 +- FE 添加配置` restore_job_compressed_serialization` 和 `backup_job_compressed_serialization` 用于解决 db tablet 数量非常大情况下备份和恢复操作时 FE OOM 的问题,默认关闭,打开之后无法降级 + +## 新功能 + +- **查询执行引擎:**Arrowflight 协议支持通过负载均衡设备访问 BE。 [#43281](https://github.com/apache/doris/pull/43281) +- **其他:**当前 Lambda 表达式支持捕获外部的列。 [#45186](https://github.com/apache/doris/pull/45186) + +## 改进提升 + +### 湖仓一体 + +- Hudi 版本更新至 0.15,并且优化了 Hudi 表的查询规划性能。 +- 优化了 MaxCompute 分区表的读取性能。 [#45148](https://github.com/apache/doris/pull/45148) +- 支持会话变量 enable_text_validate_utf8,可以忽略 CSV 格式中的 UTF8 编码检测。[#45537](https://github.com/apache/doris/pull/45537) +- 优化在高过滤率情况下,Parquet 文件延迟物化的性能。[#46183](https://github.com/apache/doris/pull/46183) + +### 异步物化视图 + +- 现在支持手动刷新异步物化视图中不存在的分区。[#45290](https://github.com/apache/doris/pull/45290) +- 优化了透明改写规划的性能。[#44786](https://github.com/apache/doris/pull/44786) + +### 查询优化器 + +- 提升了 Runtime Filter 的自适应能力。[#42640](https://github.com/apache/doris/pull/42640) +- 增加了在 MAX / MIN 聚合函数列上的过滤条件生成原始列过滤条件的能力。[#39252](https://github.com/apache/doris/pull/39252) +- 增加了在连接谓词上抽取单测过滤条件的能力。[#38479](https://github.com/apache/doris/pull/38479) +- 优化了谓词推导在集合算子上的能力,可以更好的生成过滤谓词。[#39450](https://github.com/apache/doris/pull/39450) +- 优化了统计信息收集和使用的异常处理能力,避免在收集异常时产生非预期的执行计划。[#43009](https://github.com/apache/doris/pull/43009) [#43776](https://github.com/apache/doris/pull/43776) [#43865](https://github.com/apache/doris/pull/43865) [#42104](https://github.com/apache/doris/pull/42104) [#42399](https://github.com/apache/doris/pull/42399) [#41729](https://github.com/apache/doris/pull/41729) + +### 查询执行引擎 + +- Resource group 支持在当前 group 不可用的时候,降级到别的 Group. [#44255](https://github.com/apache/doris/pull/44255) +- 优化带 limit 的查询执行使其能够更快的结束,避免多余的数据扫描。[#45222](https://github.com/apache/doris/pull/45222) + +### 存储管理 + +- CCR 支持了更加全面的操作,比如 Rename Table,Rename Column,Modify Comment,Drop View,Drop Rollup 等。 +- 提升了 Broker Load 导入进度的准确性和多个压缩文件导入时的性能。 +- 改进了 Routine Load 超时策略、线程池使用以防止 Routine Load 超时失败和影响查询。 + +### 其他 + +- Docker 快速启动镜像支持不设置环境参数直接启动,添加环境变量 `SKIP_CHECK_ULIMIT` 以跳过 `start_be.sh` 脚本以及 BE 进程内关于 `swap`、`max_map_count`、`ulimit` 相关校验检查,仅适用于 Docker 快速启动场景中应用。[#45269](https://github.com/apache/doris/pull/45269) +- 新增 LDAP 配置型 `ldap_group_filter` 用于自定义 Group 过滤。[#43292](https://github.com/apache/doris/pull/43292) +- 优化了使用 Ranger 时的性能。[#41207](https://github.com/apache/doris/pull/41207) +- 修复审计日志中,`scan bytes` 统计不准的问题。[#45167](https://github.com/apache/doris/pull/45167) +- 在 COLUMNS 系统表中能够正确显示列的默认值。[#44849](https://github.com/apache/doris/pull/44849) +- 在 VIEWS 系统表中能够正确显示视图的定义。[#45857](https://github.com/apache/doris/pull/45857) +- 当前,admin 用户不能被删除。[#44751](https://github.com/apache/doris/pull/44751) + +## Bug 修复 + +### 湖仓一体 + +- Hive + + - 修复无法查询 Spark 创建的 Hive 视图的问题。[#43553](https://github.com/apache/doris/pull/43553) + + - 修复无法正确读取某些 Hive Transaction 表的问题。[#45753](https://github.com/apache/doris/pull/45753) + + - 修复 Hive 表分区存在特殊字符时,无法进行正确分区裁剪的问题。[#42906](https://github.com/apache/doris/pull/42906) + +- Iceberg + + - 修复在 Kerberos 认证环境下,无法创建 Iceberg 表的问题。[#43445](https://github.com/apache/doris/pull/43445) + + - 修复某些情况下,Iceberg 表存在 dangling delete 情况下,`count(*)` 查询不准确的问题。[#44039](https://github.com/apache/doris/pull/44039) + + - 修复某些情况下,Iceberg 表列名不匹配导致查询错误的问题[#44470](https://github.com/apache/doris/pull/44470) + + - 修复某些情况下,当 Iceberg 表分区被修改后,无法读取的问题[#45367](https://github.com/apache/doris/pull/45367) + +- Paimon + + - 修复 Paimon Catalog 无法访问阿里云 OSS-HDFS 的问题。[#42585](https://github.com/apache/doris/pull/42585) + +- Hudi + + - 修复某些情况下,Hudi 表分区裁剪失效的问题。[#44669](https://github.com/apache/doris/pull/44669) + +- JDBC + + - 修复某些情况下,开始表名大小写不敏感功能后,使用 JDBC Catalog 无法获取表的问题。 + +- MaxCompute + + - 修复某些情况下,MaxCompute 表分区裁剪失效的问题。[#44508](https://github.com/apache/doris/pull/44508) + +- 其他 + + - 修复某些情况下,Export 任务导致 FE 内存泄露的问题。[#44019](https://github.com/apache/doris/pull/44019) + + - 修复某些情况下,无法使用 HTTPS 协议访问 S3 对象存储的问题。[#44242](https://github.com/apache/doris/pull/44242) + + - 修复某些情况下,Kerberos 认证票据无法自动刷新的问题。[#44916](https://github.com/apache/doris/pull/44916) + + - 修复某些情况下,读取 Hadoop Block 压缩格式文件出错的问题。[#45289](https://github.com/apache/doris/pull/45289) + + - 查询 ORC 格式的数据时,不再下推 CHAR 类型的谓词,以避免可能的结果错误。[#45484](https://github.com/apache/doris/pull/45484) + +### 异步物化视图 + +- 修复了当物化视图定义中存在 CTE 时,无法刷新的问题。[#44857](https://github.com/apache/doris/pull/44857) +- 修复了当基表增加列后,异步物化视图不能命中透明改写的问题。[#44867](https://github.com/apache/doris/pull/44867) +- 修复了当查询中在不同位置包含相同的过滤谓词时,透明改写失败的问题。[#44575](https://github.com/apache/doris/pull/44575) +- 修复了当过滤谓词或连接谓词中使用列的别名时,无法透明改写的问题。[#44779](https://github.com/apache/doris/pull/44779) + +### 索引 + +- 修复倒排索引 Compaction 异常处理的问题 [#45773](https://github.com/apache/doris/pull/45773) +- 修复倒排索引构建因为等锁超时失败的问题 [#43589](https://github.com/apache/doris/pull/43589) +- 修复异常情况下倒排索引写入 Crash 的问题。[#46075](https://github.com/apache/doris/pull/46075) +- 修复 Match 函数特殊参数时空指针的问题 [#45774](https://github.com/apache/doris/pull/45774) +- 修复 VARIANT 倒排索引相关的问题,禁用 VARIANT 使用索引 v1 格式。[#43971](https://github.com/apache/doris/pull/43971) [#45179](https://github.com/apache/doris/pull/45179/) + +- 修复 NGram Bloomfilter Index 设置 `gram_size = 65535` 时 Crash 的问题。[#43654](https://github.com/apache/doris/pull/43654) +- 修复 Bloomfilter Index 计算 DATE 和 DATETIME 不对的问题。[#43622](https://github.com/apache/doris/pull/43622) +- 修复 Drop Coloumn 没有自动 Drop Bloomfilter Index 的问题。[#44478](https://github.com/apache/doris/pull/44478) +- 减少 Bloomfilter Index 写入时的内存占用。[#46047](https://github.com/apache/doris/pull/46047) + +### 半结构化数据类型 + +- 优化内存占用,降低 VARIANT 数据类型的内存消耗。[#43349](https://github.com/apache/doris/pull/43349) [#44585](https://github.com/apache/doris/pull/44585) [#45734](https://github.com/apache/doris/pull/45734) +- 优化 VARIANT Schema Copy 性能。[#45731](https://github.com/apache/doris/pull/45731) +- 自动推断 Tablet Key 时不将 VARIANT 作为 Key。[#44736](https://github.com/apache/doris/pull/44736) +- 修复 VARIANT 从 NOT NULL 改成 NULL 的问题。[#45734](https://github.com/apache/doris/pull/45734) +- 修复 Lambda 函数类型推断错误的问题。[#45798](https://github.com/apache/doris/pull/45798) +- 修复 `ipv6_cidr_to_range` 函数边界条件 Coredump。[#46252](https://github.com/apache/doris/pull/46252) + +### 查询优化器 + +- 修复了潜在的表读锁互斥导致的死锁问题,并优化了锁的使用逻辑[#45045](https://github.com/apache/doris/pull/45045) [#43376](https://github.com/apache/doris/pull/43376) [#44164](https://github.com/apache/doris/pull/44164) [#44967](https://github.com/apache/doris/pull/44967) [#45995](https://github.com/apache/doris/pull/45995) +- 修复了 SQL Cache 功能错误的使用常量折叠导致在使用包含时间格式的函数时结果不正确的问题。[#44631](https://github.com/apache/doris/pull/44631) +- 修复了比较表达式优化,在边缘情况下可能优化错误,导致结果不正确的问题。[#44054](https://github.com/apache/doris/pull/44054) [#44725](https://github.com/apache/doris/pull/44725) [#44922](https://github.com/apache/doris/pull/44922) [#45735](https://github.com/apache/doris/pull/45735) [#45868](https://github.com/apache/doris/pull/45868) +- 修复高并发点查审计日志不正确的问题。[ #43345 ](https://github.com/apache/doris/pull/43345)[#44588](https://github.com/apache/doris/pull/44588) +- 修复高并发点查遇到异常后持续报错的问题。[#44582](https://github.com/apache/doris/pull/44582) +- 修复部分字段 Prepared Statement 不正确的问题。[#45732 ](https://github.com/apache/doris/pull/45732) + +### 查询执行引擎 + +- 修复了正则表达式和 LIKE 函数在特殊字符时结果不对的问题。[#44547](https://github.com/apache/doris/pull/44547) +- 修复 SQL Cache 在切换 DB 的时候结果可能不对的问题。[#44782](https://github.com/apache/doris/pull/44782) +- 修复`cut_ipv6` 函数结果不对的问题。[#43921](https://github.com/apache/doris/pull/43921) +- 修复数值类型到 bool 类型 cast 的问题。[#46275](https://github.com/apache/doris/pull/46275) +- 修复了一系列 Arrow Flight 相关的问题。[#45661](https://github.com/apache/doris/pull/45661) [#45023](https://github.com/apache/doris/pull/45023) [#43960](https://github.com/apache/doris/pull/43960) [#43929](https://github.com/apache/doris/pull/43929) +- 修复了当 hashjoin 的 hash 表超过 4G 时,部分情况结果错误的问题。[#46461](https://github.com/apache/doris/pull/46461/files) +- 修复了 convert_to 函数在中文字符时溢出的问题。[#46505](https://github.com/apache/doris/pull/46405) + +### 存储管理 + +- 修复高并发 DDL 可能导致 FE 启动失败的问题。 +- 修复自增列可能出现重复值的问题。 +- 修复扩容时 Routine Load 不能使用新扩容 BE 的问题。 + +### 权限管理 + +- 修复使用 Ranger 作为鉴权插件时,频繁访问 Ranger 服务的问题[#45645](https://github.com/apache/doris/pull/45645) + +### Others + +- 修复 BE 端开启 `enable_jvm_monitor=true` 后可能导致的内存泄露问题。[#44311](https://github.com/apache/doris/pull/44311) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/releasenotes/v3.0/release-3.0.4.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/releasenotes/v3.0/release-3.0.4.md index 66729e16ba805..bdc6910809cd0 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/releasenotes/v3.0/release-3.0.4.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/releasenotes/v3.0/release-3.0.4.md @@ -38,6 +38,7 @@ under the License. - 导出数据至 Parquet/ORC 格式时,`bitmap`、`quantile_state` 和 `hll` 类型将以 Binary 格式导出。同时新增支持导出 `jsonb` 和 `variant` 类型,导出格式为 `string`。 [#44041](https://github.com/apache/doris/pull/44041) - 更多内容,参考文档:[Export Overview - Apache Doris](https://doris.apache.org/docs/3.0/data-operate/export/export-overview) +- 当通过 External Catalog 查询表名大小写不敏感的数据源(如 Hive)时,在之前版本中,可以使用任意大小写进行表名查询,但是在 3.0.4 版本中,将严格遵循 Doris 自身的表名大小写敏感策略。 - 将 Hudi JNI Scanner 从 Spark API 替换为 Hadoop API,以增强兼容性。用户可以通过设置会话变量 `set hudi_jni_scanner=spark/hadoop` 进行切换。[#44267](https://github.com/apache/doris/pull/44267) - 禁止在 Colocate 表中使用 `auto bucket`。 [#44396](https://github.com/apache/doris/pull/44396) - 为 Catalog 增加 Paimon 缓存,不再进行实时数据查询。 [#44911 ](https://github.com/apache/doris/pull/44911) @@ -224,4 +225,4 @@ under the License. - 赋予 `CREATE_PRIV` 时,不再检查对应资源是否存在。 [#45125](https://github.com/apache/doris/pull/45125) - 修复在极端场景下,可能出现的查询有权限的视图,但报错没有视图中引用的表的权限的问题。 [#44621](https://github.com/apache/doris/pull/44621) -- 修复 `use db` 时检查权限时不区分内外 Catalog 的问题。 [#45720](https://github.com/apache/doris/pull/45720) \ No newline at end of file +- 修复 `use db` 时检查权限时不区分内外 Catalog 的问题。 [#45720](https://github.com/apache/doris/pull/45720) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/v2.1/release-2.1.8.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/v2.1/release-2.1.8.md index 5924060769b9c..b50fa62a7e95e 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/v2.1/release-2.1.8.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/v2.1/release-2.1.8.md @@ -33,6 +33,7 @@ under the License. ## 行为变更 +- 当通过 External Catalog 查询表名大小写不敏感的数据源(如 Hive)时,在之前版本中,可以使用任意大小写进行表名查询,但是在 2.1.8版本中,将严格遵循 Doris 自身的表名大小写敏感策略。 - 添加环境变量 `SKIP_CHECK_ULIMIT` 以跳过 BE 进程内关于 ulimit 值校验检查,仅适用于 Docker 快速启动场景中应用。[#45267](https://github.com/apache/doris/pull/45267) - 添加 `enable_cooldown_replica_affinity session` 变量控制冷热分层下查询选用副本亲和性 - FE 添加配置` restore_job_compressed_serialization` 和 `backup_job_compressed_serialization` 用于解决 db tablet 数量非常大情况下备份和恢复操作时 FE OOM 的问题,默认关闭,打开之后无法降级 @@ -195,4 +196,4 @@ under the License. ### Others -- 修复 BE 端开启 `enable_jvm_monitor=true` 后可能导致的内存泄露问题。[#44311](https://github.com/apache/doris/pull/44311) \ No newline at end of file +- 修复 BE 端开启 `enable_jvm_monitor=true` 后可能导致的内存泄露问题。[#44311](https://github.com/apache/doris/pull/44311) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/v3.0/release-3.0.4.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/v3.0/release-3.0.4.md index 66729e16ba805..bdc6910809cd0 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/v3.0/release-3.0.4.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/v3.0/release-3.0.4.md @@ -38,6 +38,7 @@ under the License. - 导出数据至 Parquet/ORC 格式时,`bitmap`、`quantile_state` 和 `hll` 类型将以 Binary 格式导出。同时新增支持导出 `jsonb` 和 `variant` 类型,导出格式为 `string`。 [#44041](https://github.com/apache/doris/pull/44041) - 更多内容,参考文档:[Export Overview - Apache Doris](https://doris.apache.org/docs/3.0/data-operate/export/export-overview) +- 当通过 External Catalog 查询表名大小写不敏感的数据源(如 Hive)时,在之前版本中,可以使用任意大小写进行表名查询,但是在 3.0.4 版本中,将严格遵循 Doris 自身的表名大小写敏感策略。 - 将 Hudi JNI Scanner 从 Spark API 替换为 Hadoop API,以增强兼容性。用户可以通过设置会话变量 `set hudi_jni_scanner=spark/hadoop` 进行切换。[#44267](https://github.com/apache/doris/pull/44267) - 禁止在 Colocate 表中使用 `auto bucket`。 [#44396](https://github.com/apache/doris/pull/44396) - 为 Catalog 增加 Paimon 缓存,不再进行实时数据查询。 [#44911 ](https://github.com/apache/doris/pull/44911) @@ -224,4 +225,4 @@ under the License. - 赋予 `CREATE_PRIV` 时,不再检查对应资源是否存在。 [#45125](https://github.com/apache/doris/pull/45125) - 修复在极端场景下,可能出现的查询有权限的视图,但报错没有视图中引用的表的权限的问题。 [#44621](https://github.com/apache/doris/pull/44621) -- 修复 `use db` 时检查权限时不区分内外 Catalog 的问题。 [#45720](https://github.com/apache/doris/pull/45720) \ No newline at end of file +- 修复 `use db` 时检查权限时不区分内外 Catalog 的问题。 [#45720](https://github.com/apache/doris/pull/45720) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/v2.1/release-2.1.8.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/v2.1/release-2.1.8.md index 5924060769b9c..b50fa62a7e95e 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/v2.1/release-2.1.8.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/v2.1/release-2.1.8.md @@ -33,6 +33,7 @@ under the License. ## 行为变更 +- 当通过 External Catalog 查询表名大小写不敏感的数据源(如 Hive)时,在之前版本中,可以使用任意大小写进行表名查询,但是在 2.1.8版本中,将严格遵循 Doris 自身的表名大小写敏感策略。 - 添加环境变量 `SKIP_CHECK_ULIMIT` 以跳过 BE 进程内关于 ulimit 值校验检查,仅适用于 Docker 快速启动场景中应用。[#45267](https://github.com/apache/doris/pull/45267) - 添加 `enable_cooldown_replica_affinity session` 变量控制冷热分层下查询选用副本亲和性 - FE 添加配置` restore_job_compressed_serialization` 和 `backup_job_compressed_serialization` 用于解决 db tablet 数量非常大情况下备份和恢复操作时 FE OOM 的问题,默认关闭,打开之后无法降级 @@ -195,4 +196,4 @@ under the License. ### Others -- 修复 BE 端开启 `enable_jvm_monitor=true` 后可能导致的内存泄露问题。[#44311](https://github.com/apache/doris/pull/44311) \ No newline at end of file +- 修复 BE 端开启 `enable_jvm_monitor=true` 后可能导致的内存泄露问题。[#44311](https://github.com/apache/doris/pull/44311) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/v3.0/release-3.0.4.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/v3.0/release-3.0.4.md index 66729e16ba805..bdc6910809cd0 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/v3.0/release-3.0.4.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/v3.0/release-3.0.4.md @@ -38,6 +38,7 @@ under the License. - 导出数据至 Parquet/ORC 格式时,`bitmap`、`quantile_state` 和 `hll` 类型将以 Binary 格式导出。同时新增支持导出 `jsonb` 和 `variant` 类型,导出格式为 `string`。 [#44041](https://github.com/apache/doris/pull/44041) - 更多内容,参考文档:[Export Overview - Apache Doris](https://doris.apache.org/docs/3.0/data-operate/export/export-overview) +- 当通过 External Catalog 查询表名大小写不敏感的数据源(如 Hive)时,在之前版本中,可以使用任意大小写进行表名查询,但是在 3.0.4 版本中,将严格遵循 Doris 自身的表名大小写敏感策略。 - 将 Hudi JNI Scanner 从 Spark API 替换为 Hadoop API,以增强兼容性。用户可以通过设置会话变量 `set hudi_jni_scanner=spark/hadoop` 进行切换。[#44267](https://github.com/apache/doris/pull/44267) - 禁止在 Colocate 表中使用 `auto bucket`。 [#44396](https://github.com/apache/doris/pull/44396) - 为 Catalog 增加 Paimon 缓存,不再进行实时数据查询。 [#44911 ](https://github.com/apache/doris/pull/44911) @@ -224,4 +225,4 @@ under the License. - 赋予 `CREATE_PRIV` 时,不再检查对应资源是否存在。 [#45125](https://github.com/apache/doris/pull/45125) - 修复在极端场景下,可能出现的查询有权限的视图,但报错没有视图中引用的表的权限的问题。 [#44621](https://github.com/apache/doris/pull/44621) -- 修复 `use db` 时检查权限时不区分内外 Catalog 的问题。 [#45720](https://github.com/apache/doris/pull/45720) \ No newline at end of file +- 修复 `use db` 时检查权限时不区分内外 Catalog 的问题。 [#45720](https://github.com/apache/doris/pull/45720) diff --git a/versioned_docs/version-2.0/releasenotes/v2.1/release-2.1.8.md b/versioned_docs/version-2.0/releasenotes/v2.1/release-2.1.8.md new file mode 100644 index 0000000000000..c00a31a73c114 --- /dev/null +++ b/versioned_docs/version-2.0/releasenotes/v2.1/release-2.1.8.md @@ -0,0 +1,187 @@ +--- +{ + "title": "Release 2.1.8", + "language": "en" +} +--- + + + +Dear Community, **Apache Doris version 2.1.8 was officially released on January 24, 2025.** This version introduces continuous upgrades and enhancements in several key areas, including Lakehouse, Asynchronous Materialized Views, Query Optimizer and Execution Engine, Storage Management, and more. + +- [Quick Download](https://doris.apache.org/download) + +- [GitHub Release](https://github.com/apache/doris/releases/tag/2.1.8-rc01) + +## Behavior Changes + +- When querying a data source with case-insensitive table names (such as Hive) through External Catalog, in previous versions, you can use any case to query the table name, but in version 2.1.8, Doris's own table name case sensitivity policy will be strictly followed. +- Add the environment variable `SKIP_CHECK_ULIMIT` to skip the ulimit value verification check within the BE process. This is only available to applications in the Docker quick start scenario. [#45267](https://github.com/apache/doris/pull/45267) +- Add the `enable_cooldown_replica_affinity` session variable to control the selection of replica affinity for queries under cold - hot separation. +- In FE, add the configurations `restore_job_compressed_serialization` and `backup_job_compressed_serialization` to solve the OOM problem of FE during backup and restore operations when the number of db tablets is extremely large. By default, these configurations are disabled, and once enabled, they cannot be downgraded. + +## New Features + +- The Arrow flight protocol supports accessing BE through a load - balancing device. [#43281](https://github.com/apache/doris/pull/43281) +- Now lambda expressions support capturing external columns (#45186).[#45186](https://github.com/apache/doris/pull/45186) + +## Improvements + +### Lakehouse + +- Update the Hudi version to 0.15. And optimize the query planning performance of Hudi tables. +- Optimize the read performance of MaxCompute partitioned tables. [#45148](https://github.com/apache/doris/pull/45148) +- Support the session variable `enable_text_validate_utf8`, which can ignore the UTF8 encoding detection in CSV format. [#45537](https://github.com/apache/doris/pull/45537) +- Optimize the performance of Parquet file lazy materialization under high - filtering - rate conditions. [#46183](https://github.com/apache/doris/pull/46183) + +### Asynchronous Materialized Views + +- Now it supports manually refreshing partitions that do not exist in an asynchronous materialized view [#45290](https://github.com/apache/doris/pull/45290). +- Optimize the performance of transparent rewrite planning [#44786](https://github.com/apache/doris/pull/44786). + +### Query Optimizer + +- Improve the adaptive ability of runtime filters [#42640](https://github.com/apache/doris/pull/42640). +- Add the ability to generate original column filter conditions from filter conditions on `max/min` aggregate function columns [#39252](https://github.com/apache/doris/pull/39252) +- Add the ability to extract single - side filter conditions from join predicates [#38479](https://github.com/apache/doris/pull/38479). +- Optimize the ability of predicate derivation on set operators to better generate filter predicates [#39450](https://github.com/apache/doris/pull/39450). +- Optimize the exception handling ability of statistic information collection and usage to avoid generating unexpected execution plans when collection exceptions occur. [#43009](https://github.com/apache/doris/pull/43009) [#43776](https://github.com/apache/doris/pull/43776) [#43865](https://github.com/apache/doris/pull/43865) [#42104](https://github.com/apache/doris/pull/42104) [#42399](https://github.com/apache/doris/pull/42399) [#41729](https://github.com/apache/doris/pull/41729) + +### Query Execution Engine + +- Optimize the execution of queries with `limit` to end faster and avoid unnecessary data scanning [#44255](https://github.com/apache/doris/pull/44255). + +### Storage Management + +- CCR supports more comprehensive operations, such as `rename table`, `rename column`, `modify comment`, `drop view`, `drop rollup`, etc. +- Improve the accuracy of the broker load import progress and the performance when importing multiple compressed files. +- Improve the routine load timeout strategy and thread - pool usage to prevent routine load timeout failures and impacts on queries. + +### Others + +- The Docker quick - start image supports starting without setting environment parameters. Add the environment variable `SKIP_CHECK_ULIMIT` to skip the `start_be.sh` script and the swap, `max_map_count`, ulimit - related verification checks within the BE process. This is only applicable to applications in the Docker quick - start scenario. [#45269](https://github.com/apache/doris/pull/45269) +- Add the new LDAP configuration `ldap_group_filter` for custom group filtering. [#43292](https://github.com/apache/doris/pull/43292) +- Optimize performance when using ranger. [#41207](https://github.com/apache/doris/pull/41207) +- Fix the inaccurate statistics of `scan bytes` in the audit log. [#45167](https://github.com/apache/doris/pull/45167) +- Now, the default values of columns can be correctly displayed in the `COLUMNS` system table. [#44849](https://github.com/apache/doris/pull/44849) +- Now, the definition of views can be correctly displayed in the `VIEWS` system table. [#45857](https://github.com/apache/doris/pull/45857) +- Now, the `admin` user cannot be deleted. [#44751](https://github.com/apache/doris/pull/44751) + +## Bug Fixes + +### Lakehouse + +#### Hive + +- Fix the problem of being unable to query Hive views created by Spark. [#43553](https://github.com/apache/doris/pull/43553) +- Fix the problem of being unable to correctly read some Hive Transaction tables. [#45753](https://github.com/apache/doris/pull/45753) +- Fix the problem of incorrect partition pruning when Hive table partitions contain special characters. [#42906](https://github.com/apache/doris/pull/42906) + +#### Iceberg + +- Fix the problem of being unable to create Iceberg tables in a Kerberos - authenticated environment. [#43445](https://github.com/apache/doris/pull/43445) +- Fix the problem of inaccurate `count(*)` queries when there are dangling deletes in Iceberg tables in some cases. [#44039](https://github.com/apache/doris/pull/44039) +- Fix the problem of query errors due to column name mismatches in Iceberg tables in some cases . [#44470](https://github.com/apache/doris/pull/44470) +- Fix the problem of being unable to read Iceberg tables when their partitions are modified in some cases .[#45367](https://github.com/apache/doris/pull/45367) + +#### Paimon + +- Fix the problem that the Paimon Catalog cannot access Alibaba Cloud OSS - HDFS. [#42585](https://github.com/apache/doris/pull/42585) + +#### Hudi + +- Fix the problem of ineffective partition pruning in Hudi tables in some cases. [#44669](https://github.com/apache/doris/pull/44669) + +#### JDBC + +- Fix the problem of being unable to obtain tables using the JDBC Catalog after enabling the case insensitive table name feature in some cases. + +#### MaxCompute + +- Fix the problem of ineffective partition pruning in MaxCompute tables in some cases[#44508](https://github.com/apache/doris/pull/44508). + +#### Others + +- Fix the problem of FE memory leaks caused by EXPORT tasks in some cases.[#44019](https://github.com/apache/doris/pull/44019) +- Fix the problem of being unable to access S3 object storage using the https protocol in some cases [#44242](https://github.com/apache/doris/pull/44242). +- Fix the problem of the inability to automatically refresh Kerberos authentication tickets in some cases [#44916](https://github.com/apache/doris/pull/44916) +- Fix the problem of errors when reading Hadoop Block compressed format files in some cases. [#45289](https://github.com/apache/doris/pull/45289) +- When querying ORC - formatted data, no longer push down CHAR - type predicates to avoid possible result errors. [#45484](https://github.com/apache/doris/pull/45484) + +### Asynchronous Materialized Views + +- Fix the problem that when there is a CTE in the materialized view definition, it cannot be refreshed [#44857](https://github.com/apache/doris/pull/44857). +- Fix the problem that when columns are added to the base table, the asynchronous materialized view cannot hit the transparent rewrite. [#44867](https://github.com/apache/doris/pull/44867) +- Fix the problem that when the same filter predicate is included in different positions in a query, the transparent rewrite fails. [#44575](https://github.com/apache/doris/pull/44575) +- Fix the problem that when column aliases are used in filter predicates or join predicates, the transparent rewrite cannot be performed. [#44779](https://github.com/apache/doris/pull/44779) + +### Inverted Index + +- Fix the problem of abnormal handling of inverted index compaction. [#45773](https://github.com/apache/doris/pull/45773) +- Fix the problem that inverted index construction fails due to lock - waiting timeout. [#43589](https://github.com/apache/doris/pull/43589) +- Fix the problem of inverted index write crashes in abnormal situations. [#46075](https://github.com/apache/doris/pull/46075) +- Fix the null - pointer problem of the `match` function with special parameters. [#45774](https://github.com/apache/doris/pull/45774) +- Fix problems related to the variant inverted index and disable the use of the index v1 format for variants [#43971](https://github.com/apache/doris/pull/43971) [#45179](https://github.com/apache/doris/pull/45179/) +- Fix the problem of crashes when setting `gram_size = 65535` for the ngram bloomfilter index [#43654](https://github.com/apache/doris/pull/43654) +- Fix the problem of incorrect calculation of DATE and DATETIME for the bloomfilter index [#43622](https://github.com/apache/doris/pull/43622) +- Fix the problem that dropping a column does not automatically drop the bloomfilter index [#44478](https://github.com/apache/doris/pull/44478) +- Reduce the memory footprint when writing the bloomfilter index [#46047](https://github.com/apache/doris/pull/46047) + +### Semi-Structure Data + +- Optimize memory usage and reduce the memory consumption of the `variant` data type [#43349](https://github.com/apache/doris/pull/43349) [#44585](https://github.com/apache/doris/pull/44585) [#45734](https://github.com/apache/doris/pull/45734) +- Optimize the performance of `variant` schema copy. [#45731](https://github.com/apache/doris/pull/45731) +- Do not use `variant` as a key when automatically inferring tablet keys. [#44736](https://github.com/apache/doris/pull/44736) +- Fix the problem of changing `variant` from `NOT NULL` to `NULL` [#45734](https://github.com/apache/doris/pull/45734) +- Fix the problem of incorrect type inference of lambda functions. [#45798](https://github.com/apache/doris/pull/45798) +- Fix the coredump problem at the boundary conditions of the `ipv6_cidr_to_range` function [#46252](https://github.com/apache/doris/pull/46252) + +### Query Optimizer + +- Fix the potential deadlock problem caused by mutual exclusion of table read locks and optimize the lock - using logic [#45045](https://github.com/apache/doris/pull/45045) [#43376](https://github.com/apache/doris/pull/43376) [#44164](https://github.com/apache/doris/pull/44164) [#44967](https://github.com/apache/doris/pull/44967) [#45995](https://github.com/apache/doris/pull/45995). +- Fix the problem that the SQL Cache function incorrectly uses constant folding, resulting in incorrect results when using functions containing time formats . [#44631](https://github.com/apache/doris/pull/44631) +- Fix the problem of incorrect optimization of comparison expressions in edge cases, which may lead to incorrect results. [#44054](https://github.com/apache/doris/pull/44054) [#44725](https://github.com/apache/doris/pull/44725) [#44922](https://github.com/apache/doris/pull/44922) [#45735](https://github.com/apache/doris/pull/45735) [#45868](https://github.com/apache/doris/pull/45868) +- Fix the problem of incorrect audit logs for high - concurrent point queries [ #43345 ](https://github.com/apache/doris/pull/43345)[#44588](https://github.com/apache/doris/pull/44588) +- Fix the problem of continuous error reporting after an exception occurs in high - concurrent point queries [#44582](https://github.com/apache/doris/pull/44582) +- Fix the problem of incorrectly prepared statements for some fields.[#45732 ](https://github.com/apache/doris/pull/45732) + +### Query Execution Engine + +- Fix the problem of incorrect results of regular expressions and `like` functions for special characters. [#44547](https://github.com/apache/doris/pull/44547) +- Fix the problem that the SQL Cache may have incorrect results when switching databases. [#44782](https://github.com/apache/doris/pull/44782) +- Fix the problem of incorrect results of the `cut_ipv6` function. [#43921](https://github.com/apache/doris/pull/43921) +- Fix the problem of casting from numeric types to bool types. [#46275](https://github.com/apache/doris/pull/46275) +- Fix a series of problems related to arrow flight. [#45661](https://github.com/apache/doris/pull/45661) [#45023](https://github.com/apache/doris/pull/45023) [#43960](https://github.com/apache/doris/pull/43960) [#43929](https://github.com/apache/doris/pull/43929) +- Fix the problem of incorrect results in some cases when the hash table of hash join exceeds 4G. [#46461](https://github.com/apache/doris/pull/46461/files) +- Fix the overflow problem of the `convert_to` function for Chinese characters. [#46505](https://github.com/apache/doris/pull/46405) + +### Storage Management + +- Fix the problem that high - concurrent DDL may cause FE startup failure. +- Fix the problem that auto - increment columns may have duplicate values. +- Fix the problem that routine load cannot use the newly expanded BE during expansion. + +### Permission Management + +- Fix the problem of frequent access to the Ranger service when using Ranger as the authentication plugin [#45645](https://github.com/apache/doris/pull/45645). + +### Others + +- Fix the potential memory leak problem when `enable_jvm_monitor=true` is enabled on the BE side [#44311](https://github.com/apache/doris/pull/44311). diff --git a/versioned_docs/version-2.0/releasenotes/v3.0/release-3.0.4.md b/versioned_docs/version-2.0/releasenotes/v3.0/release-3.0.4.md index 261108f867bb3..43c3effe652ea 100644 --- a/versioned_docs/version-2.0/releasenotes/v3.0/release-3.0.4.md +++ b/versioned_docs/version-2.0/releasenotes/v3.0/release-3.0.4.md @@ -39,6 +39,7 @@ Dear community members, the Apache Doris 3.0.4 version was officially released o - For more information, please refer to documentation: [Export Overview - Apache Doris](https://doris.apache.org/docs/3.0/data-operate/export/export-overview) +- When querying a data source with case-insensitive table names (such as Hive) through External Catalog, in previous versions, you can use any case to query the table name, but in version 3.0.4, Doris's own table name case sensitivity policy will be strictly followed. - The Hudi JNI Scanner has been replaced from Spark API to Hadoop API to enhance compatibility. Users can switch by setting the session variable `set hudi_jni_scanner=spark/hadoop`. [#44396](https://github.com/apache/doris/pull/44396) - The use of `auto bucket` in Colocate tables is prohibited. [#44396](https://github.com/apache/doris/pull/44396) - Paimon cache has been added to the Catalog, eliminating real-time data queries. [#44911 ](https://github.com/apache/doris/pull/44911) @@ -225,4 +226,4 @@ Dear community members, the Apache Doris 3.0.4 version was officially released o - When granting `CREATE_PRIV`, the existence of the corresponding resource is no longer checked. [#45125](https://github.com/apache/doris/pull/45125) - Fixed the issue where queries on views with permissions could fail due to missing permissions for referenced tables in extreme scenarios. [#44621](https://github.com/apache/doris/pull/44621) -- Resolved the issue where permission checks for `use db` did not distinguish between internal and external Catalogs. [#45720](https://github.com/apache/doris/pull/45720) \ No newline at end of file +- Resolved the issue where permission checks for `use db` did not distinguish between internal and external Catalogs. [#45720](https://github.com/apache/doris/pull/45720) diff --git a/versioned_docs/version-2.1/releasenotes/v2.1/release-2.1.8.md b/versioned_docs/version-2.1/releasenotes/v2.1/release-2.1.8.md index 525675897294e..c00a31a73c114 100644 --- a/versioned_docs/version-2.1/releasenotes/v2.1/release-2.1.8.md +++ b/versioned_docs/version-2.1/releasenotes/v2.1/release-2.1.8.md @@ -32,6 +32,7 @@ Dear Community, **Apache Doris version 2.1.8 was officially released on January ## Behavior Changes +- When querying a data source with case-insensitive table names (such as Hive) through External Catalog, in previous versions, you can use any case to query the table name, but in version 2.1.8, Doris's own table name case sensitivity policy will be strictly followed. - Add the environment variable `SKIP_CHECK_ULIMIT` to skip the ulimit value verification check within the BE process. This is only available to applications in the Docker quick start scenario. [#45267](https://github.com/apache/doris/pull/45267) - Add the `enable_cooldown_replica_affinity` session variable to control the selection of replica affinity for queries under cold - hot separation. - In FE, add the configurations `restore_job_compressed_serialization` and `backup_job_compressed_serialization` to solve the OOM problem of FE during backup and restore operations when the number of db tablets is extremely large. By default, these configurations are disabled, and once enabled, they cannot be downgraded. @@ -183,4 +184,4 @@ Dear Community, **Apache Doris version 2.1.8 was officially released on January ### Others -- Fix the potential memory leak problem when `enable_jvm_monitor=true` is enabled on the BE side [#44311](https://github.com/apache/doris/pull/44311). \ No newline at end of file +- Fix the potential memory leak problem when `enable_jvm_monitor=true` is enabled on the BE side [#44311](https://github.com/apache/doris/pull/44311). diff --git a/versioned_docs/version-2.1/releasenotes/v3.0/release-3.0.4.md b/versioned_docs/version-2.1/releasenotes/v3.0/release-3.0.4.md index 261108f867bb3..43c3effe652ea 100644 --- a/versioned_docs/version-2.1/releasenotes/v3.0/release-3.0.4.md +++ b/versioned_docs/version-2.1/releasenotes/v3.0/release-3.0.4.md @@ -39,6 +39,7 @@ Dear community members, the Apache Doris 3.0.4 version was officially released o - For more information, please refer to documentation: [Export Overview - Apache Doris](https://doris.apache.org/docs/3.0/data-operate/export/export-overview) +- When querying a data source with case-insensitive table names (such as Hive) through External Catalog, in previous versions, you can use any case to query the table name, but in version 3.0.4, Doris's own table name case sensitivity policy will be strictly followed. - The Hudi JNI Scanner has been replaced from Spark API to Hadoop API to enhance compatibility. Users can switch by setting the session variable `set hudi_jni_scanner=spark/hadoop`. [#44396](https://github.com/apache/doris/pull/44396) - The use of `auto bucket` in Colocate tables is prohibited. [#44396](https://github.com/apache/doris/pull/44396) - Paimon cache has been added to the Catalog, eliminating real-time data queries. [#44911 ](https://github.com/apache/doris/pull/44911) @@ -225,4 +226,4 @@ Dear community members, the Apache Doris 3.0.4 version was officially released o - When granting `CREATE_PRIV`, the existence of the corresponding resource is no longer checked. [#45125](https://github.com/apache/doris/pull/45125) - Fixed the issue where queries on views with permissions could fail due to missing permissions for referenced tables in extreme scenarios. [#44621](https://github.com/apache/doris/pull/44621) -- Resolved the issue where permission checks for `use db` did not distinguish between internal and external Catalogs. [#45720](https://github.com/apache/doris/pull/45720) \ No newline at end of file +- Resolved the issue where permission checks for `use db` did not distinguish between internal and external Catalogs. [#45720](https://github.com/apache/doris/pull/45720) diff --git a/versioned_docs/version-3.0/releasenotes/v2.1/release-2.1.8.md b/versioned_docs/version-3.0/releasenotes/v2.1/release-2.1.8.md index 525675897294e..c00a31a73c114 100644 --- a/versioned_docs/version-3.0/releasenotes/v2.1/release-2.1.8.md +++ b/versioned_docs/version-3.0/releasenotes/v2.1/release-2.1.8.md @@ -32,6 +32,7 @@ Dear Community, **Apache Doris version 2.1.8 was officially released on January ## Behavior Changes +- When querying a data source with case-insensitive table names (such as Hive) through External Catalog, in previous versions, you can use any case to query the table name, but in version 2.1.8, Doris's own table name case sensitivity policy will be strictly followed. - Add the environment variable `SKIP_CHECK_ULIMIT` to skip the ulimit value verification check within the BE process. This is only available to applications in the Docker quick start scenario. [#45267](https://github.com/apache/doris/pull/45267) - Add the `enable_cooldown_replica_affinity` session variable to control the selection of replica affinity for queries under cold - hot separation. - In FE, add the configurations `restore_job_compressed_serialization` and `backup_job_compressed_serialization` to solve the OOM problem of FE during backup and restore operations when the number of db tablets is extremely large. By default, these configurations are disabled, and once enabled, they cannot be downgraded. @@ -183,4 +184,4 @@ Dear Community, **Apache Doris version 2.1.8 was officially released on January ### Others -- Fix the potential memory leak problem when `enable_jvm_monitor=true` is enabled on the BE side [#44311](https://github.com/apache/doris/pull/44311). \ No newline at end of file +- Fix the potential memory leak problem when `enable_jvm_monitor=true` is enabled on the BE side [#44311](https://github.com/apache/doris/pull/44311). diff --git a/versioned_docs/version-3.0/releasenotes/v3.0/release-3.0.4.md b/versioned_docs/version-3.0/releasenotes/v3.0/release-3.0.4.md index 261108f867bb3..43c3effe652ea 100644 --- a/versioned_docs/version-3.0/releasenotes/v3.0/release-3.0.4.md +++ b/versioned_docs/version-3.0/releasenotes/v3.0/release-3.0.4.md @@ -39,6 +39,7 @@ Dear community members, the Apache Doris 3.0.4 version was officially released o - For more information, please refer to documentation: [Export Overview - Apache Doris](https://doris.apache.org/docs/3.0/data-operate/export/export-overview) +- When querying a data source with case-insensitive table names (such as Hive) through External Catalog, in previous versions, you can use any case to query the table name, but in version 3.0.4, Doris's own table name case sensitivity policy will be strictly followed. - The Hudi JNI Scanner has been replaced from Spark API to Hadoop API to enhance compatibility. Users can switch by setting the session variable `set hudi_jni_scanner=spark/hadoop`. [#44396](https://github.com/apache/doris/pull/44396) - The use of `auto bucket` in Colocate tables is prohibited. [#44396](https://github.com/apache/doris/pull/44396) - Paimon cache has been added to the Catalog, eliminating real-time data queries. [#44911 ](https://github.com/apache/doris/pull/44911) @@ -225,4 +226,4 @@ Dear community members, the Apache Doris 3.0.4 version was officially released o - When granting `CREATE_PRIV`, the existence of the corresponding resource is no longer checked. [#45125](https://github.com/apache/doris/pull/45125) - Fixed the issue where queries on views with permissions could fail due to missing permissions for referenced tables in extreme scenarios. [#44621](https://github.com/apache/doris/pull/44621) -- Resolved the issue where permission checks for `use db` did not distinguish between internal and external Catalogs. [#45720](https://github.com/apache/doris/pull/45720) \ No newline at end of file +- Resolved the issue where permission checks for `use db` did not distinguish between internal and external Catalogs. [#45720](https://github.com/apache/doris/pull/45720)