[Enhancement] support setting auto_min_buckets seperately for each table in dynamic partition

[Elijah-Liu]

Search before asking

• I had searched in the issues and found no similar issues.

Description

In dynamic partitioning, there is a global property auto_min_buckets. We want to set this property individually for each table.

The reason is that our log tables are divided into large and small tables. If auto_min_buckets is set too high, it will lead to excessive partitioning for small tables, even when they contain very little data.

But setting it too low also causes issues because our large log tables receive a high volume of data from Monday to Friday but much less on weekends. This results in too few partitions being created on Mondays, which negatively impacts query performance.

Solution

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct