Support max bucket number of a table

[wuchong]

Search before asking

• I searched in the issues and found nothing similar.

Description

See parent issue.

Willingness to contribute

• I'm willing to submit a PR!

[MehulBatra]

@wuchong, if it's not taken, I would love to take a Jab at it. I went through the partition one, and it gives me a sense both must be somewhat identical.

[wuchong]

What should the default max bucket number be? Do you have any ideas cc @MehulBatra @swuferhong

[MehulBatra]

@wuchong @swuferhong
128-256 buckets per table, I went through the multiple data stores docs, and most of them recommended this.
Currently, we can stick to this, later, we can extend it dynamically configurable based on cluster size.
What do you guys think?

[wuchong]

@MehulBatra I think 128–256 is a reasonable range for the suggested number of buckets. However, this value seems too small for the maximum number of buckets. Currently, we use 1000 as the default maximum number of partitions per table. This means that if we only allow a maximum of 128 buckets per partition, the total maximum number of buckets should be 128 * 1000 to align with our overall design.

[MehulBatra]

@wuchong ok, so I will go ahead with 128,000 buckets per table as max-limit.
Do we need to take care of the max bucket limit per partition as well, or for now, are we good with the max limit per table?