Fix an exception when create and drop a table with the same name multiple times

[zcoo]

Purpose

Linked issue: close #712

Brief change log

Drop table's all partitions when coordinator listens a partitioned table dropped.

Tests

API and Format

Documentation

[wuchong]

I think there are issues with the current fix.

When deleting tables/t1, its child partitions, such as tables/t1/partitions/p1, should also be deleted automatically. There should be no need to explicitly and additionally delete the partition directories.

In my opinion, the root cause here is that after ZooKeeper deletes tables/t1, the AutoPartitionManager is triggered and recreates the partitions (with the old table ID). This results in an exception when attempting to recreate the table.

The solution is straightforward: before dropping the table, the AutoPartitionManager should unregister the table id first.

With the current fix, which deletes partitions in the processDropTableEvent, may lead to the deletion of partitions belonging to the new table, potentially causing data loss.

cc @luoyuxia

[zcoo]

@wuchong I think your solution may be inconsistent with current code implement.

Here is the original code logic:

Step 1. Create Table 1 (only created on zk node without adding to AutoPartitionManager)
Step 2. Delete Table 1 (only dropped on zk node)
Step 3. zk table creation is being monitored and the table creation request is added to the CoordinatorEventProcessor request queue
Step 4. The zk deletion table is being monitored and the deletion request is added to the CoordinatorEventProcessor request queue
Step 5. CoordinatorEventProcessor queue executes table creation request, AutoPartitionManager adds the table zk, creates table partition nodes
Step 6. CoordinatEventProcessor queue executes droping a table, but only unregister for table 1 from AutoPartitionManager without deleting the table partition node, resulting in the retention of the zk table partition node

"The solution is straightforward: before dropping the table, the AutoPartitionManager should unregister the table id first."
So this solution doesn't work because before Step 2, the Table 1 haven't been register from AutoPartitionManager.