dumpling: improve string key handling, streaming process with chunking#62172

Open

takaidohigasi wants to merge 72 commits into

pingcap:masterfrom

takaidohigasi:improve-string-key-handling

Commits on Sep 5, 2025

[pingcap/tidb#61999] improve dumpling string key handling
takaidohigasi
committed
remove unused adaptive chunking function
takaidohigasi
committed
fix: enable chunk progress tracking for streaming string key chunking

takaidohigasi
and
claude
committed
disable ROW_NUMBER() implementation
takaidohigasi
committed
add unit tests and integration tests

takaidohigasi
and
claude
committed
implement buffering strategy for string chunking to enable concatenable INSERT statements
takaidohigasi
committed
fix: use standard SQL escaping in composite string key test

takaidohigasi
and
claude
committed
fix: update test expectation to match standard SQL escaping behavior

takaidohigasi
and
claude
committed
docs: clarify escapeSQLString is for internal queries only

takaidohigasi
and
claude
committed
fix: update Unicode test expectation for standard SQL escaping mode

takaidohigasi
and
claude
committed
revert: restore default dumpling escaping behavior in tests

takaidohigasi
and
claude
committed
fix: correct test expectation to match actual dumpling quote behavior

takaidohigasi
and
claude
committed
fix: correct single quote escaping in test expectation

takaidohigasi
and
claude
committed
fix: update composite string key test to expect escaped double quotes

takaidohigasi
and
claude
committed
fix: configure UTF8MB4 charset for composite string key test

takaidohigasi
and
claude
committed
fix: resolve linting warnings and add charset support

takaidohigasi
and
claude
committed
revert: remove SET NAMES modification for backward compatibility

takaidohigasi
and
claude
committed
style: format Go files with gofmt

takaidohigasi
and
claude
committed
fix: configure UTF8MB4 charset for composite string key test

takaidohigasi
and
claude
committed
fix: implement UTF8MB4 charset detection and SET NAMES output

takaidohigasi
and
claude
committed
revert: remove collation detection code for separate branch

takaidohigasi
and
claude
committed
fix: configure TiDB server charset settings for Unicode test

takaidohigasi
and
claude
committed
fix: restore parameter names in WriteInsert functions

takaidohigasi
and
claude
committed
fix: correct chunking logic for row-based vs string-based modes

takaidohigasi
and
claude
committed
revert: restore original chunking logic

takaidohigasi
and
claude
committed
fix: distinguish string chunking vs row chunking by table name

takaidohigasi
and
claude
committed
Revert "fix: distinguish string chunking vs row chunking by table name"
takaidohigasi
committed
feat: add isStringChunking parameter to WriteInsert functions

takaidohigasi
and
claude
committed
fix: add missing isStringChunking parameter to writer_serial_test.go

takaidohigasi
and
claude
committed
fix: resolve linting issues

takaidohigasi
and
claude
committed
make bazel_prepare
takaidohigasi
committed
delete extra file
takaidohigasi
committed
delete useless logic
takaidohigasi
committed
store isStringChunking to conf
takaidohigasi
committed
remove extra condition
takaidohigasi
committed
fix unused input to _
takaidohigasi
committed
fix chunking for statesize limit
takaidohigasi
committed
fix: resolve INSERT statement duplication in string-based chunking

takaidohigasi
and
claude
committed
refactor: remove unused totalChunks parameter from writer functions

takaidohigasi
and
claude
committed
fix test expectations for removed unused params
takaidohigasi
committed
fix: handle column names containing commas in extractOrderByColumns

takaidohigasi
and
claude
committed
fix format
takaidohigasi
committed
revert failpoint removal
takaidohigasi
committed
fix -r option expectation
takaidohigasi
committed
fix: update composite_string_key test expectations based on actual row counts
takaidohigasi
committed
fix: use * for row estimation with string fields to handle composite keys correctly
takaidohigasi
committed
fix: add fallback to direct COUNT(*) when EXPLAIN returns 0 for string fields
takaidohigasi
committed
fix: add missing empty function parameter to QuerySQL call
takaidohigasi
committed
fix: address gofmt and security linter issues
takaidohigasi
committed

Commits on Apr 24, 2026

Commits on Apr 25, 2026

Commits on May 19, 2026

Merge remote-tracking branch 'upstream/master' into improve-string-key-handling
takaidohigasi
committed