Skip to content

Conversation

@bobhan1
Copy link
Contributor

@bobhan1 bobhan1 commented Jun 26, 2024

Proposed changes

Issue Number: close #36638

#30914 add partition tablet sink shuffle and the processing of auto_increment column should be handled on exchange node raher than TabletWriter when using partition tablet sink shuffle.

branch-2.1-pick: #37029

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@bobhan1
Copy link
Contributor Author

bobhan1 commented Jun 26, 2024

run buildall

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

return DecimalType(value);
}

Status OlapTableBlockConvertor::_validate_column(RuntimeState* state, const TypeDescriptor& type,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: function '_validate_column' has cognitive complexity of 336 (threshold 50) [readability-function-cognitive-complexity]

Status OlapTableBlockConvertor::_validate_column(RuntimeState* state, const TypeDescriptor& type,
                                ^
Additional context

be/src/vec/sink/vtablet_block_convertor.cpp:191: +1

    DCHECK((rows == nullptr) || (rows->size() == row_count));
                             ^

be/src/vec/sink/vtablet_block_convertor.cpp:193: nesting level increased to 1

    auto set_invalid_and_append_error_msg = [&](int row) {
                                            ^

be/src/vec/sink/vtablet_block_convertor.cpp:206: +1, including nesting penalty of 0, nesting level increased to 1

    auto& real_column_ptr = column_ptr == nullptr ? column : (column_ptr->get_nested_column_ptr());
                                                  ^

be/src/vec/sink/vtablet_block_convertor.cpp:207: +1, including nesting penalty of 0, nesting level increased to 1

    auto null_map = column_ptr == nullptr ? nullptr : column_ptr->get_null_map_data().data();
                                          ^

be/src/vec/sink/vtablet_block_convertor.cpp:208: nesting level increased to 1

    auto need_to_validate = [&null_map, this](size_t j, size_t row) {
                            ^

be/src/vec/sink/vtablet_block_convertor.cpp:212: nesting level increased to 1

    auto string_column_checker = [&](const ColumnString* column_string) {
                                 ^

be/src/vec/sink/vtablet_block_convertor.cpp:215: +2, including nesting penalty of 1, nesting level increased to 2

        if (type.len > 0) {
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:221: +2, including nesting penalty of 1, nesting level increased to 2

        for (int j = 0; j < row_count; ++j) {
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:225: +2, including nesting penalty of 1, nesting level increased to 2

        if (invalid_count) {
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:226: +3, including nesting penalty of 2, nesting level increased to 3

            for (size_t j = 0; j < row_count; ++j) {
            ^

be/src/vec/sink/vtablet_block_convertor.cpp:227: +4, including nesting penalty of 3, nesting level increased to 4

                auto row = rows ? (*rows)[j] : j;
                                ^

be/src/vec/sink/vtablet_block_convertor.cpp:228: +4, including nesting penalty of 3, nesting level increased to 4

                if (need_to_validate(j, row)) {
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:231: +5, including nesting penalty of 4, nesting level increased to 5

                    if (invalid) {
                    ^

be/src/vec/sink/vtablet_block_convertor.cpp:232: +6, including nesting penalty of 5, nesting level increased to 6

                        if (str_val.size > type.len) {
                        ^

be/src/vec/sink/vtablet_block_convertor.cpp:239: +1, nesting level increased to 6

                        } else if (str_val.size > limit) {
                               ^

be/src/vec/sink/vtablet_block_convertor.cpp:249: +6, including nesting penalty of 5, nesting level increased to 6

                        RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));
                        ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:249: +7, including nesting penalty of 6, nesting level increased to 7

                        RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));
                        ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:257: +1, including nesting penalty of 0, nesting level increased to 1

    switch (type.type) {
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:263: +2, including nesting penalty of 1, nesting level increased to 2

        RETURN_IF_ERROR(string_column_checker(column_string));
        ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:263: +3, including nesting penalty of 2, nesting level increased to 3

        RETURN_IF_ERROR(string_column_checker(column_string));
        ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:269: +2, including nesting penalty of 1, nesting level increased to 2

        for (size_t j = 0; j < row_count; ++j) {
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:270: +3, including nesting penalty of 2, nesting level increased to 3

            if (!_filter_map[j]) {
            ^

be/src/vec/sink/vtablet_block_convertor.cpp:271: +4, including nesting penalty of 3, nesting level increased to 4

                if (is_nullable && column_ptr && column_ptr->is_null_at(j)) {
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:271: +1

                if (is_nullable && column_ptr && column_ptr->is_null_at(j)) {
                                              ^

be/src/vec/sink/vtablet_block_convertor.cpp:276: +4, including nesting penalty of 3, nesting level increased to 4

                if (invalid) {
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:279: +5, including nesting penalty of 4, nesting level increased to 5

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(j));
                    ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:279: +6, including nesting penalty of 5, nesting level increased to 6

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(j));
                    ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:291: +2, including nesting penalty of 1, nesting level increased to 2

        for (size_t j = 0; j < row_count; ++j) {
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:292: +3, including nesting penalty of 2, nesting level increased to 3

            auto row = rows ? (*rows)[j] : j;
                            ^

be/src/vec/sink/vtablet_block_convertor.cpp:293: +3, including nesting penalty of 2, nesting level increased to 3

            if (need_to_validate(j, row)) {
            ^

be/src/vec/sink/vtablet_block_convertor.cpp:298: +4, including nesting penalty of 3, nesting level increased to 4

                if (dec_val.greater_than_scale(type.scale)) {
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:302: +5, including nesting penalty of 4, nesting level increased to 5

                    if (code != E_DEC_OK) {
                    ^

be/src/vec/sink/vtablet_block_convertor.cpp:308: +4, including nesting penalty of 3, nesting level increased to 4

                if (dec_val > max_decimalv2 || dec_val < min_decimalv2) {
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:308: +1

                if (dec_val > max_decimalv2 || dec_val < min_decimalv2) {
                                            ^

be/src/vec/sink/vtablet_block_convertor.cpp:318: +4, including nesting penalty of 3, nesting level increased to 4

                if (invalid) {
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:319: +5, including nesting penalty of 4, nesting level increased to 5

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));
                    ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:319: +6, including nesting penalty of 5, nesting level increased to 6

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));
                    ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:357: +2, including nesting penalty of 1, nesting level increased to 2

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal32);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:333: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

    for (int j = 0; j < row_count; ++j) {                                                         \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:357: +1

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal32);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:335: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

        invalid_count += dec_val > max_decimal || dec_val < min_decimal;                          \
                                               ^

be/src/vec/sink/vtablet_block_convertor.cpp:357: +2, including nesting penalty of 1, nesting level increased to 2

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal32);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:337: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

    if (invalid_count) {                                                                          \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:357: +3, including nesting penalty of 2, nesting level increased to 3

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal32);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:338: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

        for (size_t j = 0; j < row_count; ++j) {                                                  \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:357: +4, including nesting penalty of 3, nesting level increased to 4

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal32);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:339: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

            auto row = rows ? (*rows)[j] : j;                                                     \
                            ^

be/src/vec/sink/vtablet_block_convertor.cpp:357: +4, including nesting penalty of 3, nesting level increased to 4

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal32);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:340: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

            if (need_to_validate(j, row)) {                                                       \
            ^

be/src/vec/sink/vtablet_block_convertor.cpp:357: +5, including nesting penalty of 4, nesting level increased to 5

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal32);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:343: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (dec_val > max_decimal || dec_val < min_decimal) {                             \
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:357: +1

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal32);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:343: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (dec_val > max_decimal || dec_val < min_decimal) {                             \
                                          ^

be/src/vec/sink/vtablet_block_convertor.cpp:357: +5, including nesting penalty of 4, nesting level increased to 5

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal32);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:351: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (invalid) {                                                                    \
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:357: +6, including nesting penalty of 5, nesting level increased to 6

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal32);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:352: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));                       \
                    ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:357: +7, including nesting penalty of 6, nesting level increased to 7

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal32);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:352: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));                       \
                    ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:361: +2, including nesting penalty of 1, nesting level increased to 2

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal64);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:333: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

    for (int j = 0; j < row_count; ++j) {                                                         \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:361: +1

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal64);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:335: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

        invalid_count += dec_val > max_decimal || dec_val < min_decimal;                          \
                                               ^

be/src/vec/sink/vtablet_block_convertor.cpp:361: +2, including nesting penalty of 1, nesting level increased to 2

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal64);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:337: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

    if (invalid_count) {                                                                          \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:361: +3, including nesting penalty of 2, nesting level increased to 3

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal64);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:338: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

        for (size_t j = 0; j < row_count; ++j) {                                                  \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:361: +4, including nesting penalty of 3, nesting level increased to 4

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal64);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:339: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

            auto row = rows ? (*rows)[j] : j;                                                     \
                            ^

be/src/vec/sink/vtablet_block_convertor.cpp:361: +4, including nesting penalty of 3, nesting level increased to 4

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal64);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:340: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

            if (need_to_validate(j, row)) {                                                       \
            ^

be/src/vec/sink/vtablet_block_convertor.cpp:361: +5, including nesting penalty of 4, nesting level increased to 5

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal64);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:343: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (dec_val > max_decimal || dec_val < min_decimal) {                             \
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:361: +1

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal64);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:343: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (dec_val > max_decimal || dec_val < min_decimal) {                             \
                                          ^

be/src/vec/sink/vtablet_block_convertor.cpp:361: +5, including nesting penalty of 4, nesting level increased to 5

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal64);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:351: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (invalid) {                                                                    \
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:361: +6, including nesting penalty of 5, nesting level increased to 6

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal64);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:352: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));                       \
                    ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:361: +7, including nesting penalty of 6, nesting level increased to 7

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal64);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:352: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));                       \
                    ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:365: +2, including nesting penalty of 1, nesting level increased to 2

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal128V3);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:333: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

    for (int j = 0; j < row_count; ++j) {                                                         \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:365: +1

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal128V3);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:335: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

        invalid_count += dec_val > max_decimal || dec_val < min_decimal;                          \
                                               ^

be/src/vec/sink/vtablet_block_convertor.cpp:365: +2, including nesting penalty of 1, nesting level increased to 2

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal128V3);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:337: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

    if (invalid_count) {                                                                          \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:365: +3, including nesting penalty of 2, nesting level increased to 3

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal128V3);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:338: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

        for (size_t j = 0; j < row_count; ++j) {                                                  \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:365: +4, including nesting penalty of 3, nesting level increased to 4

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal128V3);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:339: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

            auto row = rows ? (*rows)[j] : j;                                                     \
                            ^

be/src/vec/sink/vtablet_block_convertor.cpp:365: +4, including nesting penalty of 3, nesting level increased to 4

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal128V3);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:340: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

            if (need_to_validate(j, row)) {                                                       \
            ^

be/src/vec/sink/vtablet_block_convertor.cpp:365: +5, including nesting penalty of 4, nesting level increased to 5

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal128V3);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:343: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (dec_val > max_decimal || dec_val < min_decimal) {                             \
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:365: +1

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal128V3);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:343: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (dec_val > max_decimal || dec_val < min_decimal) {                             \
                                          ^

be/src/vec/sink/vtablet_block_convertor.cpp:365: +5, including nesting penalty of 4, nesting level increased to 5

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal128V3);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:351: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (invalid) {                                                                    \
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:365: +6, including nesting penalty of 5, nesting level increased to 6

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal128V3);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:352: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));                       \
                    ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:365: +7, including nesting penalty of 6, nesting level increased to 7

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal128V3);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:352: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));                       \
                    ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:369: +2, including nesting penalty of 1, nesting level increased to 2

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal256);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:333: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

    for (int j = 0; j < row_count; ++j) {                                                         \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:369: +1

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal256);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:335: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

        invalid_count += dec_val > max_decimal || dec_val < min_decimal;                          \
                                               ^

be/src/vec/sink/vtablet_block_convertor.cpp:369: +2, including nesting penalty of 1, nesting level increased to 2

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal256);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:337: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

    if (invalid_count) {                                                                          \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:369: +3, including nesting penalty of 2, nesting level increased to 3

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal256);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:338: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

        for (size_t j = 0; j < row_count; ++j) {                                                  \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:369: +4, including nesting penalty of 3, nesting level increased to 4

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal256);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:339: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

            auto row = rows ? (*rows)[j] : j;                                                     \
                            ^

be/src/vec/sink/vtablet_block_convertor.cpp:369: +4, including nesting penalty of 3, nesting level increased to 4

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal256);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:340: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

            if (need_to_validate(j, row)) {                                                       \
            ^

be/src/vec/sink/vtablet_block_convertor.cpp:369: +5, including nesting penalty of 4, nesting level increased to 5

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal256);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:343: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (dec_val > max_decimal || dec_val < min_decimal) {                             \
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:369: +1

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal256);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:343: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (dec_val > max_decimal || dec_val < min_decimal) {                             \
                                          ^

be/src/vec/sink/vtablet_block_convertor.cpp:369: +5, including nesting penalty of 4, nesting level increased to 5

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal256);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:351: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                if (invalid) {                                                                    \
                ^

be/src/vec/sink/vtablet_block_convertor.cpp:369: +6, including nesting penalty of 5, nesting level increased to 6

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal256);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:352: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));                       \
                    ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:369: +7, including nesting penalty of 6, nesting level increased to 7

        CHECK_VALIDATION_FOR_DECIMALV3(vectorized::Decimal256);
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:352: expanded from macro 'CHECK_VALIDATION_FOR_DECIMALV3'

                    RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));                       \
                    ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:380: +2, including nesting penalty of 1, nesting level increased to 2

        for (size_t r = 0; r < row_count; ++r) {
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:381: +3, including nesting penalty of 2, nesting level increased to 3

            for (size_t c = offsets[r - 1]; c < offsets[r]; ++c) {
            ^

be/src/vec/sink/vtablet_block_convertor.cpp:386: +2, including nesting penalty of 1, nesting level increased to 2

        RETURN_IF_ERROR(_validate_column(state, nested_type, type.contains_nulls[0], false,
        ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:386: +3, including nesting penalty of 2, nesting level increased to 3

        RETURN_IF_ERROR(_validate_column(state, nested_type, type.contains_nulls[0], false,
        ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:398: +2, including nesting penalty of 1, nesting level increased to 2

        for (size_t r = 0; r < row_count; ++r) {
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:399: +3, including nesting penalty of 2, nesting level increased to 3

            for (size_t c = offsets[r - 1]; c < offsets[r]; ++c) {
            ^

be/src/vec/sink/vtablet_block_convertor.cpp:404: +2, including nesting penalty of 1, nesting level increased to 2

        RETURN_IF_ERROR(_validate_column(state, key_type, type.contains_nulls[0], false,
        ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:404: +3, including nesting penalty of 2, nesting level increased to 3

        RETURN_IF_ERROR(_validate_column(state, key_type, type.contains_nulls[0], false,
        ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:407: +2, including nesting penalty of 1, nesting level increased to 2

        RETURN_IF_ERROR(_validate_column(state, val_type, type.contains_nulls[1], false,
        ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:407: +3, including nesting penalty of 2, nesting level increased to 3

        RETURN_IF_ERROR(_validate_column(state, val_type, type.contains_nulls[1], false,
        ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:417: +2, including nesting penalty of 1, nesting level increased to 2

        for (size_t sc = 0; sc < column_struct->tuple_size(); ++sc) {
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:418: +3, including nesting penalty of 2, nesting level increased to 3

            RETURN_IF_ERROR(_validate_column(state, type.children[sc], type.contains_nulls[sc],
            ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:418: +4, including nesting penalty of 3, nesting level increased to 4

            RETURN_IF_ERROR(_validate_column(state, type.children[sc], type.contains_nulls[sc],
            ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:427: +2, including nesting penalty of 1, nesting level increased to 2

        if (column_string) {
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:428: +3, including nesting penalty of 2, nesting level increased to 3

            RETURN_IF_ERROR(string_column_checker(column_string));
            ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:428: +4, including nesting penalty of 3, nesting level increased to 4

            RETURN_IF_ERROR(string_column_checker(column_string));
            ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:440: +1, including nesting penalty of 0, nesting level increased to 1

    if ((!is_nullable || type == TYPE_OBJECT) && column_ptr && !is_auto_inc) {
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:440: +1

    if ((!is_nullable || type == TYPE_OBJECT) && column_ptr && !is_auto_inc) {
                                                            ^

be/src/vec/sink/vtablet_block_convertor.cpp:440: +1

    if ((!is_nullable || type == TYPE_OBJECT) && column_ptr && !is_auto_inc) {
                      ^

be/src/vec/sink/vtablet_block_convertor.cpp:441: +2, including nesting penalty of 1, nesting level increased to 2

        for (int j = 0; j < row_count; ++j) {
        ^

be/src/vec/sink/vtablet_block_convertor.cpp:442: +3, including nesting penalty of 2, nesting level increased to 3

            auto row = rows ? (*rows)[j] : j;
                            ^

be/src/vec/sink/vtablet_block_convertor.cpp:443: +3, including nesting penalty of 2, nesting level increased to 3

            if (null_map[j] && !_filter_map[row]) {
            ^

be/src/vec/sink/vtablet_block_convertor.cpp:446: +4, including nesting penalty of 3, nesting level increased to 4

                RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));
                ^

be/src/common/status.h:626: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/vec/sink/vtablet_block_convertor.cpp:446: +5, including nesting penalty of 4, nesting level increased to 5

                RETURN_IF_ERROR(set_invalid_and_append_error_msg(row));
                ^

be/src/common/status.h:628: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

@doris-robot
Copy link

TPC-H: Total hot run time: 39641 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b62d39ae0674eab19518af785b67f4fc36d3cd6f, data reload: false

------ Round 1 ----------------------------------
q1	17601	4362	4264	4264
q2	1998	186	182	182
q3	10482	1073	1013	1013
q4	10180	749	769	749
q5	7471	2648	2595	2595
q6	217	134	135	134
q7	937	591	603	591
q8	9223	2059	2033	2033
q9	8882	6464	6443	6443
q10	8954	3657	3716	3657
q11	463	241	236	236
q12	472	223	225	223
q13	18059	2991	2956	2956
q14	263	217	225	217
q15	499	475	480	475
q16	481	382	373	373
q17	959	706	699	699
q18	7942	7480	7498	7480
q19	7955	1424	1434	1424
q20	644	318	306	306
q21	4962	3251	3845	3251
q22	395	340	343	340
Total cold run time: 119039 ms
Total hot run time: 39641 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4459	4313	4317	4313
q2	370	270	266	266
q3	3053	2977	2966	2966
q4	2005	1779	1773	1773
q5	5556	5514	5522	5514
q6	228	132	134	132
q7	2315	1870	1882	1870
q8	3326	3474	3474	3474
q9	8964	9059	8929	8929
q10	4292	3931	3982	3931
q11	636	533	519	519
q12	829	655	705	655
q13	16858	3149	3140	3140
q14	312	291	277	277
q15	549	515	508	508
q16	501	466	458	458
q17	1818	1559	1547	1547
q18	8143	7981	7753	7753
q19	1805	1711	1606	1606
q20	2968	1868	1900	1868
q21	12453	4855	4721	4721
q22	646	571	552	552
Total cold run time: 82086 ms
Total hot run time: 56772 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 170474 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b62d39ae0674eab19518af785b67f4fc36d3cd6f, data reload: false

query1	941	396	389	389
query2	6440	2469	2366	2366
query3	6630	211	202	202
query4	18736	17338	17129	17129
query5	3561	462	459	459
query6	233	155	151	151
query7	4588	301	290	290
query8	312	291	301	291
query9	8458	2465	2443	2443
query10	550	304	276	276
query11	10440	9978	9869	9869
query12	112	83	80	80
query13	1639	374	395	374
query14	10287	6273	7759	6273
query15	239	188	179	179
query16	7743	275	256	256
query17	1908	538	530	530
query18	1946	277	267	267
query19	201	150	159	150
query20	85	83	80	80
query21	212	144	126	126
query22	4383	4126	3948	3948
query23	33750	33721	33767	33721
query24	10626	2871	2923	2871
query25	595	372	365	365
query26	714	151	154	151
query27	2292	333	320	320
query28	6173	2176	2167	2167
query29	899	643	664	643
query30	265	155	157	155
query31	983	773	770	770
query32	100	60	55	55
query33	677	327	277	277
query34	889	465	489	465
query35	750	651	640	640
query36	1129	969	975	969
query37	140	72	70	70
query38	2992	2862	2842	2842
query39	910	839	825	825
query40	226	132	127	127
query41	53	53	55	53
query42	111	99	100	99
query43	587	578	550	550
query44	1096	726	722	722
query45	190	160	164	160
query46	1083	742	727	727
query47	1852	1794	1755	1755
query48	381	320	293	293
query49	834	416	414	414
query50	790	393	384	384
query51	6906	6753	6811	6753
query52	103	93	91	91
query53	366	298	290	290
query54	900	438	435	435
query55	72	72	74	72
query56	278	269	261	261
query57	1119	1051	1037	1037
query58	249	250	242	242
query59	3470	3538	3169	3169
query60	297	271	281	271
query61	96	95	96	95
query62	614	428	452	428
query63	322	295	290	290
query64	8581	2303	1748	1748
query65	3144	3119	3116	3116
query66	746	326	325	325
query67	15553	15178	14913	14913
query68	6815	546	537	537
query69	629	467	412	412
query70	1243	1130	1115	1115
query71	499	278	281	278
query72	7644	4813	2705	2705
query73	797	321	323	321
query74	5764	5466	5458	5458
query75	4028	2676	2671	2671
query76	3930	988	915	915
query77	682	305	303	303
query78	10234	9927	9776	9776
query79	1790	507	506	506
query80	771	458	470	458
query81	555	223	219	219
query82	769	105	97	97
query83	190	231	167	167
query84	236	88	84	84
query85	1159	285	271	271
query86	470	316	314	314
query87	3305	3080	3069	3069
query88	3297	2466	2466	2466
query89	490	385	392	385
query90	1700	206	195	195
query91	127	100	104	100
query92	58	50	49	49
query93	1789	508	501	501
query94	969	192	188	188
query95	391	312	313	312
query96	604	268	270	268
query97	3214	3051	3041	3041
query98	220	198	195	195
query99	1156	844	848	844
Total cold run time: 269072 ms
Total hot run time: 170474 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.64 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b62d39ae0674eab19518af785b67f4fc36d3cd6f, data reload: false

query1	0.04	0.03	0.04
query2	0.08	0.04	0.04
query3	0.22	0.04	0.05
query4	1.67	0.09	0.07
query5	0.50	0.50	0.47
query6	1.13	0.73	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.54	0.50	0.48
query10	0.54	0.54	0.54
query11	0.14	0.10	0.11
query12	0.14	0.12	0.13
query13	0.59	0.58	0.59
query14	0.76	0.76	0.82
query15	0.81	0.79	0.81
query16	0.37	0.37	0.38
query17	0.99	1.02	1.00
query18	0.21	0.25	0.23
query19	1.90	1.75	1.68
query20	0.02	0.01	0.01
query21	15.48	0.65	0.64
query22	4.03	7.00	2.07
query23	18.32	1.41	1.27
query24	2.10	0.22	0.22
query25	0.16	0.09	0.08
query26	0.26	0.18	0.18
query27	0.07	0.07	0.09
query28	13.28	1.00	0.99
query29	12.64	3.30	3.29
query30	0.25	0.06	0.06
query31	2.87	0.41	0.38
query32	3.27	0.46	0.47
query33	2.92	2.89	2.88
query34	17.08	4.42	4.39
query35	4.49	4.52	4.52
query36	0.65	0.48	0.47
query37	0.18	0.16	0.16
query38	0.16	0.14	0.14
query39	0.04	0.04	0.04
query40	0.17	0.14	0.14
query41	0.10	0.04	0.05
query42	0.05	0.04	0.05
query43	0.05	0.03	0.04
Total cold run time: 109.34 s
Total hot run time: 30.64 s

@bobhan1 bobhan1 changed the title [Fix](autoinc) Skip to check and convert the nullability of auto_increment column in OlapTableBlockConvertor [Fix](autoinc) Hanlde the processing of auto_increment column on exchange node rather than on TabletWriter when using TABLET_SINK_SHUFFLE_PARTITIONED Jun 26, 2024
@bobhan1
Copy link
Contributor Author

bobhan1 commented Jun 26, 2024

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

1 similar comment
@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@bobhan1
Copy link
Contributor Author

bobhan1 commented Jun 26, 2024

run performance

@doris-robot
Copy link

TPC-H: Total hot run time: 40646 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 24aaa359a624e872c244446de373f310a4485923, data reload: false

------ Round 1 ----------------------------------
q1	18174	4601	4442	4442
q2	2155	184	188	184
q3	10509	1091	1151	1091
q4	10182	757	819	757
q5	7452	2641	2649	2641
q6	223	133	131	131
q7	944	619	613	613
q8	9233	2081	2065	2065
q9	8824	6507	6483	6483
q10	8914	3724	3760	3724
q11	484	243	241	241
q12	442	227	222	222
q13	17769	2954	2956	2954
q14	274	214	216	214
q15	524	481	477	477
q16	491	371	370	370
q17	963	619	720	619
q18	8100	7584	7379	7379
q19	6159	1533	1560	1533
q20	661	340	339	339
q21	5005	3829	3906	3829
q22	386	338	343	338
Total cold run time: 117868 ms
Total hot run time: 40646 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4489	4248	4266	4248
q2	371	263	262	262
q3	2973	2763	2775	2763
q4	1886	1610	1593	1593
q5	5266	5281	5305	5281
q6	219	126	130	126
q7	2134	1764	1787	1764
q8	3198	3330	3338	3330
q9	8308	8372	8312	8312
q10	3867	3669	3666	3666
q11	569	497	490	490
q12	786	589	594	589
q13	16589	2991	2966	2966
q14	302	261	255	255
q15	515	465	493	465
q16	479	405	402	402
q17	1782	1499	1499	1499
q18	7570	7544	7538	7538
q19	1764	1634	1562	1562
q20	1985	1779	1770	1770
q21	4846	4740	4664	4664
q22	608	565	527	527
Total cold run time: 70506 ms
Total hot run time: 54072 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 173205 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 24aaa359a624e872c244446de373f310a4485923, data reload: false

query1	905	371	381	371
query2	6452	2356	2232	2232
query3	6647	197	196	196
query4	20340	17314	17364	17314
query5	4147	484	517	484
query6	254	180	161	161
query7	4582	302	292	292
query8	324	327	289	289
query9	8590	2447	2455	2447
query10	591	298	283	283
query11	10531	10095	10081	10081
query12	125	89	81	81
query13	1642	362	376	362
query14	9852	7693	7364	7364
query15	228	194	181	181
query16	7821	259	264	259
query17	1923	525	521	521
query18	1967	276	276	276
query19	206	156	154	154
query20	90	83	84	83
query21	208	131	124	124
query22	4135	4072	3882	3882
query23	33754	32988	33096	32988
query24	11959	2838	2812	2812
query25	669	357	355	355
query26	1770	149	153	149
query27	2912	312	320	312
query28	7626	2068	2066	2066
query29	1140	617	599	599
query30	279	147	151	147
query31	1012	711	740	711
query32	91	51	51	51
query33	758	283	274	274
query34	964	459	458	458
query35	757	635	596	596
query36	1114	951	928	928
query37	287	69	72	69
query38	2933	2742	2766	2742
query39	865	807	801	801
query40	294	123	125	123
query41	54	54	57	54
query42	118	103	101	101
query43	573	526	544	526
query44	1219	739	735	735
query45	189	165	160	160
query46	1103	721	735	721
query47	1862	1767	1762	1762
query48	368	309	295	295
query49	1200	404	417	404
query50	765	384	394	384
query51	6866	6739	6795	6739
query52	103	97	92	92
query53	357	285	287	285
query54	958	454	446	446
query55	79	73	71	71
query56	292	254	254	254
query57	1138	1067	1056	1056
query58	247	244	241	241
query59	3325	3236	3266	3236
query60	286	265	286	265
query61	113	134	93	93
query62	651	442	467	442
query63	320	283	284	283
query64	9783	2261	1739	1739
query65	3199	3105	3100	3100
query66	1375	332	324	324
query67	15413	15138	14783	14783
query68	4605	555	554	554
query69	463	340	314	314
query70	1190	1108	1181	1108
query71	397	272	279	272
query72	6991	5554	5713	5554
query73	746	327	324	324
query74	5962	5530	5471	5471
query75	3342	2704	2690	2690
query76	2755	996	950	950
query77	448	288	300	288
query78	10432	9845	9729	9729
query79	1609	534	518	518
query80	1909	465	473	465
query81	576	219	216	216
query82	798	100	101	100
query83	281	162	168	162
query84	269	92	86	86
query85	1377	292	272	272
query86	465	323	330	323
query87	3228	3104	3088	3088
query88	3628	2455	2433	2433
query89	482	379	395	379
query90	1832	195	195	195
query91	138	115	111	111
query92	64	51	51	51
query93	1721	515	506	506
query94	1185	203	200	200
query95	422	337	327	327
query96	599	273	275	273
query97	3226	3013	3021	3013
query98	224	208	199	199
query99	1255	846	825	825
Total cold run time: 275319 ms
Total hot run time: 173205 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.8 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 24aaa359a624e872c244446de373f310a4485923, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.04
query4	1.68	0.09	0.08
query5	0.50	0.50	0.50
query6	1.14	0.73	0.74
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.53	0.49	0.48
query10	0.54	0.53	0.56
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.60	0.60	0.61
query14	0.75	0.79	0.79
query15	0.87	0.83	0.84
query16	0.37	0.38	0.37
query17	1.06	1.04	0.99
query18	0.25	0.21	0.26
query19	1.91	1.82	1.82
query20	0.01	0.00	0.00
query21	15.46	0.65	0.65
query22	3.27	8.12	1.89
query23	18.28	1.37	1.34
query24	2.16	0.22	0.22
query25	0.14	0.09	0.08
query26	0.26	0.18	0.17
query27	0.08	0.08	0.08
query28	13.22	1.05	1.00
query29	12.60	3.36	3.26
query30	0.26	0.06	0.06
query31	2.85	0.40	0.40
query32	3.26	0.49	0.49
query33	2.91	2.85	2.86
query34	17.29	4.51	4.40
query35	4.51	4.51	4.54
query36	0.65	0.49	0.49
query37	0.19	0.15	0.15
query38	0.15	0.15	0.15
query39	0.05	0.03	0.04
query40	0.17	0.14	0.14
query41	0.09	0.04	0.04
query42	0.06	0.04	0.05
query43	0.04	0.04	0.04
Total cold run time: 108.87 s
Total hot run time: 30.8 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Jun 26, 2024

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39646 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f3def72ff0329c62b95587297baf35439428b77f, data reload: false

------ Round 1 ----------------------------------
q1	17985	4714	4346	4346
q2	2626	196	207	196
q3	11233	1174	1109	1109
q4	10794	789	808	789
q5	7517	2708	2627	2627
q6	224	139	135	135
q7	966	610	623	610
q8	9600	2097	2063	2063
q9	8987	6436	6438	6436
q10	8930	3702	3710	3702
q11	454	231	238	231
q12	449	225	222	222
q13	17767	2972	2974	2972
q14	257	223	222	222
q15	510	470	467	467
q16	499	368	372	368
q17	952	633	683	633
q18	8085	7382	7486	7382
q19	3285	1341	1519	1341
q20	635	320	340	320
q21	4900	3138	3253	3138
q22	384	337	341	337
Total cold run time: 117039 ms
Total hot run time: 39646 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4317	4217	4196	4196
q2	379	268	278	268
q3	2976	2709	2691	2691
q4	1870	1569	1596	1569
q5	5229	5233	5240	5233
q6	215	126	130	126
q7	2074	1763	1663	1663
q8	3173	3339	3313	3313
q9	8353	8324	8313	8313
q10	3843	3643	3675	3643
q11	572	492	492	492
q12	794	647	599	599
q13	16594	2981	2970	2970
q14	305	263	259	259
q15	525	479	489	479
q16	470	430	415	415
q17	1765	1481	1477	1477
q18	7801	7573	7397	7397
q19	2092	1521	1598	1521
q20	1970	1788	1768	1768
q21	4825	4551	4790	4551
q22	607	566	567	566
Total cold run time: 70749 ms
Total hot run time: 53509 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 174096 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f3def72ff0329c62b95587297baf35439428b77f, data reload: false

query1	922	377	375	375
query2	6468	2418	2372	2372
query3	6648	205	214	205
query4	19163	17523	17345	17345
query5	4247	486	492	486
query6	296	169	180	169
query7	4601	300	294	294
query8	321	307	290	290
query9	8582	2477	2462	2462
query10	628	313	299	299
query11	10510	9997	9995	9995
query12	142	89	86	86
query13	1641	373	362	362
query14	10307	7682	7526	7526
query15	266	192	190	190
query16	8153	281	285	281
query17	1861	573	540	540
query18	2065	293	284	284
query19	263	158	162	158
query20	93	84	82	82
query21	215	133	127	127
query22	4164	4008	3965	3965
query23	33979	33177	33104	33104
query24	10670	2804	2835	2804
query25	650	384	387	384
query26	1291	166	164	164
query27	2842	319	327	319
query28	7224	2090	2090	2090
query29	880	655	629	629
query30	304	161	154	154
query31	952	726	774	726
query32	94	54	58	54
query33	784	328	298	298
query34	930	474	465	465
query35	760	678	624	624
query36	1085	970	936	936
query37	156	76	71	71
query38	2889	2791	2747	2747
query39	871	815	793	793
query40	222	134	128	128
query41	58	57	53	53
query42	130	106	109	106
query43	625	543	541	541
query44	1218	738	726	726
query45	197	169	165	165
query46	1170	730	702	702
query47	1832	1746	1782	1746
query48	380	300	308	300
query49	1068	415	401	401
query50	773	390	400	390
query51	7049	6755	6908	6755
query52	100	93	94	93
query53	369	297	295	295
query54	874	444	438	438
query55	73	74	74	74
query56	276	254	285	254
query57	1136	1050	1039	1039
query58	273	244	254	244
query59	3614	3143	3369	3143
query60	301	294	295	294
query61	97	97	99	97
query62	640	438	445	438
query63	323	287	284	284
query64	9198	2289	1746	1746
query65	3157	3108	3112	3108
query66	957	338	337	337
query67	15593	14934	15249	14934
query68	6447	546	555	546
query69	747	544	463	463
query70	1235	1156	1070	1070
query71	471	283	285	283
query72	9363	5746	5402	5402
query73	791	337	330	330
query74	5901	5504	5491	5491
query75	4910	2669	2664	2664
query76	4044	944	883	883
query77	769	302	290	290
query78	10579	9797	9809	9797
query79	4605	528	520	520
query80	2685	483	483	483
query81	543	226	225	225
query82	1095	110	102	102
query83	307	227	170	170
query84	269	88	91	88
query85	1357	290	281	281
query86	452	323	329	323
query87	3351	3079	3140	3079
query88	4784	2454	2476	2454
query89	504	376	387	376
query90	1888	187	193	187
query91	133	102	101	101
query92	67	50	49	49
query93	5235	520	504	504
query94	1259	188	188	188
query95	403	314	321	314
query96	606	276	279	276
query97	3217	3045	3043	3043
query98	237	199	236	199
query99	1192	859	829	829
Total cold run time: 289066 ms
Total hot run time: 174096 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.43 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f3def72ff0329c62b95587297baf35439428b77f, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.09	0.10
query5	0.49	0.49	0.48
query6	1.13	0.73	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.50	0.50
query10	0.55	0.55	0.55
query11	0.15	0.12	0.12
query12	0.14	0.12	0.13
query13	0.60	0.60	0.60
query14	0.77	0.77	0.78
query15	0.83	0.80	0.80
query16	0.37	0.35	0.36
query17	0.98	0.95	0.95
query18	0.23	0.26	0.26
query19	1.86	1.83	1.82
query20	0.01	0.01	0.02
query21	15.44	0.75	0.66
query22	4.28	7.64	1.61
query23	18.22	1.34	1.26
query24	2.24	0.22	0.21
query25	0.15	0.08	0.09
query26	0.27	0.18	0.19
query27	0.09	0.08	0.08
query28	13.21	1.01	0.99
query29	12.58	3.30	3.29
query30	0.26	0.07	0.06
query31	2.86	0.42	0.38
query32	3.25	0.47	0.48
query33	2.81	2.94	2.89
query34	17.10	4.40	4.42
query35	4.54	4.50	4.54
query36	0.66	0.46	0.45
query37	0.18	0.15	0.16
query38	0.15	0.15	0.15
query39	0.04	0.03	0.03
query40	0.18	0.14	0.15
query41	0.09	0.06	0.05
query42	0.06	0.05	0.05
query43	0.05	0.05	0.04
Total cold run time: 109.44 s
Total hot run time: 30.43 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Jun 27, 2024

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39521 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit accaf3e2504855d6f9d2f94dfd874f61b90fb6a0, data reload: false

------ Round 1 ----------------------------------
q1	17599	4292	4218	4218
q2	2017	196	196	196
q3	10455	1152	1014	1014
q4	10194	857	781	781
q5	7557	2637	2557	2557
q6	214	132	132	132
q7	928	594	601	594
q8	9214	2071	2055	2055
q9	8807	6460	6463	6460
q10	9072	3686	3702	3686
q11	461	233	231	231
q12	417	231	218	218
q13	17787	2970	2973	2970
q14	261	231	220	220
q15	541	483	488	483
q16	515	388	370	370
q17	957	657	671	657
q18	7995	7425	7349	7349
q19	2927	1512	1481	1481
q20	659	312	321	312
q21	4915	3200	3856	3200
q22	392	340	337	337
Total cold run time: 113884 ms
Total hot run time: 39521 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4352	4216	4190	4190
q2	366	267	258	258
q3	2943	2728	2777	2728
q4	1979	1702	1659	1659
q5	5476	5608	5515	5515
q6	213	134	134	134
q7	2174	1815	1781	1781
q8	3289	3402	3409	3402
q9	8623	8649	8649	8649
q10	4168	3800	3873	3800
q11	596	482	480	480
q12	792	631	597	597
q13	16095	3143	3161	3143
q14	295	272	284	272
q15	513	485	477	477
q16	474	420	436	420
q17	1773	1498	1481	1481
q18	8128	7857	7848	7848
q19	1815	1700	1741	1700
q20	2146	1878	1845	1845
q21	8841	4887	4914	4887
q22	640	569	535	535
Total cold run time: 75691 ms
Total hot run time: 55801 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 170635 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit accaf3e2504855d6f9d2f94dfd874f61b90fb6a0, data reload: false

query1	925	391	366	366
query2	6475	2350	2360	2350
query3	6640	203	208	203
query4	19406	17619	17297	17297
query5	3652	466	468	466
query6	254	174	160	160
query7	4587	292	291	291
query8	299	280	269	269
query9	8629	2466	2455	2455
query10	562	286	278	278
query11	10641	10134	10044	10044
query12	127	88	79	79
query13	1653	379	361	361
query14	9461	6250	7672	6250
query15	239	180	177	177
query16	7733	267	259	259
query17	1887	572	518	518
query18	1935	264	268	264
query19	190	149	147	147
query20	83	80	80	80
query21	215	134	125	125
query22	4522	4045	3980	3980
query23	33529	33685	33796	33685
query24	10571	2901	2894	2894
query25	592	378	364	364
query26	705	153	154	153
query27	2313	326	331	326
query28	6166	2150	2144	2144
query29	904	623	657	623
query30	248	161	163	161
query31	990	774	746	746
query32	99	57	52	52
query33	674	287	285	285
query34	880	473	489	473
query35	759	651	644	644
query36	1171	1011	956	956
query37	145	76	71	71
query38	2948	2877	2804	2804
query39	875	821	813	813
query40	203	123	124	123
query41	55	53	55	53
query42	115	94	100	94
query43	558	563	527	527
query44	1086	739	719	719
query45	191	162	160	160
query46	1082	718	731	718
query47	1867	1777	1787	1777
query48	373	313	313	313
query49	842	419	442	419
query50	753	382	391	382
query51	6905	6684	6763	6684
query52	110	86	98	86
query53	355	295	282	282
query54	868	438	442	438
query55	72	73	74	73
query56	283	268	269	268
query57	1113	1043	1059	1043
query58	237	236	256	236
query59	3372	3031	3252	3031
query60	299	266	262	262
query61	119	91	89	89
query62	599	436	446	436
query63	324	286	287	286
query64	8481	2286	1742	1742
query65	3172	3166	3092	3092
query66	736	322	327	322
query67	15421	14848	15074	14848
query68	4535	537	542	537
query69	563	428	399	399
query70	1188	1152	1118	1118
query71	376	275	268	268
query72	7570	2864	2745	2745
query73	753	333	324	324
query74	5922	5477	5572	5477
query75	3431	2672	2673	2672
query76	2423	962	946	946
query77	662	323	307	307
query78	10486	9809	9824	9809
query79	2288	510	516	510
query80	2788	474	486	474
query81	593	220	226	220
query82	787	110	104	104
query83	320	176	175	175
query84	268	91	92	91
query85	1930	361	340	340
query86	476	339	331	331
query87	3355	3105	3114	3105
query88	4360	2483	2471	2471
query89	466	382	383	382
query90	1720	195	188	188
query91	138	110	111	110
query92	63	49	49	49
query93	2526	508	503	503
query94	1140	196	193	193
query95	413	327	324	324
query96	593	270	270	270
query97	3213	3055	3060	3055
query98	216	198	198	198
query99	1302	824	907	824
Total cold run time: 270139 ms
Total hot run time: 170635 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.54 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit accaf3e2504855d6f9d2f94dfd874f61b90fb6a0, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.22	0.06	0.05
query4	1.68	0.07	0.07
query5	0.48	0.50	0.49
query6	1.14	0.73	0.73
query7	0.03	0.01	0.01
query8	0.06	0.05	0.05
query9	0.55	0.48	0.50
query10	0.54	0.55	0.54
query11	0.15	0.11	0.12
query12	0.15	0.12	0.12
query13	0.60	0.59	0.59
query14	0.80	0.78	0.79
query15	0.86	0.84	0.83
query16	0.35	0.35	0.36
query17	0.94	0.98	0.97
query18	0.23	0.22	0.28
query19	1.80	1.68	1.76
query20	0.01	0.01	0.02
query21	15.45	0.76	0.65
query22	4.01	7.89	1.80
query23	18.36	1.34	1.22
query24	2.07	0.22	0.22
query25	0.16	0.08	0.09
query26	0.26	0.17	0.18
query27	0.09	0.09	0.08
query28	13.30	1.05	1.02
query29	12.61	3.33	3.30
query30	0.25	0.06	0.05
query31	2.88	0.40	0.39
query32	3.25	0.49	0.48
query33	2.87	2.89	2.97
query34	17.24	4.46	4.47
query35	4.55	4.53	4.54
query36	0.66	0.48	0.48
query37	0.17	0.16	0.15
query38	0.15	0.14	0.13
query39	0.04	0.03	0.04
query40	0.17	0.16	0.14
query41	0.09	0.05	0.04
query42	0.05	0.05	0.04
query43	0.05	0.04	0.04
Total cold run time: 109.44 s
Total hot run time: 30.54 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Jun 29, 2024

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39991 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c4f46c677784900da85f2097aef216b19ec919b3, data reload: false

------ Round 1 ----------------------------------
q1	17665	4397	4291	4291
q2	2027	188	193	188
q3	10507	1238	1174	1174
q4	10215	747	746	746
q5	7514	2647	2651	2647
q6	221	132	138	132
q7	946	595	598	595
q8	9221	2095	2077	2077
q9	9038	6518	6467	6467
q10	8952	3749	3733	3733
q11	449	243	241	241
q12	506	230	232	230
q13	17763	3010	2994	2994
q14	270	234	223	223
q15	523	475	502	475
q16	531	376	372	372
q17	958	709	705	705
q18	8190	7605	7384	7384
q19	6371	1449	1480	1449
q20	663	325	334	325
q21	4977	3206	3293	3206
q22	393	338	337	337
Total cold run time: 117900 ms
Total hot run time: 39991 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4385	4289	4296	4289
q2	363	271	268	268
q3	2990	2916	2951	2916
q4	2012	1721	1714	1714
q5	5631	5562	5477	5477
q6	230	129	126	126
q7	2233	1880	1842	1842
q8	3287	3443	3432	3432
q9	8749	8798	8778	8778
q10	4148	3745	3856	3745
q11	632	490	512	490
q12	773	663	636	636
q13	17098	3127	3191	3127
q14	307	271	286	271
q15	525	481	492	481
q16	494	439	412	412
q17	1792	1515	1485	1485
q18	8305	7959	7810	7810
q19	1812	1696	1610	1610
q20	2961	1878	1835	1835
q21	5204	4935	4844	4844
q22	672	559	575	559
Total cold run time: 74603 ms
Total hot run time: 56147 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 174340 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c4f46c677784900da85f2097aef216b19ec919b3, data reload: false

query1	915	383	375	375
query2	6474	2472	2370	2370
query3	6640	202	211	202
query4	18975	17733	17238	17238
query5	3773	465	469	465
query6	254	162	157	157
query7	4592	299	292	292
query8	317	285	307	285
query9	8507	2476	2457	2457
query10	569	305	299	299
query11	10515	10159	10072	10072
query12	127	83	86	83
query13	1652	371	370	370
query14	9387	7726	7015	7015
query15	297	190	196	190
query16	8027	275	280	275
query17	1867	590	579	579
query18	1983	284	280	280
query19	208	161	160	160
query20	95	87	94	87
query21	219	132	127	127
query22	4337	4169	3896	3896
query23	34144	33812	33640	33640
query24	11178	2969	2835	2835
query25	619	431	397	397
query26	722	159	157	157
query27	2245	319	331	319
query28	6424	2169	2174	2169
query29	913	654	700	654
query30	251	161	164	161
query31	959	756	751	751
query32	95	55	58	55
query33	753	295	287	287
query34	1026	483	493	483
query35	783	636	690	636
query36	1164	987	985	985
query37	142	73	84	73
query38	2983	2825	2802	2802
query39	873	791	788	788
query40	213	123	124	123
query41	54	52	49	49
query42	117	98	106	98
query43	591	567	556	556
query44	1212	738	727	727
query45	196	170	166	166
query46	1073	716	719	716
query47	1858	1790	1770	1770
query48	380	299	308	299
query49	835	408	418	408
query50	773	385	386	385
query51	6923	6718	6716	6716
query52	96	95	89	89
query53	361	286	287	286
query54	883	443	449	443
query55	73	76	73	73
query56	305	266	261	261
query57	1112	1050	1088	1050
query58	235	239	233	233
query59	3378	3093	3224	3093
query60	307	282	292	282
query61	95	88	96	88
query62	596	454	429	429
query63	310	288	286	286
query64	8593	2248	1733	1733
query65	3167	3139	3122	3122
query66	748	329	329	329
query67	15764	15009	14853	14853
query68	6262	536	546	536
query69	663	454	404	404
query70	1146	1155	1137	1137
query71	489	279	274	274
query72	8771	5907	5745	5745
query73	791	328	321	321
query74	5980	5576	5497	5497
query75	4669	2702	2599	2599
query76	4186	921	985	921
query77	744	301	305	301
query78	10567	9699	9855	9699
query79	4483	517	521	517
query80	1006	469	463	463
query81	546	221	224	221
query82	779	101	103	101
query83	314	177	179	177
query84	270	86	92	86
query85	1239	287	329	287
query86	418	311	331	311
query87	3341	3060	3096	3060
query88	4689	2468	2472	2468
query89	514	400	377	377
query90	1839	196	190	190
query91	130	101	100	100
query92	69	51	51	51
query93	5211	514	505	505
query94	1100	190	191	190
query95	402	318	324	318
query96	620	279	274	274
query97	3221	3040	3086	3040
query98	221	195	198	195
query99	1202	846	846	846
Total cold run time: 281134 ms
Total hot run time: 174340 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.45 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c4f46c677784900da85f2097aef216b19ec919b3, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.06	0.05
query4	1.67	0.08	0.06
query5	0.48	0.48	0.49
query6	1.14	0.73	0.73
query7	0.02	0.01	0.02
query8	0.05	0.05	0.04
query9	0.56	0.47	0.48
query10	0.54	0.54	0.54
query11	0.16	0.11	0.12
query12	0.14	0.13	0.12
query13	0.59	0.59	0.60
query14	0.78	0.79	0.80
query15	0.86	0.82	0.82
query16	0.36	0.38	0.35
query17	1.05	1.02	1.01
query18	0.23	0.24	0.26
query19	1.85	1.74	1.75
query20	0.01	0.01	0.01
query21	15.43	0.74	0.65
query22	5.02	7.45	1.61
query23	18.31	1.32	1.31
query24	2.10	0.24	0.23
query25	0.17	0.09	0.08
query26	0.26	0.17	0.17
query27	0.09	0.09	0.08
query28	13.22	1.02	1.01
query29	12.64	3.34	3.37
query30	0.25	0.05	0.06
query31	2.88	0.39	0.39
query32	3.31	0.47	0.47
query33	2.90	2.89	2.90
query34	17.31	4.42	4.41
query35	4.54	4.53	4.47
query36	0.65	0.48	0.47
query37	0.18	0.17	0.16
query38	0.16	0.15	0.14
query39	0.04	0.03	0.04
query40	0.17	0.15	0.14
query41	0.09	0.05	0.04
query42	0.06	0.04	0.04
query43	0.04	0.04	0.03
Total cold run time: 110.66 s
Total hot run time: 30.45 s

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 29, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@dataroaring dataroaring merged commit c73391b into apache:master Jun 30, 2024
dataroaring pushed a commit that referenced this pull request Jul 1, 2024
…ment column on exchange node rather than on TabletWriter when using TABLET_SINK_SHUFFLE_PARTITIONED #36836" (#37029)

## Proposed changes

pick #36836
dataroaring pushed a commit that referenced this pull request Jul 2, 2024
…ange node rather than on TabletWriter when using `TABLET_SINK_SHUFFLE_PARTITIONED` (#36836)

## Proposed changes

Issue Number: close #36638

#30914 add partition tablet sink
shuffle and the processing of auto_increment column should be handled on
exchange node raher than TabletWriter when using partition tablet sink
shuffle.

branch-2.1-pick: #37029
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.5-merged dev/3.0.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] AUTO_INCREMENT doesn't seem to work, gives error.

4 participants