Skip to content

Conversation

@liutang123
Copy link
Contributor

cherry-pick #40948

Like mysql, json_search returns the path which point to a json string witch match the pattern.
SELECT JSON_SEARCH('["A",[{"B":"1"}],{"C":"AB"},{"D":"BC"}]', 'one', 'A_') as res;

+----------+
| res      |
+----------+
| "$[2].C" |
+----------+

github-actions bot and others added 30 commits March 19, 2025 11:08
…e#49144)

Cherry-picked from apache#49009

Co-authored-by: bobhan1 <baohan@selectdb.com>
…ular Reference apache#48955 (apache#49114)

Cherry-picked from apache#48955

Co-authored-by: Socrates <suyiteng@selectdb.com>
…49140 (apache#49168)

Cherry-picked from apache#49140

Co-authored-by: Gabriel <liwenqiang@selectdb.com>
…48458)

### What problem does this PR solve?
Problem Summary:
the partition_sorts is unique_ptr,could release after destroy.
and when some extreme case like cancel, if source reset the sorter
early, the sink operator will coredump still use it.
…apache#49192)

Cherry-picked from apache#49160

Co-authored-by: meiyi <meiyi@selectdb.com>
…umn type. apache#48768 (apache#48841)

Cherry-picked from apache#48768

Co-authored-by: daidai <changyuwei@selectdb.com>
…9213 (apache#49228)

Cherry-picked from apache#49213

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
…he#49170 (apache#49230)

Cherry-picked from apache#49170

Co-authored-by: Xin Liao <liaoxin@selectdb.com>
…he#49000 (apache#49217)

Cherry-picked from apache#49000

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
…rder by apache#49247 (apache#49285)

Cherry-picked from apache#49247

Co-authored-by: amory <wangqiannan@selectdb.com>
… (apache#49294)

Cherry-picked from apache#48150

Co-authored-by: caoliang-web <71004656+caoliang-web@users.noreply.github.com>
… type in variant apache#47688 (apache#48117)

Cherry-picked from apache#47688

Co-authored-by: lihangyu <lihangyu@selectdb.com>
…dinate parsing apache#46661 (apache#47264)

Cherry-picked from apache#46661

Co-authored-by: lw112 <131352377+felixwluo@users.noreply.github.com>
…fter-free when input Const(Nullable) column apache#48288 (apache#49246)

Cherry-picked from apache#48288

Co-authored-by: Mryange <yanxuecheng@selectdb.com>
 (apache#48903)

Cherry-picked from apache#48843

Co-authored-by: yujun <yujun@selectdb.com>
…e#48861 (apache#49013)

Cherry-picked from apache#48861

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
 (apache#49200)

Cherry-picked from apache#49149

Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
…e conflict in find_symbols.h apache#43004 (apache#49078)

Cherry-picked from apache#43004

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
Co-authored-by: camby <cambyzhu@tencent.com>
…mments and trimming SQL input apache#46099 (apache#46471)

Cherry-picked from apache#46099

Co-authored-by: York Cao <52438394+Baymine@users.noreply.github.com>
…ScanPredicate in jni_connect.h apache#46666 (apache#46726)

Cherry-picked from apache#46666

Co-authored-by: 神技圈子 <songguangfan@gmail.com>
…48602 (apache#48712)

Cherry-picked from apache#48602

Co-authored-by: Socrates <suyiteng@selectdb.com>
…he#49322)

Cherry-picked from apache#49295

Co-authored-by: meiyi <meiyi@selectdb.com>
morningman and others added 20 commits April 25, 2025 10:37
… once in a time (pick#50387) (apache#50402)

pick#50387

too many ttl cache blocks gc will burst the cache lock latency and thus
affect the query latency. limit them into batches to unleash the lock.
… `ListObjectsV2` apache#50252 (apache#50413)

Cherry-picked from apache#50252

Co-authored-by: Lei Zhang <zhanglei@selectdb.com>
… insert overwrite execution apache#48673 (apache#49964)

Cherry-picked from apache#48673

Co-authored-by: zhangdong <zhangdong@selectdb.com>
…array_json_outer apache#50164 (apache#50226)

Cherry-picked from apache#50164

Co-authored-by: zhangstar333 <zhangsida@selectdb.com>
… test apache#50380 (apache#50429)

Cherry-picked from apache#50380

Co-authored-by: koarz <lihao@selectdb.com>
…load apache#49714 (apache#50410)

Cherry-picked from apache#49714

Co-authored-by: 神技圈子 <songguangfan@gmail.com>
Co-authored-by: 宋光璠 <songguangfan@sf.com>
Co-authored-by: morningman <yunyou@selectdb.com>
Co-authored-by: morningman <morningman@163.com>
…g parallelism apache#50037 (apache#50428)

Cherry-picked from apache#50037

Co-authored-by: abmdocrt <lianyukang@selectdb.com>
…bal lock when execute compaction (apache#49882)" (apache#50432)

Pick apache#49882 

Background:
In cloud mode, compaction tasks for the same tablet may be scheduled
across multiple BEs. To ensure that only one BE can execute a compaction
task for a given tablet at a time, a global locking mechanism is used.

During compaction preparation, tablet and compaction information is
written as key-value pairs to the metadata service. A background thread
periodically renews the lease. Other BEs can only perform compaction on
a tablet when the KV entry has expired or doesn't exist, ensuring that a
tablet's compaction occurs on only one BE at a time.

Problem:
Compaction tasks are processed through a thread pool. Currently, we
first prepare compaction and acquire the global lock before queueing the
task. If a BE is under heavy compaction pressure with all threads
occupied, tablets may wait in the queue for extended periods. Meanwhile,
other idle BEs cannot perform compaction on these tablets because they
cannot acquire the global lock, leading to resource imbalance with some
BEs starved and others overloaded.

Solution:
To address this issue, we'll modify the workflow to queue tasks first,
then attempt to acquire the lock only when the task is about to be
executed. This ensures that even if a tablet's compaction task is queued
on one BE, another idle BE can still perform compaction on that tablet,
resulting in better resource utilization across the cluster.
…rts dynamic apache#50149 (apache#50302)

Cherry-picked from apache#50149

Co-authored-by: lw112 <131352377+felixwluo@users.noreply.github.com>
… table apache#49905 (apache#50128)

Cherry-picked from apache#49905

Co-authored-by: bobhan1 <baohan@selectdb.com>
… to use conf_path's value specified when started apache#50381 (apache#50474)

Cherry-picked from apache#50381

Co-authored-by: Siyang Tang <tangsiyang@selectdb.com>
…pache#50350 (apache#50443)

Cherry-picked from apache#50350

Co-authored-by: airborne12 <jiangkai@selectdb.com>
…pache#49999 (apache#50087)

Cherry-picked from apache#49999

Co-authored-by: Yongqiang YANG <yangyongqiang@selectdb.com>
…46851 (apache#50475)

Cherry-picked from apache#46851

Co-authored-by: Yongqiang YANG <yangyongqiang@selectdb.com>
Like mysql, json_search returns the path which point to a json string
witch match the pattern.
`SELECT JSON_SEARCH('["A",[{"B":"1"}],{"C":"AB"},{"D":"BC"}]', 'one',
'A_') as res;`
```
+----------+
| res      |
+----------+
| "$[2].C" |
+----------+
```
@Thearas
Copy link
Contributor

Thearas commented Apr 28, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@liutang123 liutang123 closed this Apr 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.