[Feature] ADD: show create routine load by stalary · Pull Request #6067 · apache/doris

stalary · 2021-06-21T00:58:06Z

Proposed changes

Add show create routine load

…/incubator-doris into show_create_routine_load

stalary · 2021-06-21T00:58:49Z

EmmyMiao87 · 2021-06-23T03:16:13Z

In fact, these information will be displayed in the results of show routine load.
Under what circumstances will a show create routine load syntax be needed?

morningman · 2021-06-23T03:32:18Z

In fact, these information will be displayed in the results of show routine load.
Under what circumstances will a show create routine load syntax be needed?

Just like show create table, user may may need to create routine load job again.

stalary · 2021-06-23T04:08:47Z

For example, I stopped it and then tried to restart it

fe/fe-core/src/main/java/org/apache/doris/analysis/ShowCreateRoutineLoadStmt.java

fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java

EmmyMiao87 · 2021-06-23T05:18:27Z

You need to consider a question.
Whether the routine load after stopping also needs to be displayed.

The routine load after stopping may have the same name.
So if show, it may produce multiple results.
The one way is that using 'show create routine load' to display running routine load, using 'show all create routine load' to displays all routine loads with the same name include stopped.

stalary · 2021-06-23T05:44:01Z

You need to consider a question.
Whether the routine load after stopping also needs to be displayed.

The routine load after stopping may have the same name.
So if show, it may produce multiple results.
The one way is that using 'show create routine load' to display running routine load, using 'show all create routine load' to displays all routine loads with the same name include stopped.

Well, I've decided to support both

EmmyMiao87 · 2021-06-23T05:44:35Z

At the moment my requirement is just to show running, do we need to support all of them？Show all create routine load is not very useful to me right now.

This is no problem.
It needs to be stated on the document that only the routine load of running or paused is displayed.

stalary · 2021-06-25T00:49:47Z

PTAL @EmmyMiao87

EmmyMiao87 · 2021-06-28T03:01:02Z

docs/zh-CN/sql-reference/sql-statements/Data Manipulation/SHOW CREATE ROUTINE LOAD.md

+
+# SHOW CREATE ROUTINE LOAD
+## description
+    该语句用于展示用户自定义例行导入作业的创建语句


Suggested change

该语句用于展示用户自定义例行导入作业的创建语句

该语句用于展示例行导入作业的创建语句

fe/fe-core/src/main/java/org/apache/doris/load/routineload/KafkaRoutineLoadJob.java

fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java

EmmyMiao87 · 2021-06-28T03:09:27Z

fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java

+                        dbName,
+                        tableName,
+                        PrivPredicate.LOAD)) {
+                    ErrorReport.reportAnalysisException(ErrorCode.ERR_TABLEACCESS_DENIED_ERROR, "LOAD",


If user don’t have permission, we can simply not display it without reporting an error

fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java

EmmyMiao87 · 2021-06-28T03:12:21Z

Please add some UT~
Maybe you need to rebase master so that P0(NewDorisTest) could be passed.

* [Enhance] Support show unrecoverable tablets The unrecoverable tablets are tablets which non of their replicas are healthy. We should be able to find out these tablets then manual intervention. And these tablets should not be added to the tablet scheduler.

…information (apache#5947) * Record all backup jobs and support where clause

Co-authored-by: zouxinyi <zouxinyi@baidu.com>

1. Disable libhdfs3 on ARM, because it doesn't support ARM now. 2. Add compilation doc for ARM64

apache#6054) 1. check the parquet schema property on FE side. 2. auto generate parquet schema if not specified.

* SIMD instruction speed up the storage layer * 1. add DECHECK in power of 2 int32 2. change vector to array deduce the cost

stalary added 3 commits June 21, 2021 08:37

ADD: show create routine load

5bafde3

ADD: show create routine load

624de07

Merge branch 'show_create_routine_load' of https://github.com/stalary…

1df57e4

…/incubator-doris into show_create_routine_load

FIX: fix some bug

65eae80

stalary changed the title ~~[WIP] ADD: show create routine load~~ [Feature] ADD: show create routine load Jun 21, 2021

stalary added 3 commits June 21, 2021 16:11

ADD: add end_line

cdb22f3

ADD: add doc

1fb5a5d

MOD: 修改sidebar

5c7d22d

EmmyMiao87 self-assigned this Jun 23, 2021

EmmyMiao87 reviewed Jun 23, 2021

View reviewed changes

EmmyMiao87 added area/routine load kind/feature Categorizes issue or PR as related to a new feature. labels Jun 23, 2021

MOD: support all

0e218f6

EmmyMiao87 reviewed Jun 28, 2021

View reviewed changes

morningman and others added 7 commits June 28, 2021 22:43

[Feature] Support recording custom number of backup and restore task …

b2a7794

…information (apache#5947) * Record all backup jobs and support where clause

fix spring boot web maximum upload file limit config (apache#6070)

7aa034d

Co-authored-by: zouxinyi <zouxinyi@baidu.com>

[Build][ARM] Fix some compilation problems on ARM64 (apache#6076)

b07ab37

1. Disable libhdfs3 on ARM, because it doesn't support ARM now. 2. Add compilation doc for ARM64

[Bug] Fix bug that select into outfile in parquet format may cause NPE (

f7ba232

apache#6054) 1. check the parquet schema property on FE side. 2. auto generate parquet schema if not specified.

[Docs] Fix README.md (apache#6084)

851b771

fix (apache#6081)

e970572

HappenLee and others added 6 commits June 28, 2021 22:43

SIMD instruction speed up the storage layer (apache#6089)

a1c796f

* SIMD instruction speed up the storage layer * 1. add DECHECK in power of 2 int32 2. change vector to array deduce the cost

fix stdfs link error in some gcc version (apache#6090)

5997321

ADD: show create routine load

e6b90d8

ADD: show create routine load

5309e08

FIX: fix some bug

47ab7e2

MOD: mod some code

a0d2df1

stalary closed this Jun 28, 2021

stalary deleted the show_create_routine_load branch June 28, 2021 14:58

stalary mentioned this pull request Jul 4, 2021

[Feature] ADD: show create routine load #6110

Merged

10 tasks

	该语句用于展示用户自定义例行导入作业的创建语句
	该语句用于展示例行导入作业的创建语句

Conversation

stalary commented Jun 21, 2021 • edited by EmmyMiao87 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Proposed changes

Uh oh!

stalary commented Jun 21, 2021

Uh oh!

EmmyMiao87 commented Jun 23, 2021

Uh oh!

morningman commented Jun 23, 2021

Uh oh!

stalary commented Jun 23, 2021

Uh oh!

Uh oh!

Uh oh!

Uh oh!

EmmyMiao87 commented Jun 23, 2021

Uh oh!

stalary commented Jun 23, 2021

Uh oh!

EmmyMiao87 commented Jun 23, 2021

Uh oh!

stalary commented Jun 25, 2021

Uh oh!

EmmyMiao87 Jun 28, 2021

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

EmmyMiao87 Jun 28, 2021

Choose a reason for hiding this comment

Uh oh!

Uh oh!

EmmyMiao87 commented Jun 28, 2021 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

stalary commented Jun 21, 2021 •

edited by EmmyMiao87

Loading

EmmyMiao87 commented Jun 28, 2021 •

edited

Loading