Skip to content

Conversation

@morningman
Copy link
Contributor

…is too large or is not reachable

Proposed changes

Issue Number: close #xxx

When query tables in information_schema databases, it may timeout due to:

  1. There are external catalog with too many tables.
  2. The external catalog is unreachable

So I add a new FE config infodb_support_ext_catalog.
The default is false, which means that when select from tables in information_schema database,
the result will not contain the information of the table in external catalog.

Describe your changes.

Checklist(Required)

  • Does it affect the original behavior
  • Has unit tests been added
  • Has document been added or modified
  • Does it need to update dependencies
  • Is this PR support rollback (If NO, please explain WHY)

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/docs Categorizes issue or PR as related to documentation. labels Apr 14, 2023
@morningman morningman changed the title [fix](info_db) avoid infodb query timeout when external catalog info … [fix](info_db) avoid infodb query timeout when external catalog info is too large or is not reachable Apr 14, 2023
@morningman
Copy link
Contributor Author

run buildall

Copy link
Contributor

@yiguolei yiguolei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yiguolei yiguolei merged commit 9634d21 into apache:master Apr 14, 2023
@yiguolei yiguolei added the usercase Important user case type label label Apr 14, 2023
morningman added a commit that referenced this pull request Apr 14, 2023
…is too large or is not reachable (#18662)

When query tables in information_schema databases, it may timeout due to:

There are external catalog with too many tables.
The external catalog is unreachable
So I add a new FE config infodb_support_ext_catalog.
The default is false, which means that when select from tables in information_schema database,
the result will not contain the information of the table in external catalog.

Describe your changes.
gnehil pushed a commit to gnehil/doris that referenced this pull request Apr 21, 2023
…is too large or is not reachable (apache#18662)

When query tables in information_schema databases, it may timeout due to:

There are external catalog with too many tables.
The external catalog is unreachable
So I add a new FE config infodb_support_ext_catalog.
The default is false, which means that when select from tables in information_schema database,
the result will not contain the information of the table in external catalog.

Describe your changes.
Reminiscent pushed a commit to Reminiscent/doris that referenced this pull request May 15, 2023
…is too large or is not reachable (apache#18662)

When query tables in information_schema databases, it may timeout due to:

There are external catalog with too many tables.
The external catalog is unreachable
So I add a new FE config infodb_support_ext_catalog.
The default is false, which means that when select from tables in information_schema database,
the result will not contain the information of the table in external catalog.

Describe your changes.
@xiaokang xiaokang mentioned this pull request Jun 21, 2023
mongo360 pushed a commit to mongo360/doris that referenced this pull request Jul 12, 2023
…is too large or is not reachable (apache#18662)

When query tables in information_schema databases, it may timeout due to:

There are external catalog with too many tables.
The external catalog is unreachable
So I add a new FE config infodb_support_ext_catalog.
The default is false, which means that when select from tables in information_schema database,
the result will not contain the information of the table in external catalog.

Describe your changes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/planner Issues or PRs related to the query planner dev/1.2.4-merged kind/behavior-changed kind/docs Categorizes issue or PR as related to documentation. usercase Important user case type label

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants