Skip to content

Add routine load job cleaner #742

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morningman merged 1 commit into from
Mar 14, 2019
Merged

Add routine load job cleaner #742

morningman merged 1 commit into from
Mar 14, 2019

Conversation

@EmmyMiao87
Copy link
Contributor

@EmmyMiao87 EmmyMiao87 commented Mar 13, 2019

  1. the stopped and cancelled job will be cleaned after the interval of clean second
  2. the interval of clean second * 1000 = current timestamp - end timestamp
  3. if job could not fetch topic metadata when need_schedule, job will be cancelled
  4. fix the deadlock of job and txn. the lock of txn must be in front of the lock of job
  5. the job will be paused or cancelled depend on the abort reason of txn
  6. the job will be cancelled immediately if the abort reason named offsets out of range

@EmmyMiao87
Add routine load job cleaner
f299188 
1. the stopped and cancelled job will be cleaned after the interval of clean second
2. the interval of clean second * 1000 = current timestamp - end timestamp
3. if job could not fetch topic metadata when need_schedule, job will be cancelled
4. fix the deadlock of job and txn. the lock of txn must be in front of the lock of job
5. the job will be paused or cancelled depend on the abort reason of txn
6. the job will be cancelled immediately if the abort reason named offsets out of range
@morningman morningman merged commit cf26610 into apache:kafka_routine_load Mar 14, 2019
morningman pushed a commit to morningman/doris that referenced this pull request Mar 25, 2019
@EmmyMiao87 @morningman
Add routine load job cleaner (apache#742)
f649a6c 
1. the stopped and cancelled job will be cleaned after the interval of clean second
2. the interval of clean second * 1000 = current timestamp - end timestamp
3. if job could not fetch topic metadata when need_schedule, job will be cancelled
4. fix the deadlock of job and txn. the lock of txn must be in front of the lock of job
5. the job will be paused or cancelled depend on the abort reason of txn
6. the job will be cancelled immediately if the abort reason named offsets out of range
morningman pushed a commit that referenced this pull request Mar 25, 2019
@EmmyMiao87 @morningman
Add routine load job cleaner (#742)
a401c76 
1. the stopped and cancelled job will be cleaned after the interval of clean second
2. the interval of clean second * 1000 = current timestamp - end timestamp
3. if job could not fetch topic metadata when need_schedule, job will be cancelled
4. fix the deadlock of job and txn. the lock of txn must be in front of the lock of job
5. the job will be paused or cancelled depend on the abort reason of txn
6. the job will be cancelled immediately if the abort reason named offsets out of range
morningman pushed a commit to morningman/doris that referenced this pull request Apr 4, 2019
@EmmyMiao87 @morningman
Add routine load job cleaner (apache#742)
97b8499 
1. the stopped and cancelled job will be cleaned after the interval of clean second
2. the interval of clean second * 1000 = current timestamp - end timestamp
3. if job could not fetch topic metadata when need_schedule, job will be cancelled
4. fix the deadlock of job and txn. the lock of txn must be in front of the lock of job
5. the job will be paused or cancelled depend on the abort reason of txn
6. the job will be cancelled immediately if the abort reason named offsets out of range
morningman pushed a commit that referenced this pull request Apr 4, 2019
@EmmyMiao87 @morningman
Add routine load job cleaner (#742)
1a202db 
1. the stopped and cancelled job will be cleaned after the interval of clean second
2. the interval of clean second * 1000 = current timestamp - end timestamp
3. if job could not fetch topic metadata when need_schedule, job will be cancelled
4. fix the deadlock of job and txn. the lock of txn must be in front of the lock of job
5. the job will be paused or cancelled depend on the abort reason of txn
6. the job will be cancelled immediately if the abort reason named offsets out of range
morningman pushed a commit that referenced this pull request Apr 19, 2019
@EmmyMiao87 @morningman
Add routine load job cleaner (#742)
26c48c3 
1. the stopped and cancelled job will be cleaned after the interval of clean second
2. the interval of clean second * 1000 = current timestamp - end timestamp
3. if job could not fetch topic metadata when need_schedule, job will be cancelled
4. fix the deadlock of job and txn. the lock of txn must be in front of the lock of job
5. the job will be paused or cancelled depend on the abort reason of txn
6. the job will be cancelled immediately if the abort reason named offsets out of range
EmmyMiao87 added a commit to EmmyMiao87/incubator-doris that referenced this pull request Apr 23, 2019
@EmmyMiao87
Add routine load job cleaner (apache#742)
16bc0c9 
1. the stopped and cancelled job will be cleaned after the interval of clean second
2. the interval of clean second * 1000 = current timestamp - end timestamp
3. if job could not fetch topic metadata when need_schedule, job will be cancelled
4. fix the deadlock of job and txn. the lock of txn must be in front of the lock of job
5. the job will be paused or cancelled depend on the abort reason of txn
6. the job will be cancelled immediately if the abort reason named offsets out of range
morningman pushed a commit that referenced this pull request Apr 24, 2019
@EmmyMiao87 @morningman
Add routine load job cleaner (#742)
907bc9a 
1. the stopped and cancelled job will be cleaned after the interval of clean second
2. the interval of clean second * 1000 = current timestamp - end timestamp
3. if job could not fetch topic metadata when need_schedule, job will be cancelled
4. fix the deadlock of job and txn. the lock of txn must be in front of the lock of job
5. the job will be paused or cancelled depend on the abort reason of txn
6. the job will be cancelled immediately if the abort reason named offsets out of range
imay pushed a commit that referenced this pull request Apr 28, 2019
@EmmyMiao87 @imay
Add routine load job cleaner (#742)
e1fb02d 
1. the stopped and cancelled job will be cleaned after the interval of clean second
2. the interval of clean second * 1000 = current timestamp - end timestamp
3. if job could not fetch topic metadata when need_schedule, job will be cancelled
4. fix the deadlock of job and txn. the lock of txn must be in front of the lock of job
5. the job will be paused or cancelled depend on the abort reason of txn
6. the job will be cancelled immediately if the abort reason named offsets out of range
platoneko pushed a commit to platoneko/doris that referenced this pull request Oct 27, 2022
@Lchangliang
[feature](selectdb-cloud) Fix error by regression case (apache#742)
8966d0d
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@EmmyMiao87 @morningman