[AIRFLOW-53] Add CLI DagBag loading stats option to list_dags subcommand#1468
Merged
mistercrunch merged 1 commit intomasterfrom May 6, 2016
Merged
[AIRFLOW-53] Add CLI DagBag loading stats option to list_dags subcommand#1468mistercrunch merged 1 commit intomasterfrom
mistercrunch merged 1 commit intomasterfrom
Conversation
| task_num=sum([o.dag_num for o in stats]), | ||
| table=pprinttable(stats), | ||
| ) | ||
| logging.debug(dagbag_stats) |
Member
Author
There was a problem hiding this comment.
this was litterring the travis stdout like crazy
Contributor
|
LGTM |
Contributor
|
Please squash commits. |
Contributor
|
Squash and add AIRFLOW-53 to the beginning of commit string. |
Member
Author
|
Should we re-enable the new and amazing rebase-squash-merge button in this repo? I'm missing my admin privileges. I can't even check if the master branch is still protected after the move... Will squash for now. |
Adding DagBag stats report to CLI's list_dags Removing logging call in favor of CLI, on-demend based approach Addressing Dan's feedback
e43b90c to
b942933
Compare
yiqingj
pushed a commit
to yiqingj/airflow
that referenced
this pull request
May 27, 2016
* master: AIRFLOW-92 Avoid unneeded upstream_failed session closes apache#1485 AIRFLOW-52 Warn about overwriting tasks in a DAG Add logic to lock DB and avoid race condition Handle queued tasks from multiple jobs/executors [AIRFLOW-80] Move example_twitter dag to contrib/example_dags as it requires hive [AIRFLOW-75] Fix bug in S3 config file parsing Use getfqdn to make sure urls are fully qualified [AIRFLOW-52] Fix bottlenecks when working with many tasks Add bulk_dump abstract method to DbApiHook (apache#1471) Fix corner case with joining processes/queues (apache#1473) [AIRFLOW-53] Adding DagBag stats report to CLI's list_dags (apache#1468)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Please accept this PR that addresses the following issues:
Also shut off the logging.debug call as it was way too verbose in the context of unitests as they load DagBags over and over.