Skip to content

Some adjustments to config examples.#6973

Merged
jon-wei merged 4 commits intoapache:masterfrom
gianm:example-confs
Feb 1, 2019
Merged

Some adjustments to config examples.#6973
jon-wei merged 4 commits intoapache:masterfrom
gianm:example-confs

Conversation

@gianm
Copy link
Copy Markdown
Contributor

@gianm gianm commented Jan 31, 2019

  • Add ExitOnOutOfMemoryError to jvm.config examples. It was added a
    pretty long time ago (8u92) and is helpful since it prevents zombie
    processes from hanging around. (OOMEs tend to bork things)
  • Disable Broker caching and enable it on Historicals in example
    configs. This config tends to scale better since it enables the
    Historicals to merge results rather than sending everything by-segment
    to the Broker. Also switch to "caffeine" cache from "local".
  • Increase concurrency a bit for Broker example config.
  • Enable SQL in the example config, a baby step towards making SQL
    more of a thing. (It's still off by default in the code.)
  • Reduce memory use a bit for the quickstart configs.
  • Add example Router configs, in case someone wants to use that. One
    reason might be to get the fancy new console (Adding a Unified web console. #6923).

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI: these files don't have license headers because they don't support comments.

- Add ExitOnOutOfMemoryError to jvm.config examples. It was added a
pretty long time ago (8u92) and is helpful since it prevents zombie
processes from hanging around. (OOMEs tend to bork things)
- Disable Broker caching and enable it on Historicals in example
configs. This config tends to scale better since it enables the
Historicals to merge results rather than sending everything by-segment
to the Broker. Also switch to "caffeine" cache from "local".
- Increase concurrency a bit for Broker example config.
- Enable SQL in the example config, a baby step towards making SQL
more of a thing. (It's still off by default in the code.)
- Reduce memory use a bit for the quickstart configs.
- Add example Router configs, in case someone wants to use that. One
reason might be to get the fancy new console (apache#6923).
# under the License.
#

druid.service=druid/router
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we have an example router config under example/conf as well?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, I'll add some.

@dylwylie
Copy link
Copy Markdown
Contributor

CI failure looks legit - license failure on the new file

examples/conf/druid/router/runtime.properties

Not sure why RAT either ignores or likes the other .properties files but not this one.

@gianm
Copy link
Copy Markdown
Contributor Author

gianm commented Jan 31, 2019

Eek, thanks. Fixed it.

Copy link
Copy Markdown
Contributor

@jon-wei jon-wei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jon-wei jon-wei merged commit 4e42632 into apache:master Feb 1, 2019
justinborromeo pushed a commit to justinborromeo/incubator-druid that referenced this pull request Feb 2, 2019
* Some adjustments to config examples.

- Add ExitOnOutOfMemoryError to jvm.config examples. It was added a
pretty long time ago (8u92) and is helpful since it prevents zombie
processes from hanging around. (OOMEs tend to bork things)
- Disable Broker caching and enable it on Historicals in example
configs. This config tends to scale better since it enables the
Historicals to merge results rather than sending everything by-segment
to the Broker. Also switch to "caffeine" cache from "local".
- Increase concurrency a bit for Broker example config.
- Enable SQL in the example config, a baby step towards making SQL
more of a thing. (It's still off by default in the code.)
- Reduce memory use a bit for the quickstart configs.
- Add example Router configs, in case someone wants to use that. One
reason might be to get the fancy new console (apache#6923).

* Add example Router configs.

* Fix up router example properties.

* Add router to quickstart supervise conf.
@jon-wei jon-wei added this to the 0.14.0 milestone Feb 20, 2019
@gianm gianm deleted the example-confs branch September 23, 2022 19:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants