Skip to content

[Doc]-Precise topic publish rate limiting #7244

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
Huanli-Meng wants to merge 124 commits into from
Closed

[Doc]-Precise topic publish rate limiting #7244

Huanli-Meng wants to merge 124 commits into from

Conversation

@Huanli-Meng
Copy link
Contributor

@Huanli-Meng Huanli-Meng commented Jun 11, 2020 •
edited
Loading

Motivation

This doc PR is updated for configurations for PRs:
#6716
#6853
#6074

1: The broker configuration (for #6716) is updated by Jia Zhai.

2: Add other supported configurations to the client, standlone and proxy configuration docs based on the client.config, standlone.config and proxy.config files.

Modifications

1: Add TLS with keystore type config in standlone and proxy configuration file.
2: update reference > pulsar configuration > client for PIP-55: Refresh Authentication Credentials
Add other supported configurations to the standlone and proxy configuration files based on the standlone.config and proxy.config files.

@Huanli-Meng
Copy link
Contributor Author

Huanli-Meng commented Jun 11, 2020

@jiazhai, please help review the doc update.

@codelipenghui codelipenghui added this to the 2.7.0 milestone Jun 16, 2020
@codelipenghui codelipenghui added doc Your PR contains doc changes, no matter whether the changes are in markdown or code files. resolution/duplicate and removed resolution/duplicate labels Jun 16, 2020
@codelipenghui
Copy link
Contributor

codelipenghui commented Jun 16, 2020

@Huanli-Meng Could you please rebase the branch?

@Huanli-Meng Huanli-Meng changed the title Precise topic publish rate limiting [Doc]-Precise topic publish rate limiting Jun 16, 2020
Jennifer88huang-zz
Jennifer88huang-zz reviewed Jun 16, 2020
View reviewed changes
Copy link
Contributor

@Jennifer88huang-zz Jennifer88huang-zz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you can use dashes (-), asterisks (*), or plus signs (+) in front of line items for unordered list in markdown. For details, see https://www.markdownguide.org/basic-syntax/#unordered-lists

Anonymitaet
Anonymitaet reviewed Jun 16, 2020
View reviewed changes
Anonymitaet
Anonymitaet reviewed Jun 16, 2020
View reviewed changes
Huanli-Meng and others added 12 commits June 17, 2020 09:39
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
536e3c9 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
d0092f9 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
0d2d0bc 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
ab95aaa 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
89ca7cb 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
88c3597 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
801a876 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
22765e2 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
438d374 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@codelipenghui
Add 2.6.0 Release note. (apache#7276)
8bcd47e
@Jennifer88huang-zz
[doc] Add doc for Pulsar SQL support in tiered storage (apache#7283)
8695e71 
* add doc for PR 4045

* update content in 2.4 and 2.5 as well
@codelipenghui
Update swagger file for 2.6.0. (apache#7288)
d697226
zymap and others added 28 commits July 6, 2020 00:36
@zymap
Add more detail information of retry errors (apache#7341)
f4547ec 
---

*Motivation*

Currently, when you connecting to a wrong address, the error
log does not show the detail information to let you know why
it failed. Add the failed reason to know more about the error.

Before adding the error log:

```
bin/pulsar-admin topics list public/default
null

Reason: java.util.concurrent.CompletionException: org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector$RetryException: Could not complete the operation. Number of retries has been exhausted.
```

After adding the error log:

```
bin/pulsar-admin topics list public/default
null

Reason: java.util.concurrent.CompletionException: org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector$RetryException: Could not complete the operation. Number of retries has been exhausted.Connection refused: localhost/127.0.0.1:8081
```
Consumer is registered on dispatcher even if hash range conflicts on …
97ee82e 
…Key_Shared subscription (apache#7444)
@codelipenghui
Fix batch ackset recycled multiple times. (apache#7409)
25a6907 
* Fix batch ackset recycled multiple times.

* Apply comments.

* Update pulsar-common/src/main/java/org/apache/pulsar/common/util/collections/BitSetRecyclable.java
@aloyszhang
fix update partitions error for non-persistent topic (apache#7459)
f8beb78
@Huanli-Meng
partition key to python functions (apache#7431)
71ee00d 
### Motivation

Pulsar release 2.4.0 supports setting partition key for messages when using function publish, as described in this PR: apache#4005

The code is updated but the doc is not updated accordingly.


### Modifications

1: Update the doc based on the code updated.
2: also add some legacy missing methods in the context class of the python functions according to the code.
3: This update is only for Pulsar 2.4.0 release. No need to update docs in 2.4.1 and later releases as these docs have been updated.
@jiazhai @sijie @Anonymitaet
[doc] fix doc after remove bc-shaded (apache#7454)
ceecc78 
* fix bc doc after remove bc-shaded

* Update site2/docs/security-bouncy-castle.md

Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>

Co-authored-by: Sijie Guo <sg@streamnative.io>
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@jerrypeng
Allow function rebalance to be run periodically (apache#7449)
304685b 
Co-authored-by: Jerry Peng <jerryp@splunk.com>
@rdhabalia @Anonymitaet
[pulsar-doc] Add document for Pulasr SNI routing with ATS (apache#7421)
ee1b810 
* [pulsar-doc] Add document for Pulasr SNI routing with ATS

* address comments

* add image

* Update site2/docs/concepts-proxy-sni-routing.md

Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>

* Update site2/docs/concepts-proxy-sni-routing.md

Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>

* Update site2/docs/concepts-proxy-sni-routing.md

Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>

* Update site2/docs/concepts-proxy-sni-routing.md

Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>

* Update site2/docs/concepts-proxy-sni-routing.md

Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>

Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@srkukarni
Differentiate authorization between source/sink/function operations (a…
77dccd2 
…pache#7466)

* Differentiate between source/sink/function operations

* Added release notes

Co-authored-by: Sanjeev Kulkarni <sanjeevk@splunk.com>
@vzhikserg
[Issue 5736] Add test checks in branches (apache#7465)
c91505e
@gaoran10
[Issue 7347] Avoid the NPE occurs in method `ManagedLedgerImpl.isOffl…
eaf268c 
…oadedNeedsDelete` (apache#7389)

Fixes apache#7347 

### Motivation

The default value of the offload-deletion-lag is `null`, this will cause an NPE problem.

### Modifications

Add null check in the method `ManagedLedgerImpl.isOffloadedNeedsDelete`.

### Verifying this change

Add unit test for method `ManagedLedgerImpl.isOffloadedNeedsDelete`.
@jerrypeng
Log scheduler stats for Pulsar Functions (apache#7474)
cc2c203 
Co-authored-by: Jerry Peng <jerryp@splunk.com>
@jiazhai
Cpp oauth2 auth client (apache#7467)
2d0cceb 
### Motivation

apache#7420 provides an Oauth2 auth client for java. This PR tries to support it in cpp client

### Modifications

- add implementation
- add related tests.
@Huanli-Meng
[Doc]--add authentication client with oauth2 support (apache#7462)
6726072 
fixes apache#7425 

### Motivation
Pulsar supports authenticating clients using OAuth 2.0 access tokens. the related code is updated as shown in this PR: apache#7420.

Update the related pulsar doc.



### Modifications
In security section: add Authentication using OAuth 2.0 access tokens
Java client: add an example about Oauth authentication
sidebar: update the sidebar document.
@codelipenghui
Fix ArrayIndexOutOfBoundsException in batch index ack. (apache#7483)
beb9e3b
@Huanli-Meng
[Doc]--Add Tls with keystore type config support
2815980
@Huanli-Meng
Update contents.
fcd24c8
@Huanli-Meng
update broker configuration and client configuration
8af33ec
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
b20562d 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
922147d 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
ee5711a 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
789173c 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
f046503 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
c9a7dd5 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
c9ff447 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
6227603 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng @Anonymitaet
Update site2/docs/reference-configuration.md
a5df13a 
Co-authored-by: Yu Liu <50226895+Anonymitaet@users.noreply.github.com>
@Huanli-Meng
resolve rebase conflict
6523aad
@Huanli-Meng
Copy link
Contributor Author

Huanli-Meng commented Jul 9, 2020

close the PR and re-open a new one.

@Huanli-Meng Huanli-Meng closed this Jul 9, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Anonymitaet Anonymitaet Anonymitaet left review comments

@sijie sijie sijie approved these changes

@jiazhai jiazhai jiazhai approved these changes

+1 more reviewer

@Jennifer88huang-zz Jennifer88huang-zz Jennifer88huang-zz approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

@Huanli-Meng Huanli-Meng

Labels

doc Your PR contains doc changes, no matter whether the changes are in markdown or code files. release/2.6.1

Projects

None yet

Milestone

2.7.0

Development

Successfully merging this pull request may close these issues.