Fix base64 decode to maxwell#2
Open
shldreams wants to merge 186 commits into
Open
Conversation
…#829) * using tidb-tools.filter * new name * fix ut
…pingcap#831) * remove checkpoint ts tick in processor * refine task status operation in processor * fix resolved ts block ddl update * update etcd download url to internal Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
* fix DDL may be lost if owner exits * fix task position could be updated after processor is stopped
* wip * wip * refine the struct of row changed events * fix ut * fix bug * fix bug * fix bug * fix bug * fix bug * fix panic in kafka * update comments * update the IsIndexUnique function Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Signed-off-by: wjhuang2016 <huangwenjun1997@gmail.com>
* remove the delete field in row change event * fix test Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Signed-off-by: Neil Shen <overvenus@gmail.com>
* support s3/local file sink
* Use batch replace in mysql sink to increase performance * fix unit test
* cdclog: fix ci * update ci * fix ci * fix ci * fix * fix Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
* update tidb to 4.0 * fix check * mod tidy Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
* support multiple pd address in cdc cli * support to deploy multiple PDs in integration test * refine startup script * refine script
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
* refine file gc in file sorter * update inegration test
* remove the indie-mark-col field in row change event * fix test * warn in cli * fix test * fix test Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
* fix filter schema * fix filter schema * update table filter Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Signed-off-by: Neil Shen <overvenus@gmail.com>
) * testing * update * update * update * update * update * update * usable * fix avro bugs * update * lint * fix avro tests * disable unit tests of the integration framework * Create README.md * sort imports * update go.mod & go.sum * fix * fix * TODO message for passing ctx to EventBatchEncoder Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Signed-off-by: Neil Shen <overvenus@gmail.com>
…ingcap#851) * add unsafe cmd * update unsafe cmd * update unsafe cmd
… to mysql sink (pingcap#843) * fix test * fix ut * using is partition * Merge remote-tracking branch 'pingcap/master' into remove_keys_in_row # Conflicts: # cdc/entry/mounter.go * fix test Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
…when creating (pingcap#861) * support force remove a changefeed, check removed/finished changefeed when creating * add integration test Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
* use S3 related API by import BR * fix ci * fix ci && reformat s3 api * update br * fix * protocol: save rowID to open protocol Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
* hide sink uri in changefeed info * fix make check Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
* owner: increase gc safepoint update frequency to 2s * fix make check
Signed-off-by: Lonng <heng@lonng.org>
…dreams/ticdc into fix_base64_decode_to_maxwell
…ng to create sink (pingcap#1155)
…dreams/ticdc into fix_base64_decode_to_maxwell
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
12 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What problem does this PR solve?
Fix base64 data output, fix maxwell output tso to unix timestamp, fix old data structure output