Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
98 commits
Select commit Hold shift + click to select a range
40cc50c
sdks/python: enrich data with CloudSQL
mohamedawnallah Mar 24, 2025
507d3ec
sdks/python: unit test `CloudSQLEnrichmentHandler`
mohamedawnallah Mar 24, 2025
b4c11d3
sdks/python: itest `CloudSQLEnrichmentHandler`
mohamedawnallah Mar 25, 2025
43943b1
website+sdks: doc `CloudSQLEnrichmentHandler`
mohamedawnallah Mar 25, 2025
846c30d
sdks/python: address claudevdm feedback (1)
mohamedawnallah Apr 11, 2025
9a1ed45
sdks/python: address claudevdm feedback (1)(test)
mohamedawnallah Apr 11, 2025
9261459
sdks/python: address claudevdm feedback (1)(itest)
mohamedawnallah Apr 11, 2025
ecbb61d
sdks: update doc `CloudSQLEnrichmentHandler`
mohamedawnallah Apr 11, 2025
83e7154
sdks/python: fix linting issues
mohamedawnallah Apr 11, 2025
4fa1830
website: add missing `enrichment-cloudsql.md`
mohamedawnallah Apr 13, 2025
4251a76
nits: remove commented code
mohamedawnallah Apr 13, 2025
ab7cf7b
sdks/python: remove `SQL_TABLE_ID` env variable
mohamedawnallah Apr 13, 2025
669d2d4
sdks/python: fix formatting issues
mohamedawnallah Apr 13, 2025
7209335
sdks/python: address claudevdm feedback (2)
mohamedawnallah May 21, 2025
abb89b7
sdks/python: address claudevdm feedback (3)
mohamedawnallah May 28, 2025
d95e926
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Jun 6, 2025
bc84430
multi: fix pymssql mac os deps
mohamedawnallah Jun 6, 2025
7a56f0e
multi: use pytds sql server database adapter
mohamedawnallah Jun 6, 2025
cc7c7f0
sdks/python: use `VARCHAR` datatype
mohamedawnallah Jun 6, 2025
7a7436d
sdks/python: address claudevdm feedback (4)
mohamedawnallah Jun 12, 2025
43ea944
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Jun 12, 2025
faff130
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Jun 13, 2025
5a472b7
fix setup.py
mohamedawnallah Jun 13, 2025
ab0a6de
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Jun 27, 2025
1083b18
sdks/python: fix linting issues
mohamedawnallah Jun 27, 2025
fe6d7d0
sdks/python: connect to beam cloudsql itest instance
mohamedawnallah Jun 27, 2025
0e89819
.github: trigger postcommits python
mohamedawnallah Jun 27, 2025
3a0bfc1
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Jun 27, 2025
ef10655
sdks/python: update base image requirements
mohamedawnallah Jun 27, 2025
40cdd73
.github: trigger beam postcommit python sdk
mohamedawnallah Jun 27, 2025
8c755bb
examples+transforms: configure sql databases for transform exmaples
mohamedawnallah Jun 28, 2025
72d8725
apache_beam: fix dependencies
mohamedawnallah Jun 28, 2025
5a4ed41
sdks/python: update `get_connector_handler` python docstring
mohamedawnallah Jun 28, 2025
e214ce5
sdks/python: fix linting for cloudsql
mohamedawnallah Jun 28, 2025
b2202c4
.github: trigger post commits python
mohamedawnallah Jun 28, 2025
b06eff7
sdks/python+website: update docs and fix linting issues
mohamedawnallah Jun 28, 2025
082571d
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Jun 28, 2025
2abba91
CHANGES.md: update release notes
mohamedawnallah Jun 28, 2025
3cd98e4
.github: trigger postcommit python CI
mohamedawnallah Jun 28, 2025
ce0da2f
sdks/python: fix linting issues
mohamedawnallah Jun 29, 2025
9b546ab
.github: trigger postcommit python CI
mohamedawnallah Jun 29, 2025
5931d65
sdks/python: fix linting issues
mohamedawnallah Jun 29, 2025
e57cba6
.github: trigger postcommit python CI
mohamedawnallah Jun 29, 2025
7e13c17
sdks/python: fix `examples` CI for cloudSQL enrichment
mohamedawnallah Jun 29, 2025
37eeec2
.github: trigger postcommit python CI
mohamedawnallah Jun 29, 2025
73b55ff
.github/workflows: include `ALLOYDB_PASSWORD` env in precommit python…
mohamedawnallah Jun 29, 2025
a6775a7
sdks/python: fix linting issues for `cloudsql`
mohamedawnallah Jun 29, 2025
82602ed
sdks/python: fix linting issues for `enrichment_test.py`
mohamedawnallah Jun 29, 2025
c906209
.github: trigger postcommit
mohamedawnallah Jun 29, 2025
7a92a99
.github+website+sdks/python: remove non-functional docs
mohamedawnallah Jun 29, 2025
da35a23
.github: trigger postcommit python CI
mohamedawnallah Jun 29, 2025
44aac80
sdks/python: generate unique table for itest
mohamedawnallah Jul 2, 2025
e0affe2
.github: enable access to `ALLOYDB_PASSWORD` in precommit py transforms
mohamedawnallah Jul 2, 2025
38263c2
.github: trigger post commit python
mohamedawnallah Jul 2, 2025
cbaea63
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Jul 2, 2025
f1e78b8
sdks/python: update py39 image requirements
mohamedawnallah Jul 2, 2025
fc2e073
.github: trigger postcommit python
mohamedawnallah Jul 2, 2025
a95d984
sdks/python: update image requirements
mohamedawnallah Jul 2, 2025
4da20c9
.github: trigger postcommit python
mohamedawnallah Jul 2, 2025
6e35a60
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Jul 7, 2025
a78be8a
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Jul 8, 2025
2f38a59
.github: trigger postcommit python
mohamedawnallah Jul 8, 2025
7819821
sdks/python: fix local unbound variable
mohamedawnallah Jul 8, 2025
759f307
.github: trigger postcommit python
mohamedawnallah Jul 8, 2025
47d8da5
sdks/python: remove params
mohamedawnallah Jul 8, 2025
363873f
.github: trigger beam post commit python
mohamedawnallah Jul 8, 2025
13ee4f3
sdks/python: experiment with my google cloud
mohamedawnallah Jul 9, 2025
6f67233
sdks/python: revert `ALLOYDB_PASSWORD` env var in precommit py transf…
mohamedawnallah Jul 9, 2025
95214e3
sdks/python: skip cloudsql tests if `ALLOYDB_PASSWORD` not set
mohamedawnallah Jul 9, 2025
948b8ba
.github: trigger postcommit python
mohamedawnallah Jul 9, 2025
09e3606
sdks/python: address gemini feedback
mohamedawnallah Jul 13, 2025
bf059d1
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Jul 19, 2025
7b6ba8f
.github: trigger postcommit python
mohamedawnallah Jul 19, 2025
b915a1a
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Jul 21, 2025
84d5e4f
.github: trigger postcommit python
mohamedawnallah Jul 21, 2025
5462138
sdks/python: fix linting issues
mohamedawnallah Jul 21, 2025
a55ab60
sdks/python: fix linting issues
mohamedawnallah Jul 22, 2025
42652ac
.github: trigger post commit python
mohamedawnallah Jul 22, 2025
b77232f
sdks/python: fix linting issues
mohamedawnallah Jul 22, 2025
ffd2f38
.github: trigger postcommit python
mohamedawnallah Jul 22, 2025
318a8bf
sdks/python: fix linting issues
mohamedawnallah Jul 22, 2025
2f21f7f
.github: trigger postcommit python
mohamedawnallah Jul 22, 2025
b8f7e7a
sdks/python: fix linting issues
mohamedawnallah Jul 22, 2025
17cff20
.github: trigger postcommit python
mohamedawnallah Jul 22, 2025
7be26c1
sdks/python: fix linting issues
mohamedawnallah Jul 22, 2025
7fbeb5c
sdks/python: fix SQL injection
mohamedawnallah Aug 3, 2025
c706a7d
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Aug 3, 2025
f9d0005
CHANGES.md: update release notes
mohamedawnallah Aug 3, 2025
4c69da0
sdks/python: fix formatting issues
mohamedawnallah Aug 3, 2025
d8c4ae1
sdks/python: fix linting issues
mohamedawnallah Aug 3, 2025
4da4af1
sdks/python: update py image requirements
mohamedawnallah Aug 3, 2025
a81fe24
.github: trigger postcommit python
mohamedawnallah Aug 3, 2025
eb5e34f
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Aug 15, 2025
3f16f13
sdks/python: try to fix python doc linting issues
mohamedawnallah Aug 15, 2025
436a97b
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Aug 16, 2025
ac0c137
sdks/python: fix linting issues
mohamedawnallah Aug 16, 2025
1ca2967
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
mohamedawnallah Aug 20, 2025
6a668d3
.github: trigger postcommit python
mohamedawnallah Aug 20, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/trigger_files/beam_PostCommit_Python.json
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
{
"comment": "Modify this file in a trivial way to cause this test suite to run.",
"modification": 35
"modification": 33
}

1 change: 0 additions & 1 deletion .github/workflows/beam_PreCommit_Python_Transforms.yml
Original file line number Diff line number Diff line change
Expand Up @@ -53,7 +53,6 @@ env:
DEVELOCITY_ACCESS_KEY: ${{ secrets.DEVELOCITY_ACCESS_KEY }}
GRADLE_ENTERPRISE_CACHE_USERNAME: ${{ secrets.GE_CACHE_USERNAME }}
GRADLE_ENTERPRISE_CACHE_PASSWORD: ${{ secrets.GE_CACHE_PASSWORD }}
ALLOYDB_PASSWORD: ${{ secrets.ALLOYDB_PASSWORD }}

jobs:
beam_PreCommit_Python_Transforms:
Expand Down
4 changes: 4 additions & 0 deletions CHANGES.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,6 +76,10 @@
* BigtableRead Connector for BeamYaml added with new Config Param ([#35696](https://github.com/apache/beam/pull/35696))
* Introduced a dedicated module for JUnit-based testing support: `sdks/java/testing/junit`, which provides `TestPipelineExtension` for JUnit 5 while maintaining backward compatibility with existing JUnit 4 `TestRule`-based tests (Java) ([#18733](https://github.com/apache/beam/issues/18733), [#35688](https://github.com/apache/beam/pull/35688)).
- To use JUnit 5 with Beam tests, add a test-scoped dependency on `org.apache.beam:beam-sdks-java-testing-junit`.
* Google CloudSQL enrichment handler added (Python) ([#34398](https://github.com/apache/beam/pull/34398)).
Beam now supports data enrichment capabilities using SQL databases, with built-in support for:
- Managed PostgreSQL, MySQL, and Microsoft SQL Server instances on CloudSQL
- Unmanaged SQL database instances not hosted on CloudSQL (e.g., self-hosted or on-premises databases)

## Breaking Changes

Expand Down
Loading
Loading