[BEAM-10937] Tour of Beam: create landing page #13747

davidcavazos · 2021-01-13T21:38:32Z

Add a landing page for the "Tour of Beam" page. This consists of a linear path users can take to learn Apache Beam with interactive notebooks.

New notebooks will be added here to cover more topics.

R: @rosetn

Staged: http://apache-beam-website-pull-requests.storage.googleapis.com/13747/get-started/tour-of-beam/index.html

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

Choose reviewer(s) and mention them in a comment (R: @username).
Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
Update CHANGES.md with noteworthy changes.
If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

Post-Commit Tests Status (on master branch)

Lang	Dataflow	Samza	Twister2
Go	---	---	---
Java
Python		---	---
XLang		---	---

Pre-Commit Tests Status (on master branch)

---	Java	Python	Go	Website	Whitespace	Typescript
Non-portable
Portable	---		---	---	---	---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

rosetn

Hi, David! This page looks really nice, but I'm recommending that you either (1) don't use a table to layout the information but instead use the heading/text style that's present on most pages in these docs or (2) change this information into an actual table (e.g. using columns "Transform", "Description", "Colab") and formatting the and correctly.

This is because the way you've formatted now is difficult for a screenreader to pass through. You can also consider adding the and markup. You can read more about this topic on the W3C entry on HTML tables.

website/www/site/content/en/get-started/tour-of-beam.md

…rview

davidcavazos · 2021-02-05T22:50:03Z

Thanks for the comments. I reverted to just using headers and normal text in favor of simplicity.

…rview

rosetn

Looks great! Thank you!

davidcavazos · 2021-02-09T02:10:56Z

Hi @aaltay, can you take a look at this whenever you have a chance? I think it might be ready to merge if you think so too.

aaltay · 2021-02-09T17:40:54Z

LGTM.

But there is a vote on replacing the web page on the dev@ list. If we merge this now would it be part of the new website? (/cc @TheNeuralBit)

TheNeuralBit · 2021-02-09T17:51:01Z

I think it would just work, but there may be some merge conflicts to resolve. Would you mind if we wait to merge this until after #13871 goes in?

aaltay · 2021-02-23T21:20:30Z

I guess this can be merged now but needs a rebase?

TheNeuralBit · 2021-02-23T21:37:36Z

Yes #13871 has been merged, it looks like there are just some minor conflicts to resolve

TheNeuralBit · 2021-02-24T21:40:09Z

Thanks! Sorry about the delay

…gger * github/master: (123 commits) [BEAM-11899] Bump commons-pool to 2.8.1 and bump commons-dbcp to 2.8.0, Because there is a library dependency Update pillars.yaml (apache#14142) [BEAM-10632] Checkerframework nullness cleanups (apache#14107) [BEAM-11213] Instantiate SparkListenerApplicationStart in a Spark 3 compatible way Fix typos for excluding testMergingCustomWindowsWithoutCustomWindowTypes Specify the time resolution for TestStreamPayload. [BEAM-10961] Enable strict depdency checking for sdks/java/extensions/euphoria (second attempt) [BEAM-11848] Store Docker images in a variable for consistency. Splitting old Go Precommit and new ULR integration test precommit. Moving runner imports out of ptest. Add the TO_STRING capability to Java and Python [BEAM-11848] Fix Docker images list. jdbc python supported Dataflow runner (apache#13960) Adding a warning to use multi-workers on FnApiRunner Fix legend for Python Directrunner microbenchmarks [BEAM-11740] Estimate PCollection byte size [BEAM-10961] enable strict dependency checking for sdks/java/extensions/zetasketch (apache#14093) Map Dataflow JOB_STATE_CANCELLING to Beam RUNNING state [BEAM-11833] Fix reported watermark after restriction split in UnboundedSourceAsSDFRestrictionTracker [BEAM-10761] add reference to BEAM-11761 [BEAM-10961] enable strict dependency checking for flink/job-server Exclude MapState example integration tests from Dataflow runner v2 suite Remove InvalidWindows from Java SDK, instead track "already merged" bit Fix checkstyle in watermark latency benchmark Fix compile breakage in WindmillStateInternals Improve test, error on ALREADY_MERGED. [BEAM-10961] Strict dependency checking for sdks/java/io/gcp (apache#13791) Initial watermark latency benchmark Attempting improvements on DirectRunner Python dash [BEAM-10961] enable strict dependency checking for sdks/java/extensions/google-cloud-platform-core (apache#14084) Merge pull request apache#13802: [BEAM-1474]. Adding MapState and SetState support for the Dataflow runner Remove some false positives Remove nullness warning suppression [BEAM-11861] Add methods to explicitly provide coder for ParquetIO's Parse and ParseFiles (apache#14078) [BEAM-11531] Use pandas 1.2 for python>=3.7 (apache#14099) [BEAM-10961] add reference to BEAM-11761 [BEAM-10961] add explicit compile for auto_value_annotations in sdks/extensions/ml/build.gradle Attempting improvements on DirectRunner Python dash Recognize JOB_STATE_PENDING from Dataflow and map to RUNNING never run checkerframework on tests Puts more expensive BQ empty table check to the right of the 'and' condition (apache#14094) Use the windowing strategy of the input, not output, PCollection of GBK. Do not stage dataflow worker jar when use runner_v2. [BEAM-11870] Re-raise underlying exception for InvocationTargetException (apache#14098) [BEAM-11778] Create a wrapper for ZetaSQL catalog and refactor accordingly. (apache#13934) [BEAM-9378] Add ignored tests which fail in various ways when querying nested structures (apache#14077) Merge Fn API and runner v2 configurations for DataflowRunner Fix up! formatting Add validate runner test for testing custom merging windows fn without custom window types Revert "Revert "[BEAM-2914] Add portable merging window support to Python. (apache#12995)"" [BEAM-10961] fix stray reordering of lines [BEAM-10961] enable strict dependency checking for sdks/java/extensions/sorter [BEAM-10961] enable strict dependency checking for sdks/java/extensions/sketching [BEAM-10961] enable strict dependency checking for sdks/java/extensions/schemaio-expansion-service [BEAM-10961] enable strict dependency checking for sdks/java/extensions/protobuf [BEAM-10961] enable strict dependency checking for sdks/java/extensions/ml [BEAM-10961] enable strict dependency checking for sdks/java/extensions/kyro [BEAM-10961] enable strict dependency checking for sdks/java/extensions/join-library [BEAM-10961] undo line moves (originally intended for alphabeticization) [BEAM-10961] enable strict dependency checking for sdks/java/extensions/jackson [BEAM-10961] Enable strict dependency checking on sdks/java/extensions/sql (apache#13830) [BEAM-10961] enable strict dependency checking for sdks/java/extensions/euphoria [BEAM-10961] enable strict dependency checking for sdks/java/io/parquet (apache#14062) [BEAM-10961] enable strict dependency checking for sdks/java/io/thrift (apache#14066) Refactor ZetaSqlDialectSpecTest and add some passing tests. (apache#14080) [BEAM-11864] Use objects.equals instead of raw comparison [BEAM-11707] Change WindmillStateCache cache invalidation to be based upon reference invalidation instead of expensive set management. Reduce operations of shared cache by caching per-key object sets locally and flushing as groups to shared cache. Remove byte tracking which could be racy based upon background evictions in favor of just iterating for rendering the status page. This also lets us capture more stats. [BEAM-11730] Reduce context switching overhead for appliance reads by issuing reads directly from calling threads in the case that there is no reads being queued. Fix preview Show string from Dataflow service when job terminates in unrecognized state Log a warning when Dataflow returns an unrecognized state Merge pull request apache#14033 from [BEAM-11408] Integrate Python BigQuery sink with GroupIntoBatches Remove SYNCHRONIZED_PROCESSING_TIME from model proto Remove use of model SYNCHRONIZED_PROCESSING_TIME Merge redundant model feature columns in capability matrix Remove MapReduce runner from capability matrix, because it is on a branch and unreleased Remove JStorm runner from capability matrix, because it is on a branch and unreleased Remove retractions from capability matrix, because they do not exist yet Remove metadata-driven triggers from capability matrix, because they do not exist [BEAM-10937] Add Tour of Beam page (apache#13747) [BEAM-11344] Apply "Become a Committer" changes from Website Revamp (apache#14036) Merge pull request apache#14046 from [BEAM-11791] Adding a microbenchmark for TestStream Returning successful writes in FhirIO.Write.Result (apache#14034) Fixup [BEAM-10961] enable strict dependency checking for sdks/java/io/file-based-io-tests (apache#14052) [BEAM-10961] enable strict dependency checking for sdks/java/io/contextualtextio (apache#14049) [BEAM-10961] enable strict dependency checking for sdks/java/io/kinesis (apache#14058) [BEAM-10961] enable strict dependency checking for sdks/java/io/bigquery-io-perf-tests (apache#14048) [BEAM-10961] enable strict dependency checking for sdks/java/io/elasticsearch (apache#14050) [BEAM-10961] enable strict dependency checking for sdks/java/io/expansion-service (apache#14051) [BEAM-10961] enable strict dependency checking for sdks/java/io/jdbc (apache#14055) [BEAM-10961] enable strict dependency checking for sdks/java/io/jms (apache#14056) [BEAM-10961] enable strict dependency checking for sdks/java/io/kafka (apache#14057) [BEAM-10961] enable strict dependency checking for sdks/java/io/hcatalog (apache#14053) [BEAM-11859] Fixed bug in python S3 IO [BEAM-10114] Fix PerSubscriptionPartitionSdf to not rely on the presence of BundleFinalizer [BEAM-10114] Fix PerSubscriptionPartitionSdf to not rely on the presence of BundleFinalizer [BEAM-10961] fix spacing [BEAM-10961] enable strict dependency checking for sdks/java/io/xml [BEAM-10961] enable strict dependency checking for sdks/java/io/tika ...

Add Tour of Beam page

88f7983

davidcavazos changed the title ~~Add Tour of Beam page~~ [BEAM-10937] Add Tour of Beam page Jan 13, 2021

rosetn suggested changes Jan 19, 2021

View reviewed changes

website/www/site/content/en/get-started/tour-of-beam.md Outdated Show resolved Hide resolved

David Cavazos added 2 commits February 5, 2021 14:48

Removed table layout

ea4a47f

Merge branch 'master' of github.com:apache/beam into tour-of-beam-ove…

6655cf1

…rview

David Cavazos added 2 commits February 8, 2021 10:50

Align buttons to left

3fc419b

Merge branch 'master' of github.com:apache/beam into tour-of-beam-ove…

063fff0

…rview

rosetn approved these changes Feb 9, 2021

View reviewed changes

davidcavazos mentioned this pull request Feb 23, 2021

[BEAM-10937] Tour of Beam: Reading and writing data notebook #14045

Merged

4 tasks

David Cavazos added 3 commits February 24, 2021 08:43

Merge branch 'master' into tour-of-beam-overview

3a2f368

Undo changes

e322d25

Add newline at EOF

6580cc7

TheNeuralBit merged commit 96866e6 into apache:master Feb 24, 2021

davidcavazos deleted the tour-of-beam-overview branch February 26, 2021 17:07

davidcavazos changed the title ~~[BEAM-10937] Add Tour of Beam page~~ [BEAM-10937] Tour of Beam: create landing page Mar 3, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[BEAM-10937] Tour of Beam: create landing page #13747

[BEAM-10937] Tour of Beam: create landing page #13747

Uh oh!

davidcavazos commented Jan 13, 2021 •

edited

Loading

Uh oh!

rosetn left a comment

Uh oh!

Uh oh!

davidcavazos commented Feb 5, 2021

Uh oh!

rosetn left a comment

Uh oh!

davidcavazos commented Feb 9, 2021

Uh oh!

aaltay commented Feb 9, 2021

Uh oh!

TheNeuralBit commented Feb 9, 2021

Uh oh!

aaltay commented Feb 23, 2021

Uh oh!

TheNeuralBit commented Feb 23, 2021

Uh oh!

TheNeuralBit commented Feb 24, 2021

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

[BEAM-10937] Tour of Beam: create landing page #13747

[BEAM-10937] Tour of Beam: create landing page #13747

Uh oh!

Conversation

davidcavazos commented Jan 13, 2021 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Post-Commit Tests Status (on master branch)

Pre-Commit Tests Status (on master branch)

GitHub Actions Tests Status (on master branch)

Uh oh!

rosetn left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

davidcavazos commented Feb 5, 2021

Uh oh!

rosetn left a comment

Choose a reason for hiding this comment

Uh oh!

davidcavazos commented Feb 9, 2021

Uh oh!

aaltay commented Feb 9, 2021

Uh oh!

TheNeuralBit commented Feb 9, 2021

Uh oh!

aaltay commented Feb 23, 2021

Uh oh!

TheNeuralBit commented Feb 23, 2021

Uh oh!

TheNeuralBit commented Feb 24, 2021

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

davidcavazos commented Jan 13, 2021 •

edited

Loading