Skip to content

[Task]: TypedSchemaTransformProvider should generate Schema field names with lower_snake_case convention #31061

@ahmedabu98

Description

@ahmedabu98

What needs to happen?

TypedSchemaTransformProvider takes advantage of DefaultSchema and AutoValueSchema to convert an AutoValue config object to a Row.
AutoValueSchema is a GetterBasedSchemaProvider which simply infers names from an object's getter methods. The end result is a Row with field names in lowerCamelCase convention.

Since SchemaTransforms are intended for external (ie. non-Java) languages, we want to generate field names that are in lower_snake_case convention. Preferably, this would be done directly in TypedSchemaTransformProvider.

P.S. TypedSchemaTransformProvider's configFromRow() method should also be updated to accept a row with snake_case field names.

Issue Priority

Priority: 3 (nice-to-have improvement)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions