Skip to content
This repository was archived by the owner on Oct 14, 2020. It is now read-only.
This repository was archived by the owner on Oct 14, 2020. It is now read-only.

Support different data pipelines #142

@motin

Description

@motin

As explained in the readme at https://github.com/mozilla/shield-studies-addon-utils/tree/develop#data-processing-pipelines, utils v5 is expected to support different data pipelines.

In practice, this would be configured by a pipeline configuration entry in studySetup, set to one of the below values. UPDATE: the configuration entry is called studyType instead

Depending on which data processing pipeline the study add-on is configured to use, the pings end up in different destinations:

  • shield - The pings end up in the shield-study and shield-study-addon Telemetry buckets for faster analysis (like these: Most recent pings arriving to telemetry_shield_study_addon_parquet by study)
  • pioneer - The pings are encrypted and end up in the Pioneer processing pipeline
  • custom-telemetry-events - The pings are sent as custom telemetry events and end up in the ordinary destination for custom telemetry events

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions