Skip to content

Add Pig-specific file handling to Avro parser#9258

Merged
jihoonson merged 3 commits intoapache:masterfrom
a2l007:respawn_pig
Feb 11, 2020
Merged

Add Pig-specific file handling to Avro parser#9258
jihoonson merged 3 commits intoapache:masterfrom
a2l007:respawn_pig

Conversation

@a2l007
Copy link
Copy Markdown
Contributor

@a2l007 a2l007 commented Jan 26, 2020

Fixes #9211 .

Description

Adds Pig-specific data file handling back to the avro hadoop parser. The tests are no longer dependent on Apache Pig since the dependency was the primary reason why the functionality was removed.


This PR has:

  • been self-reviewed.
  • added documentation for new or modified features or behaviors.
  • added unit tests or modified existing tests to cover new code paths.
  • been tested in a test Druid cluster.

@gianm
Copy link
Copy Markdown
Contributor

gianm commented Feb 5, 2020

@a2l007 Could you please add fromPigAvroStorage and AvroStorage to the spellcheck file?

(See https://travis-ci.org/apache/druid/jobs/642082497)

@a2l007
Copy link
Copy Markdown
Contributor Author

a2l007 commented Feb 7, 2020

@gianm Fixed that, but it looks like build is timing out now. Could you please restart the build?

@jihoonson
Copy link
Copy Markdown
Contributor

Restarted the failed one.

@jihoonson
Copy link
Copy Markdown
Contributor

@a2l007 thanks for the fix!

@jihoonson jihoonson merged commit 7968524 into apache:master Feb 11, 2020
@jihoonson jihoonson added this to the 0.18.0 milestone Mar 26, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Reanimate Pig specific handling in the Avro parser

4 participants