Hey there,
I'm having an issue ingesting streams of Avro where an object may or may not be present.
E.G. Some messages might look like
{"something_else": "some_value"}
and others
{"something_else": "some_value", "maybe_object": {"my_key", "my_value"}}
The following JSONPath
$.maybe_object.my_key
Will evaluate as null for the first message when using JSON but will throw a com.jayway.jsonpath.PathNotFoundException when using AVRO.
I believe this is because JSONFlattenerMake.JSONPATH_CONFIGURATION sets a suppress_exceptions option, whereas the AvroFlattenerMake doesn't.
@gianm - was this on purpose or would it be safe to also set this option for the Avro flattener maker?
Hey there,
I'm having an issue ingesting streams of Avro where an object may or may not be present.
E.G. Some messages might look like
{"something_else": "some_value"}and others
{"something_else": "some_value", "maybe_object": {"my_key", "my_value"}}The following JSONPath
$.maybe_object.my_keyWill evaluate as null for the first message when using JSON but will throw a com.jayway.jsonpath.PathNotFoundException when using AVRO.
I believe this is because JSONFlattenerMake.JSONPATH_CONFIGURATION sets a suppress_exceptions option, whereas the AvroFlattenerMake doesn't.
@gianm - was this on purpose or would it be safe to also set this option for the Avro flattener maker?