Hadoop Downloader Range not correct

[damccorm]

I found that the `HdfsDownloader.get_range(self, start, end)' get range {color:#ff0000}[start, end]{color} rather than {color:#ff0000}[start, end){color}. This will cause an error while reading hdfs file.

 

File "/data/anaconda3/envs/tfdv1.15/lib/python3.7/site-packages/apache_beam/io/tfrecordio.py", line 127, in read_record
buf = file_handle.read(buf_length_expected)
File "/data/anaconda3/envs/tfdv1.15/lib/python3.7/site-packages/apache_beam/io/filesystemio.py", line 123, in readinto
b[:len(data)] = data
ValueError: memoryview assignment: lvalue and rvalue have different structures

Imported from Jira BEAM-9152. Original Jira may contain additional context.
Reported by: Benjzhou.

[kennknowles]

@chamikaramj @udim this is a reopened recently, despite the Jira having a very early number. Seems like P1 is right if people are having data problems? Not a release blocker if it has been broken forever I guess?

[chamikaramj]

@Abacn will you be able to look into this ?

[Abacn]

.take-issue