Reshape fails for large arrays

[milenak]

We are trying to use blz to store and reshape very large UInt16 arrays (5000x3e9).

The machine has 60GB of RAM if that is of importance.

Here is an example of code breaking:

In [1]: import blz
In [2]: size = int(1e6)
In [3]: b = blz.zeros(size).reshape((size/2, 2))
In [4]: b
Out[4]: 
barray((500000, 2), float64)
  nbytes: 7.63 MB; cbytes: 88.78 KB; ratio: 88.00
  bparams := bparams(clevel=5, shuffle=True, cname=blosclz)
[[ 0.  0.]
 [ 0.  0.]
 [ 0.  0.]
 ..., 
 [ 0.  0.]
 [ 0.  0.]
 [ 0.  0.]]

In [5]: size = int(5e9)
In [6]: b = blz.zeros(size).reshape((size/2, 2))
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-6-0214aa15e7ec> in <module>()
----> 1 b = blz.zeros(size).reshape((size/2, 2))

/data_ebs/anaconda/lib/python2.7/site-packages/blz/blz_ext.so in blz.blz_ext.barray.reshape (blz/blz_ext.c:18541)()

ValueError: total size of new array must be unchanged