Skip to content

Optimize RS encode/decode with Intel ISA-L #18

@adammoody

Description

@adammoody

Intel has an open-source library supporting vectorized functions to compute RS GF(2^8) math:

https://01.org/intel%C2%AE-storage-acceleration-library-open-source-version
https://github.com/intel/isa-l

This is licensed under BSD-3. It looks like it may also support processors other than just Intel, including PowerPC. This could offer a performance boost for our internal RS encoding.

For example, the gf_vect_mul function here:

https://github.com/intel/isa-l/blob/master/include/gf_vect_mul.h

might plug in for:

void redset_rs_reduce_buffer_multadd(

This will take some developer time to make the switch, and it adds a dependency. Also, if we are bottlenecked by storage or network bandwidth, reducing encode/decode time may not improve overall performance by much. So some work should be done to investigate before taking this on.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions