ARK v0.4.0 Release Plan (Released)

[chhwang]

Timeline

Released Date: Nov. 14th, 2023

Work Items (TBU)

Platforms Support

1. • ROCm: add ROCm backend support (ROCm support #162)

Operators Support

1. • [ ] Operator: add int8 operators (dropping this plan for now)
2. • Operator: add more AllReduce & AllGather algorithms (Add msll support #152)

Examples

1. • [ ] Example: add Llama2 multi-GPU examples (moved to the next version release)

CI

1. • [ ] Unit Tests: revise Python unit tests & add to the Azure pipeline (moved to the next version release)
2. • [ ] Code Coverage: add code coverage for Python code (moved to the next version release)

Bug Fix

• Fix instrinsic type casting issues #145
• Fix the embedding kernel #147
• Fix softmax & norm perf bugs #150
• Set CUDA context before memcpy #151
• Fix unnecessarily large paddings #153
• Code cleanup & bug fixes #158
• Adjust paddings according to the original shape #160
• Fix perf bugs #167

[chhwang]

Released: https://github.com/microsoft/ark/releases/tag/v0.4.0