[lora] add lora APIs for booster, support lora for TorchDDP#4981

Merged

Fridge003 merged 11 commits intohpcaitech:feature/lorafrom

Fridge003:feature/lora

Oct 31, 2023

Commits on Oct 25, 2023

add apis and peft requirement
Baizhou Zhang
committed
add liscense and implement apis
Baizhou Zhang
committed
add checkpointio apis
Baizhou Zhang
committed

Commits on Oct 26, 2023

add torchddp fwd_bwd test
Baizhou Zhang
committed
add support_lora methods
Baizhou Zhang
committed
add checkpointio test and debug
Baizhou Zhang
committed
delete unneeded codes
Baizhou Zhang
committed

Commits on Oct 27, 2023

remove peft from LICENSE
Baizhou Zhang
committed
add concrete methods for enable_lora
Baizhou Zhang
committed
simplify enable_lora api
Baizhou Zhang
committed

Commits on Oct 31, 2023

fix requirements
Baizhou Zhang
committed