[infer]Fix some bugs in test_llama and test_bloom#4635

tiandiao123 merged 1 commit intohpcaitech:feature/colossal-inferencehpcaitech/ColossalAI:feature/colossal-inferencefrom

isky-cd:feature/colossal-inferenceisky-cd/ColossalAI:feature/colossal-inferenceCopy head branch name to clipboard