[Infer] Fix TPInferEngine init & inference tests, benchmarks#4670

yuanheng-zhao merged 6 commits intohpcaitech:feature/colossal-inferencehpcaitech/ColossalAI:feature/colossal-inferencefrom

yuanheng-zhao:colossal-inference/fix-engineyuanheng-zhao/ColossalAI:colossal-inference/fix-engineCopy head branch name to clipboard