[infer] Fix engine - tensors on different devices#4570

yuanheng-zhao merged 7 commits intohpcaitech:feature/colossal-inferencehpcaitech/ColossalAI:feature/colossal-inferencefrom

yuanheng-zhao:colossal-inference/fix-engineyuanheng-zhao/ColossalAI:colossal-inference/fix-engineCopy head branch name to clipboard