[bench] Add bloom inference benchmark#4621

tiandiao123 merged 2 commits intohpcaitech:feature/colossal-inferencehpcaitech/ColossalAI:feature/colossal-inferencefrom

yuanheng-zhao:colossal-inference/bloom-benchmarkyuanheng-zhao/ColossalAI:colossal-inference/bloom-benchmarkCopy head branch name to clipboard