[inference] refactor code for smoothquant #4902

Xu-Kai merged 1 commit intohpcaitech:feature/smoothquanthpcaitech/ColossalAI:feature/smoothquantfrom

Xu-Kai:feature/smoothquantXu-Kai/ColossalAI:feature/smoothquantCopy head branch name to clipboard