[chat] add unit tests

[cwher]

Description

Currently, Coati only has a few unit tests and integration tests. Thus, some parts of coati are not covered and may be buggy. This issue aims to add more unit tests, both from the system perspective and the algorithm perspective, for them.

The file structure of Coati is as follows,

We will test each of them iteratively.

TODOs

• Excluded files and directories are

  evaluate/*
  inference/*
  coati/ray/*
  coati/kernels/*
  coati/quant/*
  examples/ray/*
  examples/community/*
  benchmarks/ray/*

• Update ci/cd actions accordingly.
• Test coati/
  • Test dataset/
  • Test models/
  • Test experience_buffer/
  • Test experience_maker/
  • Test trainer/
• Test examples/
• Test benchmarks/