Add unit tests for LLMs (keeping in mind cost)

[luca-martial]

To avoid incurring costs, we can simulate the outputs from the different LLM APIs