Return partial code and error message from unexpected token exception.

[Sindre01]

Hi!
Currently when dev_mode=True, an excpetion is thrown with an error of unexpected token. However, it would be really usefull to be able to get the partial code as well. Then we could use this information in self-refinements loops to generate even better code.

Impact: This is escpecially usefull in cases of very low-resource languages, that LLMs struggles with. Currently for my cases, the LLM gets stuck on producing reserved keywords in unexpected cases (where identifier is excpected)..

[shubhamugare]

Hi,

Did you try using the debug flag?

[Sindre01]

Yes, but i does not return the complete partial code up to where the parser error occured.