make sure all git clone have git reset #424
Description
During evaluation we want to test a git repository.
To prevent the agent from looking at commits that are not part of the benchmark let's make sure that after every git clone we do a git reset. We want this as a validation script that everytime it finds a git clone or a git checkout, checks for a git reset afterwards and fails if there isn't one.
The check should be simple and always fail if there isn't a git reset. Let's count git reset inside a a comment, so that we can write something like
#"git reset" is not needed here, leaving comment for validation script
or similar.
The important thing is that the validation will make it easy to check if the git reset is needed or not.
So
- write the validation script
- run it and add the git reset where they are needed.