Indexing a codebase doesn't respect ignore file

[sttlr]

Hi!

metis doesn't respect ignore files (.gitignore, .metisignore) when indexing a codebase. Even though I've set it in metisignore_file parameter in metis.yaml.

So because of that my 350 Mb node_modules folder gets indexed:

This wastes a lot of tokens, time, and makes embeddings search much worse in quality - like finding a needle in a haystack of node_modules.

I've checked the metis code - and the issue is that ignore files aren't used at all during codebase indexing.

If something is not worth being in a repo it also shouldn't be indexed too.

I propose respecting ignore files when indexing a codebase.