gh-132769: Refactor possible read-out-of-bounds in lexer.c

gh-132769: Refactor possible read-out-of-bounds in lexer.c #166478