Skip to content

Update lexer peek and token reuse tests. - #22

Merged
gafter merged 3 commits into
mainfrom
issue-token-reuse-test
Feb 3, 2026
Merged

gafter merged 3 commits into
mainfrom
issue-token-reuse-test

Conversation

@gafter

@gafter gafter commented Feb 3, 2026

Copy link
Copy Markdown
Owner

Use lookahead peek without pushback, adjust tail reuse matching by shifted spans, and expand reuse test coverage.

gafter and others added 3 commits February 2, 2026 16:08
Use lookahead peek without pushback, adjust tail reuse matching by shifted spans, and expand reuse test coverage.

Co-authored-by: Cursor <cursoragent@cursor.com>
Route lexer peeks through a guarded helper and apply MaxLookahead
when computing left and right change boundaries.

Co-authored-by: Cursor <cursoragent@cursor.com>
Guard ITextCharacterSource.PeekCharacter against negative deltas.

Co-authored-by: Cursor <cursoragent@cursor.com>
@gafter
gafter merged commit e72b521 into main Feb 3, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant