Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow to customize some behaviors of Lexer, so that Extension instances can know raw block begin and end info. #1963

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Allow to customize some behaviors of Lexer, so that Extension instances can know raw block begin and end info. #1963

wants to merge 2 commits into from

Commits on Apr 10, 2024

  1. Allow token_begin and token_end in stream to enable Extensions to tre… 

    …at "data" tokens differently

Add the lexer_provider attrib to Environment to allow provide custom lexer, e.g. for testing.

Test Plan:
- Run `pytest`
    @frankdu
    frankdu committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    6ce8488 View commit details
    Browse the repository at this point in the history

  2. Fix the typing annotation. 

    Test Plan:
- Run `tox run -e typing`
    @frankdu
    frankdu committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    5e3b7f9 View commit details
    Browse the repository at this point in the history