Python/ruff
1
0
Fork 0
mirror of https://github.com/astral-sh/ruff synced 2026-01-22 14:00:51 -05:00
Code Issues Packages Projects Releases Wiki Activity

Move Token, TokenKind and Tokens to ruff-python-ast (#21760)

Browse Source
This commit is contained in:
Micha Reiser
2025-12-02 20:10:46 +01:00
committed by GitHub
parent 508c0a0861
commit 515de2d062
80 changed files with 1484 additions and 1492 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
crates/ruff_python_parser/src/token_source.rs
View File

@@ -1,10 +1,11 @@
use ruff_python_ast::token::{Token, TokenFlags, TokenKind};
use ruff_text_size::{Ranged, TextRange, TextSize};
use crate::Mode;
use crate::error::LexicalError;
use crate::lexer::{Lexer, LexerCheckpoint};
use crate::string::InterpolatedStringKind;
use crate::token::{Token, TokenFlags, TokenKind, TokenValue};
use crate::token::TokenValue;
/// Token source for the parser that skips over any trivia tokens.
#[derive(Debug)]