mirror of https://github.com/astral-sh/ruff synced 2026-01-09 15:44:22 -05:00

Files

Dhruv Manilawala 025768d303 Add Tokens newtype wrapper, TokenKind iterator (#11361 )

## Summary

Alternative to #11237 

This PR adds a new `Tokens` struct which is a newtype wrapper around a
vector of lexer output. This allows us to add a `kinds` method which
returns an iterator over the corresponding `TokenKind`. This iterator is
implemented as a separate `TokenKindIter` struct to allow using the type
and provide additional methods like `peek` directly on the iterator.

This exposes the linter to access the stream of `TokenKind` instead of
`Tok`.

Edit: I've made the necessary downstream changes and plan to merge the
entire stack at once.

2024-05-14 16:45:04 +00:00

src

Remove cyclic dev dependency with the parser crate (#11261 )

2024-05-07 09:24:57 +00:00

tests

Add Tokens newtype wrapper, TokenKind iterator (#11361 )

2024-05-14 16:45:04 +00:00

Cargo.toml

Move sub-crates to workspace dependencies (#11407 )

2024-05-13 14:37:50 +00:00

README.md

Remove cyclic dev dependency with the parser crate (#11261 )

2024-05-07 09:24:57 +00:00

README.md

Integration tests for `ruff_python_trivia`

This crate includes integration tests for the ruff_python_trivia crate.

The reason for having a separate crate is to avoid introducing a dev circular dependency between the ruff_python_parser crate and the ruff_python_trivia crate.

This crate shouldn't include any code, only tests.

Reference:

rust-analyzer issue: https://github.com/rust-lang/rust-analyzer/issues/3390
Ruff's pull request: https://github.com/astral-sh/ruff/pull/11261

README.md

Integration tests for ruff_python_trivia

Integration tests for `ruff_python_trivia`