Python
/
ruff
mirror of https://github.com/astral-sh/ruff
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
353 Commits 517 Branches 394 Tags 246 MiB
Commit Graph

235 Commits

Author SHA1 Message Date
Micha Reiser 08ebbe40d7
Fix ArgWithDefault TextRange (#13) 2023-06-20 18:21:09 +02:00
Charlie Marsh ed3b4eb72b
Add `TextRange` to `Identifier` (#8) 
## Summary

This PR adds `TextRange` to `Identifier`. Right now, the AST only
includes ranges for identifiers in certain cases (`Expr::Name`,
`Keyword`, etc.), namely when the identifier comprises an entire AST
node. In Ruff, we do additional ad-hoc lexing to extract identifiers
from source code.

One frequent example: given a function `def f(): ...`, we lex to find
the range of `f`, for use in diagnostics.

Another: `except ValueError as e`, for which the AST doesn't include a
range for `e`.

Note that, as an optimization, we avoid storing the `TextRange` for
`Expr::Name`, since it's already included.
 2023-06-20 11:19:27 -04:00
Charlie Marsh f0d200c8a1
Remove `fold`, `unparse`, and `location` features (#9) 2023-06-19 17:26:17 -04:00
Charlie Marsh 21aa0b8d84
Optimize `validate_arguments` (#10) 2023-06-19 15:32:58 -04:00
Charlie Marsh 9cb00518e5 Update snapshot tests 2023-06-19 13:16:07 -04:00
Micha Reiser 6f65c5cba7 Add `Decorator` node (#7) 2023-06-19 12:53:05 -04:00
Micha Reiser 8a415fa61e Include argument parentheses in range (#5) 2023-06-19 12:51:18 -04:00
Micha Reiser 5054cbe84f Merge branch 'RustPython:main' into main 2023-06-19 12:38:24 -04:00
Jeong, YunWon 69d27d924c
Rename unconventional nodes (#74) 2023-06-17 01:54:00 +09:00
Steve Shi a2e3209c42
Replace num-bigint with malachite-bigint (#18) 
Co-authored-by: Jeong YunWon <jeong@youknowone.org>
 2023-06-02 17:06:18 +09:00
Jeong, YunWon fdec727f80
New Arguments and Arg/ArgWithDefault AST representation (#59) 2023-06-01 01:15:23 +09:00
Jeong, YunWon 3fbf4f6804
Parse for expr and stmt variants + identifier, constant (#78) 2023-05-31 20:03:46 +09:00
Micha Reiser 342cd19f50
Add safety comment 2023-05-31 09:37:48 +02:00
Micha Reiser 4a2c4aad0b
Align `MatchCase` end location 2023-05-30 17:31:51 +02:00
Jeong, YunWon 4de0cb1827
Parse Trait (#71) 2023-05-28 21:03:27 +09:00
Micha Reiser 5493c9f4e3
Avoid removing elements from the beginning of a vec (#69) 2023-05-25 19:44:49 +09:00
Micha Reiser 41a0ef8740
Add test 2023-05-19 10:14:46 +02:00
Micha Reiser 25cc1da319
Include decorators in `Class` and `FunctionDef` range 2023-05-19 08:18:43 +02:00
Micha Reiser fac0c25343
Update `python.rs` 2023-05-19 08:08:35 +02:00
Micha Reiser 4ff779c298
Update parser/src/python.lalrpop 
Co-authored-by: Jeong, YunWon <69878+youknowone@users.noreply.github.com>
 2023-05-18 22:32:05 +02:00
Micha Reiser 726884b287
Avoid allocating `vec`s for each statement 2023-05-18 21:56:17 +02:00
Micha Reiser 851f23668f
Use named parameters to reducue copying 2023-05-18 21:41:06 +02:00
Jeong, YunWon 6c5c311bab
Fix range field order (#56) 
* Skip validate_arguments when empty

* Fix `range` field order

* Fix unused variable
 2023-05-18 21:44:01 +09:00
Jeong, YunWon ff17f6e178
Add utilities to enum (#44) 
* Add utilities to enum

* Fix unexpected pyo3 dependency propagation
 2023-05-16 23:29:49 +09:00
Jeong, YunWon 9d47d3d212
specialize ConversionFlag (#42) 
* specialize ConversionFlag

* Change value of ConversionFlag to i8 and None to -1

* is_* methods to ConversionFlag
 2023-05-16 22:52:50 +09:00
Jeong, YunWon 0c7d16b61a
Add is_* methods to Tok (#39) 2023-05-16 16:08:25 +09:00
Jeong, YunWon 735c06d5f4
Fix full-lexer feature (#38) 2023-05-16 15:45:03 +09:00
Charlie Marsh 10dda125ff
Always emit non-logical newlines for 'empty' lines (#27) 2023-05-15 14:13:05 -04:00
Jeong, YunWon 27e3873dc2
Add full-lexer feature (#36) 2023-05-16 02:21:34 +09:00
Micha Reiser dd4cc25227
Reduce copying elements when parsing (#35) 2023-05-15 23:20:44 +09:00
Micha Reiser 192379cede
Move `range` from `Attributed` to `Node`s (#22) 
* Move `range` from `Attributed` to `Node`s

* No Attributed + custom for Range PoC

* Generate all located variants, generate enum implementations

* Implement `Copy` on simple enums

* Move `Suite` to `ranged` and `located`

* Update tests
---------

Co-authored-by: Jeong YunWon <jeong@youknowone.org>
 2023-05-15 15:08:12 +09:00
Micha Reiser a983f4383f
Add `format` and `cformat` modules from `RustPython` (#24) 
* Add `format` and `cformat` modules from `RustPython`

* Introduce `rustpython-format` crate

* Remove unused dependencies
 2023-05-12 18:27:05 +09:00
Jeong YunWon cbe4e8c5f3 Make parser location optional 2023-05-11 04:40:10 +09:00
Jeong YunWon aabc96dde9 ruff integration support 2023-05-11 04:08:57 +09:00
Jeong YunWon 822cac5aa0 parse_expression{=>_starts}_at 2023-05-10 21:25:58 +09:00
Jeong YunWon aa101e4f26 fix ImportDots 2023-05-10 20:31:04 +09:00
Jeong YunWon 6fa3d0f90a Fine-tune int types 2023-05-10 19:33:39 +09:00
Jeong YunWon 455bcc01a0 Give identifier and int ast types 2023-05-10 19:33:39 +09:00
Jeong YunWon 1d366d52ab Let `located` only for python located stuff 2023-05-10 14:35:38 +09:00
Jeong YunWon a3d9d8cb14 numerous refactoring 
- Split parser core and compiler core. Fix #14
- AST int type to `u32`
- Updated asdl_rs.py and update_asdl.sh fix #6
- Use `ruff_python_ast::SourceLocation` for Python source location. Deleted our own Location.
- Renamed ast::Located to ast::Attributed to distinguish terms for TextSize and SourceLocation
- `ast::<Node>`s for TextSize located ast. `ast::located::<Node>` for Python source located ast.
- And also strictly renaming `located` to refer only python location related interfaces.
- `SourceLocator` to convert locations.
- New `source-code` features of to disable python locations when unnecessary.
- Also including fully merging https://github.com/astral-sh/RustPython/pull/4 closes #9
 2023-05-10 14:35:38 +09:00
Jeong YunWon 09a6afdd04 Adapt SourceLocation 2023-05-09 20:34:48 +09:00
Jeong YunWon a14e43e03a Separate byteoffset ast and located ast 2023-05-09 00:21:52 +09:00
Jeong YunWon f47dfca4e3 Rename compiler Location to TextSize 2023-05-08 03:38:10 +09:00
Micha Reiser 58c35ab458 Replace row/column based Location with byte-offsets. 2023-05-08 03:38:10 +09:00
Jeong YunWon 6d7358090b Refactor ast to hold data as seperated type 2023-05-07 19:20:47 +09:00
Jeong YunWon 39b2dbe04d Update lalrpop to 0.20.0 2023-05-06 13:48:20 +09:00
Jeong YunWon e1f70100ac Update parser/build.rs to embed python.rs 2023-05-06 05:28:30 +09:00
Micha Reiser ae9d3c3193 Add `Located::start`, `Located::end` and impl `Deref` 2023-04-26 10:24:34 -06:00
Micha Reiser 3873414b30 Use `Located::new` over struct initializer 2023-04-25 18:10:13 -06:00
Jeong YunWon 6d6155413b Update lalrpop 2023-03-25 22:18:02 +09:00