Python
/
ruff
mirror of https://github.com/astral-sh/ruff
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

[ty] Update evaluation results 

These are all improvements here with one slight regression on
`reveal_type` ranking. The previous completions offered were:

```
$ cargo r -q -p ty_completion_eval show-one ty-extensions-lower-stdlib
ENOTRECOVERABLE (module: errno)
REG_WHOLE_HIVE_VOLATILE (module: winreg)
SQLITE_NOTICE_RECOVER_WAL (module: _sqlite3)
SupportsGetItemViewable (module: _typeshed)
removeHandler (module: unittest.signals)
reveal_mro (module: ty_extensions)
reveal_protocol_interface (module: ty_extensions)
reveal_type (module: typing) (*, 8/10)
_remove_original_values (module: _osx_support)
_remove_universal_flags (module: _osx_support)
-----
found 10 completions
```

And now they are:

```
$ cargo r -q -p ty_completion_eval show-one ty-extensions-lower-stdlib
ENOTRECOVERABLE (module: errno)
REG_WHOLE_HIVE_VOLATILE (module: winreg)
SQLITE_NOTICE_RECOVER_WAL (module: sqlite3)
SQLITE_NOTICE_RECOVER_WAL (module: sqlite3.dbapi2)
removeHandler (module: unittest)
removeHandler (module: unittest.signals)
reveal_mro (module: ty_extensions)
reveal_protocol_interface (module: ty_extensions)
reveal_type (module: typing) (*, 9/9)
-----
found 9 completions
```

Some completions were removed (because they are now considered
unexported) and some were added (likely do to better re-export support).

This particular case probably warrants more special attention anyway.
So I think this is fine. (It's only a one-ranking regression.)
This commit is contained in:
Andrew Gallant 2025-12-03 15:26:30 -05:00 committed by Andrew Gallant
parent 32f400a457
commit e154efa229
1 changed files with 4 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
crates/ty_completion_eval/completion-evaluation-tasks.csv
View File

@ -11,9 +11,9 @@ import-deprioritizes-type_check_only,main.py,2,1
import-deprioritizes-type_check_only,main.py,3,2 import-deprioritizes-type_check_only,main.py,3,2
import-deprioritizes-type_check_only,main.py,4,3 import-deprioritizes-type_check_only,main.py,4,3
import-keyword-completion,main.py,0,1 import-keyword-completion,main.py,0,1
internal-typeshed-hidden,main.py,0,4 internal-typeshed-hidden,main.py,0,2
none-completion,main.py,0,2 none-completion,main.py,0,2
numpy-array,main.py,0, numpy-array,main.py,0,159
numpy-array,main.py,1,1 numpy-array,main.py,1,1
object-attr-instance-methods,main.py,0,1 object-attr-instance-methods,main.py,0,1
object-attr-instance-methods,main.py,1,1 object-attr-instance-methods,main.py,1,1
@ -23,6 +23,6 @@ scope-existing-over-new-import,main.py,0,1
scope-prioritize-closer,main.py,0,2 scope-prioritize-closer,main.py,0,2
scope-simple-long-identifier,main.py,0,1 scope-simple-long-identifier,main.py,0,1
tstring-completions,main.py,0,1 tstring-completions,main.py,0,1
ty-extensions-lower-stdlib,main.py,0,8 ty-extensions-lower-stdlib,main.py,0,9
type-var-typing-over-ast,main.py,0,3 type-var-typing-over-ast,main.py,0,3
type-var-typing-over-ast,main.py,1,275 type-var-typing-over-ast,main.py,1,239

1 name file index rank
11 import-deprioritizes-type_check_only main.py 3 2
12 import-deprioritizes-type_check_only main.py 4 3
13 import-keyword-completion main.py 0 1
14 internal-typeshed-hidden main.py 0 4 2
15 none-completion main.py 0 2
16 numpy-array main.py 0 159
17 numpy-array main.py 1 1
18 object-attr-instance-methods main.py 0 1
19 object-attr-instance-methods main.py 1 1
23 scope-prioritize-closer main.py 0 2
24 scope-simple-long-identifier main.py 0 1
25 tstring-completions main.py 0 1
26 ty-extensions-lower-stdlib main.py 0 8 9
27 type-var-typing-over-ast main.py 0 3
28 type-var-typing-over-ast main.py 1 275 239