From e154efa229f2474e3ab333e328cf2aac623baec4 Mon Sep 17 00:00:00 2001 From: Andrew Gallant Date: Wed, 3 Dec 2025 15:26:30 -0500 Subject: [PATCH] [ty] Update evaluation results These are all improvements here with one slight regression on `reveal_type` ranking. The previous completions offered were: ``` $ cargo r -q -p ty_completion_eval show-one ty-extensions-lower-stdlib ENOTRECOVERABLE (module: errno) REG_WHOLE_HIVE_VOLATILE (module: winreg) SQLITE_NOTICE_RECOVER_WAL (module: _sqlite3) SupportsGetItemViewable (module: _typeshed) removeHandler (module: unittest.signals) reveal_mro (module: ty_extensions) reveal_protocol_interface (module: ty_extensions) reveal_type (module: typing) (*, 8/10) _remove_original_values (module: _osx_support) _remove_universal_flags (module: _osx_support) ----- found 10 completions ``` And now they are: ``` $ cargo r -q -p ty_completion_eval show-one ty-extensions-lower-stdlib ENOTRECOVERABLE (module: errno) REG_WHOLE_HIVE_VOLATILE (module: winreg) SQLITE_NOTICE_RECOVER_WAL (module: sqlite3) SQLITE_NOTICE_RECOVER_WAL (module: sqlite3.dbapi2) removeHandler (module: unittest) removeHandler (module: unittest.signals) reveal_mro (module: ty_extensions) reveal_protocol_interface (module: ty_extensions) reveal_type (module: typing) (*, 9/9) ----- found 9 completions ``` Some completions were removed (because they are now considered unexported) and some were added (likely do to better re-export support). This particular case probably warrants more special attention anyway. So I think this is fine. (It's only a one-ranking regression.) --- crates/ty_completion_eval/completion-evaluation-tasks.csv | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/crates/ty_completion_eval/completion-evaluation-tasks.csv b/crates/ty_completion_eval/completion-evaluation-tasks.csv index f8347cb8e5..a196fb98e4 100644 --- a/crates/ty_completion_eval/completion-evaluation-tasks.csv +++ b/crates/ty_completion_eval/completion-evaluation-tasks.csv @@ -11,9 +11,9 @@ import-deprioritizes-type_check_only,main.py,2,1 import-deprioritizes-type_check_only,main.py,3,2 import-deprioritizes-type_check_only,main.py,4,3 import-keyword-completion,main.py,0,1 -internal-typeshed-hidden,main.py,0,4 +internal-typeshed-hidden,main.py,0,2 none-completion,main.py,0,2 -numpy-array,main.py,0, +numpy-array,main.py,0,159 numpy-array,main.py,1,1 object-attr-instance-methods,main.py,0,1 object-attr-instance-methods,main.py,1,1 @@ -23,6 +23,6 @@ scope-existing-over-new-import,main.py,0,1 scope-prioritize-closer,main.py,0,2 scope-simple-long-identifier,main.py,0,1 tstring-completions,main.py,0,1 -ty-extensions-lower-stdlib,main.py,0,8 +ty-extensions-lower-stdlib,main.py,0,9 type-var-typing-over-ast,main.py,0,3 -type-var-typing-over-ast,main.py,1,275 +type-var-typing-over-ast,main.py,1,239