Charlie Marsh b845e81c4a Use `memchr` for computing line indexes (#21838) ... ## Summary Some benchmarks with Claude's help: | File | Size | Baseline | Optimized | Speedup | |---------------------|-------|----------------------|----------------------|---------| | numpy/globals.py | 3 KB | 1.48 µs (1.95 GiB/s) | 740 ns (3.89 GiB/s) | 2.0x | | unicode/pypinyin.py | 4 KB | 2.04 µs (2.01 GiB/s) | 1.18 µs (3.49 GiB/s) | 1.7x | | pydantic/types.py | 26 KB | 13.1 µs (1.90 GiB/s) | 5.88 µs (4.23 GiB/s) | 2.2x | | numpy/ctypeslib.py | 17 KB | 8.45 µs (1.92 GiB/s) | 3.94 µs (4.13 GiB/s) | 2.1x | | large/dataset.py | 41 KB | 21.6 µs (1.84 GiB/s) | 11.2 µs (3.55 GiB/s) | 1.9x | I think that I originally thought we _had_ to iterate character-by-character here because we needed to do the ASCII check, but the ASCII check can be vectorized by LLVM (and the "search for newlines" can be done with `memchr`).		2025-12-08 08:50:51 -05:00
..
lib.rs	Update Rust toolchain to 1.89 (#19807)	2025-08-07 18:21:50 +02:00
line_index.rs	Use `memchr` for computing line indexes (#21838)	2025-12-08 08:50:51 -05:00
line_ranges.rs	[`pyupgrade`] Do not report when a UTF-8 comment is followed by a non-UTF-8 one (`UP009`) (#14728)	2024-12-11 10:30:41 +00:00
newlines.rs	Use `#[expect(lint)]` over `#[allow(lint)]` where possible (#17822)	2025-05-03 21:20:31 +02:00