Akinobu Mita f43804bf5f
string: memchr_inv() speed improvements ...
- Generate a 64-bit pattern more efficiently
memchr_inv needs to generate a 64-bit pattern filled with a target
character. The operation can be done by more efficient way.
- Don't call the slow check_bytes() if the memory area is 64-bit aligned
memchr_inv compares contiguous 64-bit words with the 64-bit pattern as
much as possible. The outside of the region is checked by check_bytes()
that scans for each byte. Unfortunately, the first 64-bit word is
unexpectedly scanned by check_bytes() even if the memory area is aligned
to a 64-bit boundary.
Both changes were originally suggested by Eric Dumazet.
Signed-off-by: Akinobu Mita <akinobu.mita@gmail.com >
Suggested-by: Eric Dumazet <eric.dumazet@gmail.com >
Cc: Brian Norris <computersforpeace@gmail.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org >
2012-03-23 16:58:35 -07:00
2010-01-11 09:34:04 -08:00
2012-02-02 10:34:25 +11:00
2011-10-31 19:31:19 -04:00
2011-09-21 13:39:59 -07:00
2011-03-22 17:44:17 -07:00
2010-03-12 15:52:44 -08:00
2009-12-15 08:53:32 -08:00
2011-07-26 16:49:47 -07:00
2011-09-14 13:14:11 +02:00
2011-05-04 14:41:28 -04:00
2010-12-06 15:58:43 -05:00
2011-03-11 14:25:50 +00:00
2011-10-31 17:30:56 -07:00
2011-05-19 16:55:27 +09:30
2012-01-10 16:30:49 -08:00
2012-01-26 21:28:45 +01:00
2011-07-07 04:52:24 -07:00
2012-02-02 10:34:23 +11:00
2011-10-29 21:20:22 +02:00
2011-01-24 14:51:56 -08:00
2010-05-27 09:12:48 -07:00
2011-07-26 16:49:44 -07:00
2011-06-03 15:01:06 -04:00
2012-01-10 16:30:51 -08:00
2009-12-15 08:53:32 -08:00
2010-11-29 15:18:28 -08:00
2012-03-05 15:49:43 -08:00
2011-07-26 16:49:47 -07:00
2011-12-06 10:00:05 +01:00
2011-01-13 08:03:25 -08:00
2011-12-06 09:53:40 +01:00
2012-01-12 20:13:13 -08:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:25 -08:00
2012-01-11 18:50:26 -08:00
2012-02-02 00:24:04 +11:00
2010-10-26 16:52:19 -07:00
2012-01-24 16:00:35 -08:00
2012-01-24 12:50:36 -08:00
2012-03-11 19:59:43 -07:00
2009-06-12 21:47:04 +09:30
2012-01-03 22:54:56 -05:00
2011-05-26 17:12:38 -07:00
2011-05-26 17:12:38 -07:00
2011-05-26 17:12:33 -07:00
2009-06-18 13:04:05 -07:00
2010-05-25 08:07:06 -07:00
2011-08-03 11:15:57 -04:00
2011-09-20 23:24:44 -04:00
2010-04-06 15:52:11 -07:00
2012-03-21 17:55:01 -07:00
2010-08-12 09:51:35 -07:00
2011-11-28 21:12:42 +02:00
2010-08-09 20:45:05 -07:00
2011-01-12 03:06:19 -05:00
2009-07-17 09:11:31 +10:00
2010-03-30 22:02:32 +09:00
2012-02-07 14:32:24 -08:00
2012-03-23 16:58:31 -07:00
2010-05-20 21:04:26 -05:00
2009-07-01 22:28:44 +02:00
2012-03-08 12:56:40 -08:00
2011-12-21 15:13:54 -08:00
2012-02-09 10:09:30 -08:00
2011-10-31 17:30:56 -07:00
2011-07-25 20:57:15 -07:00
2011-02-18 11:32:28 -08:00
2010-10-26 16:52:19 -07:00
2011-10-04 12:44:03 +02:00
2011-05-26 09:42:19 -07:00
2011-05-25 08:39:52 -07:00
2012-02-02 10:34:23 +11:00
2011-08-06 18:32:45 -07:00
2011-11-04 17:47:34 -04:00
2011-03-31 11:26:23 -03:00
2012-01-31 23:19:47 +02:00
2011-10-31 17:30:56 -07:00
2011-07-08 14:02:53 +02:00
2011-09-13 11:11:50 +02:00
2012-01-12 20:13:12 -08:00
2010-06-16 18:08:13 +02:00
2011-09-13 11:11:54 +02:00
2010-01-11 09:34:05 -08:00
2011-01-28 12:16:59 +10:00
2011-12-08 19:52:43 -05:00
2011-09-13 11:11:59 +02:00
2011-09-13 11:11:59 +02:00
2012-03-20 21:48:27 +08:00
2011-09-13 16:09:41 -07:00
2011-05-25 08:39:03 -07:00
2011-10-06 12:46:56 +02:00
2011-10-31 17:30:56 -07:00
2012-03-23 16:58:35 -07:00
2012-03-20 21:48:27 +08:00
2011-04-14 16:06:54 -07:00
2011-01-24 23:33:30 -08:00
2011-03-31 11:26:23 -03:00
2010-05-19 22:40:47 -04:00
2012-03-06 08:22:26 -08:00
f43804bf5f