How does any textarea in my browser handle what seems to be 2 characters represented as one?
For example:
"π".length
// -> 2
More examples here: https://jsbin.com/zazexenigi/edit?js,console
How does any textarea in my browser handle what seems to be 2 characters represented as one?
For example:
"π".length
// -> 2
More examples here: https://jsbin.com/zazexenigi/edit?js,console
Javascript uses UTF-16 (source) to manage strings.
In UTF-16 there are 1,112,064 possible characters. Now, each character uses code points to be represented(*). In UTF-16 one code-point use two bytes (16 bits) to be saved. This means that with one code point you can have only 65536 different characters.
This means some characters has to be represented with two code points.
String.length() returns the number of code units in the string, not the number of characters.
MDN explains quite well the thing on the page about String.length()
This property returns the number of code units in the string. UTF-16, the string format used by JavaScript, uses a single 16-bit code unit to represent the most common characters, but needs to use two code units for less commonly-used characters, so it's possible for the value returned by length to not match the actual number of characters in the string.
(*): Actually some chars, in the range 010000 β 03FFFF and 040000 β 10FFFF can use up to 4 bytes (32 bits) per code point, but this doesn't change the answer: some chars requires more than 2 bytes to be represented, so they need more than 1 code point.
This means that some chars that need more than 16 bits have a length of 1 anyway. Like 0x03FFFF, it needs 21 bits, but it uses only one code unit in UTF-16, so its String.length is 1.
console.log(String.fromCharCode(0x03FFFF).length)
string.length
interprets code units as single characters it computes wrong results for characters outside the Basic Multilingual Plane (BMP). β
Synchromesh When a String contains actual textual data, each element is considered to be a single UTF-16 code unit.
es5.github.io β
Neotropical I believe rpadovani answered your "why" question best, but for an implementation that will get you a proper glyph count in this situation, Lodash has tacked this problem in their toArray module.
For example,
_.toArray('12πͺ').length; // --> 3
Or, if you want to knock a few arbitrary characters off a string, you manipulate and rejoin the array, like:
_.toArray("πͺtrimToEightGlyphs").splice(0,8).join(''); // --> 'πͺtrimToE'
Array.from('12πͺ').length // --> 3
. β
Cretinism console.log(Array.from("12π¨βπ©βπ§").length);
β
Weaponless I found a simple way to get the right result.
Here it is :
'πSome text with emojisπ'.match(/./gu)
It should return:
[ "π","S", "o", "m", "e", " ", "t", "e", "x", "t", " ", "w", "i", "t", "h", " ", "e", "m", "o", "j", "i", "s", "π"]
You can then apply .length
on it :
'π'.match(/./gu).length == 1
It uses a regex match : /./gu
.
matches any single character.
g
mean 'global' : it basicly allow to not stop after the first match.
u
mean 'unicode' : it allows to show characters the right way (without it π
would show up as οΏ½οΏ½
(so 2 characters))
Btw you can add m to support multi line (/./gum
)
"π©ββ€οΈβπβπ©".match(/./gu).length
outputs 8
β
Outhouse © 2022 - 2024 β McMap. All rights reserved.