Convert accented text into ASCII characters?

Question

I would like to convert accented letters and various encodings into the plain English ASCII one in Javascript and wonder what are the possible options. What I need is that:

éclair ~becomes~ eclair

bär ~becomes~ bar

привет ~becomes~ privet

こんにちは ~becomes~ konnichiva

As you can see the idea is that any language gets converted into the plain English ASCII equivalent. The áčçéñtèd letters are converted into their plain equivalents, letters in cyrillic or japanese encoding are converted into into their transliterated equivalent.

Anyone knows an approach to do that in Javascript?

Tarrant

related: #991404 – Tincher

Answer 1

There are a number of Node modules that do similar things but are much lighter-weight than node-iconv, and in particular, are in all JS and don't require you to compile any C or C++:

1. node-unidecode appears to do mostly what you asked for:

   $ npm install unidecode
   ...
   [email protected] node_modules/unidecode
   $ node
   > var unidecode = require('unidecode');
   undefined
   > unidecode('éclair')
   'eclair'
   > unidecode('bär')
   'bar'
   > unidecode('привет')
   'priviet'
   > unidecode('こんにちは')
   'konnitiha'
   

2. node-transliterator is even lighter-weight, but behaves even further from what you asked for:

   $ npm install transliterator
   ...
   [email protected] node_modules/transliterator
   $ node
   > var transliterator = require('transliterator');
   undefined
   > transliterator('éclair')
   'eclair'
   > transliterator('bär')
   'baer'
   > transliterator('привет')
   ''
   > transliterator('こんにちは')
   ''
   

3. node-urlify is slightly closer but also way further from what you asked for:

   $ npm install urlify
   ...
   [email protected] node_modules/urlify
   $ node
   > var urlify = require('urlify').create({ spaces: ' ' });
   undefined
   > urlify('éclair')
   'eclair'
   > urlify('bär')
   'bar'
   > urlify('привет')
   'privet'
   > urlify('こんにちは')
   '_____'
   

4. Finally, limax is more heavyweight, when I did npm install limax it printed lots of C compiler warnings, but it still just worked and is the closest to what you asked for:

   $ npm install limax
   ...
   [email protected] node_modules/limax
   ├── [email protected]
   ├── [email protected]
   ├── [email protected] ([email protected])
   └── [email protected]
   $ node
   > var slug = require('limax')
   undefined
   > slug('éclair')
   'eclair'
   > slug('bär')
   'baer'
   > slug('привет')
   'privet'
   > slug('こんにちは')
   'konnichiha'
   

Exhibitionism

Thanks man, googling node js diacritics gives the inferior libraries with their incomplete list of diacritics; node-unidecode is so much better. – Lobe

Answer 2

Checkout node-iconv.

Looks like node equivalent of php iconv.

Tarp

Please mark your question as "answered" if it helped you to solve your problem. – Omentum

Answer 3

Author here. You may try the transliteration module. It can be run in both browser and node.js and with no dependencies

Pyrogenic