To help you get started, we've collected the most common ways that utf8 is being used within popular public projects.

ooooevan / Vmail / src / renderer / common / javascript / parseEmail.js View on Github

}
        const contentType = text.match(contentTypeReg)[1].trim()
        const charset = (text.match(secondChartsetReg) || text.match(charsetReg))[1].trim().replace(/"/g, '')
        const transferEncoding = text.match(contentTransferEncodingReg)[1].trim()
        const subTextArr = text.split(blankLineReg)
        subTextArr.shift()
        const contentText = subTextArr.filter(item => (item.trim())).join('')
        if (contentType.match(htmlTypeReg)) {
          if (transferEncoding === 'base64') {
            const buff = Buffer.from(contentText, transferEncoding)
            result.bodyHtml = iconv.decode(buff, charset || 'utf-8')
          } else if (transferEncoding === 'quoted-printable') {
            // 用try包裹是因为发现有邮件写着quoted-printable编码，正文却没有编码。quotedPrintable模块decode没有编码的内容就报错，进入catch
            try {
              // 编码为quoted-printable且charset为utf8。暂时遇到为utf8的,未看到其他字符集
              const quotedHtml = utf8.decode(quotedPrintable.decode(contentText))
              result.bodyHtml = quotedHtml
            } catch (e) {
              result.bodyHtml = contentText
            }
          } else {
            result.bodyHtml = contentText
          }
        } else if (contentType.match(plainTypeReg)) {
          if (transferEncoding === 'base64') {
            const buff = Buffer.from(contentText, transferEncoding)
            result.bodyText += iconv.decode(buff, charset || 'utf-8')
          } else {
            try {
              // 编码为quoted-printable且charset为utf8。其他字符集用quotedPrintable会报错，进入catch
              const quotedText = utf8.decode(quotedPrintable.decode(contentText))
              result.bodyText += quotedText

View more ways to use utf8

utf8.js

utf8.js is a well-tested UTF-8 encoder/decoder written in JavaScript. Unlike many other JavaScript solutions, it is designed to be a proper UTF-8 encoder/decoder: it can encode/decode any scalar Unicode code point values, as per the Encoding Standard. Here’s an online demo.

Feel free to fork if you see possible improvements!

Installation

Via npm:

npm install utf8

In a browser:

In Node.js:

const utf8 = require('utf8');

API

utf8.encode(string)

Encodes any given JavaScript string (string) as UTF-8, and returns the UTF-8-encoded version of the string. It throws an error if the input string contains a non-scalar value, i.e. a lone surrogate. (If you need to be able to encode non-scalar values as well, use WTF-8 instead.)

// U+00A9 COPYRIGHT SIGN; see https://codepoints.net/U+00A9
utf8.encode('\xA9');
// → '\xC2\xA9'
// U+10001 LINEAR B SYLLABLE B038 E; see https://codepoints.net/U+10001
utf8.encode('\uD800\uDC01');
// → '\xF0\x90\x80\x81'

utf8.decode(byteString)

Decodes any given UTF-8-encoded string (byteString) as UTF-8, and returns the UTF-8-decoded version of the string. It throws an error when malformed UTF-8 is detected. (If you need to be able to decode encoded non-scalar values as well, use WTF-8 instead.)

utf8.decode('\xC2\xA9');
// → '\xA9'

utf8.decode('\xF0\x90\x80\x81');
// → '\uD800\uDC01'
// → U+10001 LINEAR B SYLLABLE B038 E

utf8.version

A string representing the semantic version number.

Support

utf8.js has been tested in at least Chrome 27-39, Firefox 3-34, Safari 4-8, Opera 10-28, IE 6-11, Node.js v0.10.0, Narwhal 0.3.2, RingoJS 0.8-0.11, PhantomJS 1.9.0, and Rhino 1.7RC4.

Unit tests & code coverage

After cloning this repository, run npm install to install the dependencies needed for development and testing. You may want to install Istanbul globally using npm install istanbul -g.

Once that’s done, you can run the unit tests in Node using npm test or node tests/tests.js. To run the tests in Rhino, Ringo, Narwhal, PhantomJS, and web browsers as well, use grunt test.

To generate the code coverage report, use grunt cover.

FAQ

Why is the first release named v2.0.0? Haven’t you heard of semantic versioning?

Long before utf8.js was created, the utf8 module on npm was registered and used by another (slightly buggy) library. @ryanmcgrath was kind enough to give me access to the utf8 package on npm when I told him about utf8.js. Since there has already been a v1.0.0 release of the old library, and to avoid breaking backwards compatibility with projects that rely on the utf8 npm package, I decided the tag the first release of utf8.js as v2.0.0 and take it from there.

Author

Mathias Bynens

License

utf8.js is available under the MIT license.