Unicode sample text file for testing for Unicode related problems? [closed]

Question

I am looking for a sample text unicode file (UTF-8) that can be used for testing different problems related with text encoding and decoding including:

• low ascii character usage, like first 32 codes
• characters outside BMP
• NFC related issues
• XML encoding/decoding issues

Mainly I want to copy the text into clipboard, paste it in an HTML text-area of the application, and be able to retrieve it from a page after.

This would enable to identify different Unicode related problems that could occur at decoding, encoding or even database level.

Ardie

Canonical representation: comparison of equal but different strings: "û" = u-circumflex or "û" = letter-u + combining-diacritical-circumflex. XML 1.1 with special chars in tags. – Ashelman

At this moment I need to provide a test file for some guys so they test that what you paste will reach the database and later your browser too, so Unicode comparisons are outside the scope of the question. – Ardie

Answer 1

This page has been used to test web browsers, with texts in several scripts: https://www.kermitproject.org/utf8.html

The Gothic entry for "I can eat glass" in particular is outside of BMP: 𐌼𐌰𐌲 𐌲𐌻𐌴𐍃 𐌹̈𐍄𐌰𐌽, 𐌽𐌹 𐌼𐌹𐍃 𐍅𐌿 𐌽𐌳𐌰𐌽 𐌱𐍂𐌹𐌲𐌲𐌹𐌸.

Normalization forms and XML processing are usually not problematic when moving data around, so there are no common samples that test those two in particular.

Battleship