|
|
Home » Developing U++ » U++ Developers corner » Choosing the best way to go full UNICODE
Re: Choosing the best way to go full UNICODE [message #48236 is a reply to message #48235] |
Thu, 08 June 2017 10:43   |
cbpporter
Messages: 1427 Registered: September 2007
|
Ultimate Contributor |
|
|
mirek wrote on Thu, 08 June 2017 11:26cbpporter wrote on Thu, 08 June 2017 10:00My priority is CodeEditor right now, but right after I do want to take care on my side of canonical decomposition too.
What do you plan?
I guess you missed my saga: http://www.ultimatepp.org/forums/index.php?t=msg&th=9945 &start=0&
I'm guessing I have about 3-4 hours more of work and I'll have a preview version done. Then I'll upload it there and include it into my daily builds and test it for a couple of weeks.
mirek wrote on Thu, 08 June 2017 11:26
Quote:
I'll gather stats like what % of characters can be decomposed and into how many characters on average to come up with an optimal scheme. For Latin languages I expect a few hundred with at most 3 characters in decomposition, with most having 2.
That is my estimate too. I even thing that 3 codepoints is so sparse, that the basic table should only store 2 (which means single base char + single combining mark) - that will allow for more dense table, and 3 codepoint characters should be handled as exception.
That's why I'm gathering data to make informed decisions. I'll get back to you with the stats.
How do you want to handle compatibility decomposition? Like: http://www.fileformat.info/info/unicode/char/0149/index.htm
My plan is to have a flag for compatibility decomposition vs normal ones, with it being off by default. I'm not sure, but I think you can exclude them all if you don't want to bother with. Unicode can be complicated.
|
|
|
 |
|
Choosing the best way to go full UNICODE
By: mirek on Sat, 27 May 2017 16:58
|
 |
|
Re: Choosing the best way to go full UNICODE
By: Zbych on Sat, 27 May 2017 20:02
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Sat, 27 May 2017 20:48
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Sat, 27 May 2017 20:51
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Mon, 29 May 2017 19:40
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Tue, 30 May 2017 11:03
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Tue, 30 May 2017 11:45
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Wed, 31 May 2017 11:00
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Wed, 31 May 2017 12:07
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Wed, 31 May 2017 12:40
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Wed, 31 May 2017 13:20
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Wed, 31 May 2017 14:41
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Wed, 31 May 2017 15:25
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Wed, 31 May 2017 15:34
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Wed, 31 May 2017 15:50
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Mon, 05 June 2017 17:51
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Tue, 06 June 2017 10:41
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Tue, 06 June 2017 13:21
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Thu, 08 June 2017 10:26
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Sun, 11 June 2017 13:57
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Mon, 12 June 2017 10:13
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Mon, 12 June 2017 10:28
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Mon, 12 June 2017 10:31
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Mon, 12 June 2017 10:57
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Mon, 12 June 2017 11:41
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Wed, 14 June 2017 12:30
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Wed, 14 June 2017 19:09
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Mon, 19 June 2017 10:03
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Mon, 19 June 2017 10:40
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Mon, 19 June 2017 10:58
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
|
 |
|
Re: Choosing the best way to go full UNICODE
By: mirek on Wed, 14 June 2017 12:17
|
Goto Forum:
Current Time: Sun Jul 06 13:22:58 CEST 2025
Total time taken to generate the page: 0.02858 seconds
|
|
|