CP1251/1253/1256 and more broken if used without --lower-case

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

CP1251/1253/1256 and more broken if used without --lower-case

Felix Hartmann-2
Hi everyone - well this is a bit of a follow up of my previous message - but after I know the problem - I guess it's better to use correct title.

I'm trying to create maps without using unicode of non latin using countries - and for many weeks I was quite uncertain why the did not work correctly.


At least if I compile maps on windows - the resulting maps seem to ignore/break --code-pages somehow except if also --lower-case is given.

Now I cannot really read/write cycrillic, arabic or hebrew - but all of these maps created without --lower-case actually seem to only write the code-page into header - but the actual name will end up being transliterated into latin1/acsii.
This seems to be completely independant of style - I've put a link list with greece as example, it's not based on default style - but with default style the exactly same thing happens.


a) https://openmtbmap.org/mtbgreece.exe (compiled without --lower-case)
b) https://openmtbmap.org/mtbgreece_lc.exe (exactly the same but compiled adding --lower-case)
c) http://ftp5.gwdg.de/pub/misc/openstreetmap/openmtbmap/odbl/mtbgreece.exe (without --lower-case but using codepage=65001 / unicode)
(linux users - you can simply unpack the .exe - it's lzma packed, note for windows user - the registry entry created by each installer is identical - you can install to different folders though to check the maps - in Basecamp/Mapsource only one will be visible)

Now a) will actually display in Cyrillic on some computers (e.g. windows 2007, windows server 2008) however not on windows 10 (for Basecamp, Mapsource or GPSMapedit). However the labels clearly are not really correct. Sometimes there are placeholder, sometimes simply wrong. I rechecked that b) is correct by also compiling a unicode version and checking the labels. 


Working Codepages without lower-case: Chinese, Japanese... (not based on any alphabet), latin1, 65001
Broken Codepages without lower-case: Russian, Cyrillic, Hebrew, Arabic,....


Just for reference - here is the command I gave for compiling (note style does not matter, I verified with default style) -- add or take --lower-case:

start /low /b /wait java -jar -XX:StringTableSize=100003 -Xms6000M -Xmx13300M C:\openmtbmap\mkgmap.jar --max-jobs=8 "--generate-sea" --code-page="1253" "--precomp-sea=C:\openmtbmap\maps\sea.zip" --nsis --index --levels="0:24, 1:23, 2:22, 3:21, 4:20, 5:19, 6:18" --overview-levels="7:17, 8:16, 9:15, 10:14, 11:13, 12:12" --add-pois-to-areas --pois-to-areas-placement=entrance=main;entrance=yes;building=entrance;barrier=entrance --reduce-point-density=3.4 --reduce-point-density-polygon=6 --cycle-map --ignore-fixme-values --housenumbers --link-pois-to-ways --ignore-turn-restrictions --polygon-size-limits="24:16, 23:14, 22:12, 21:11, 20:10, 19:9, 18:8, 17:7, 16:6, 15:5, 14:4, 13:3, 12:2, 11:0, 10:0" --description=openmtbmap_gr --show-profiles=1  --location-autofill=bounds,is_in,nearest  --bounds=C:\openmtbmap\maps\bounds.zip --route --country-abbr=gr --country-name=greece --mapname=63950000 --family-id=6395 --product-id=1 --series-name=openmtbmap_greece_27.06.2017_NU --family-name=mtbmap_gr_26.06.2017_NU --tdbfile --overview-mapname=mapsetc --keep-going --area-name="greece_27.06.2017_NU_openmtbmap.org" -c E:\openmtbmap\maps\template.greece



--
Felix Hartman - Openmtbmap.org & VeloMap.org
Schusterbergweg 32/8
6020 Innsbruck
Austria - Österreich

_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: CP1251/1253/1256 and more broken if used without --lower-case

popej
Hi Felix,

I have checked map a) on Windows 10 and I can't find problems in
Mapsource or BaseCamp. Could you try to change fonts in
MapSource/BaseCamp options?

--
Best regards,
Andrzej
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: CP1251/1253/1256 and more broken if used without --lower-case

Felix Hartmann-2
Okay - so I'm simply too stupid to read cycrillic, hebrew and arabic I guess. So Mapsource/Basecamp/GPSMapedit simply put Unicode maps like --lower-case (first letter capital, then lower case), but non unicode maps are all in caps?

Screenshot of a): 

Screenshot of c) or b):

Essentially however both are the same - just once lower case and once not.

On 27 June 2017 at 16:40, Andrzej Popowski <[hidden email]> wrote:
Hi Felix,

I have checked map a) on Windows 10 and I can't find problems in Mapsource or BaseCamp. Could you try to change fonts in MapSource/BaseCamp options?

--
Best regards,
Andrzej
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev



--
Felix Hartman - Openmtbmap.org & VeloMap.org
Schusterbergweg 32/8
6020 Innsbruck
Austria - Österreich

_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: CP1251/1253/1256 and more broken if used without --lower-case

popej
Hi Felix,

 > So Mapsource/Basecamp/GPSMapedit simply put Unicode maps like
 > --lower-case (first letter capital, then lower case), but non unicode
 > maps are all in caps?

I guess this conversion to first capital and then lower case works only
for some code pages. I see the same problem for CP1252 (Eastern Europe)
in MapSource/Basecamp. But in Dakota labels are converted.

--
Best regards,
Andrzej


_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: CP1251/1253/1256 and more broken if used without --lower-case

Felix Hartmann-2
yeah - and on Windows 7 this seems to be different - hence I got really confused (plus greek in capitals looking a lot like a bad latin transliteration). However cgpsmapper maps seem to always end up first capital, then lower case. So somehow I guess there is a hint in the maps too. Maybe there is some place in the mkgmap codepages that sets this?

On 27 June 2017 at 22:41, Andrzej Popowski <[hidden email]> wrote:
Hi Felix,

> So Mapsource/Basecamp/GPSMapedit simply put Unicode maps like
> --lower-case (first letter capital, then lower case), but non unicode
> maps are all in caps?

I guess this conversion to first capital and then lower case works only for some code pages. I see the same problem for CP1252 (Eastern Europe) in MapSource/Basecamp. But in Dakota labels are converted.


--
Best regards,
Andrzej


_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev



--
Felix Hartman - Openmtbmap.org & VeloMap.org
Schusterbergweg 32/8
6020 Innsbruck
Austria - Österreich

_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: CP1251/1253/1256 and more broken if used without --lower-case

popej
Hi Felix,

I have mistaken code page, Eastern Europe is 1250. There is no
conversion to first upper-case then lower for maps with CP1250
regardless of compiler - the same problem for mkgmap and cgpsmapper.

--
Best regards,
Andrzej
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: CP1251/1253/1256 and more broken if used without --lower-case

Gerd Petermann
Hi,

if I got this right this problem is probably not caused by an error in mkgmap, right?

Gerd

________________________________________
Von: mkgmap-dev <[hidden email]> im Auftrag von Andrzej Popowski <[hidden email]>
Gesendet: Mittwoch, 28. Juni 2017 20:06:40
An: [hidden email]
Betreff: Re: [mkgmap-dev] CP1251/1253/1256 and more broken if used without --lower-case

Hi Felix,

I have mistaken code page, Eastern Europe is 1250. There is no
conversion to first upper-case then lower for maps with CP1250
regardless of compiler - the same problem for mkgmap and cgpsmapper.

--
Best regards,
Andrzej
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: CP1251/1253/1256 and more broken if used without --lower-case

Felix Hartmann-2
most likely not - it's just strange that some cgpsmapper maps appear completely in lower-case (first letter capital) - same behaviour as e.g. latin1 - while most mkgmap created non latin1 maps are fully in caps without --lower-case option. The code page is correct however. This is independant of Mapsource/Basecamp/GPSMapedit - however on Windows 7 it seems to be fine. On devices itself it also seems to be fine.

Is there a list anywhere which devices are compatible/not compatible with --lower-case? Maybe this note about incompatibility is really really dated?

On 25 July 2017 at 08:07, Gerd Petermann <[hidden email]> wrote:
Hi,

if I got this right this problem is probably not caused by an error in mkgmap, right?

Gerd

________________________________________
Von: mkgmap-dev <[hidden email]> im Auftrag von Andrzej Popowski <[hidden email]>
Gesendet: Mittwoch, 28. Juni 2017 20:06:40
An: [hidden email]
Betreff: Re: [mkgmap-dev] CP1251/1253/1256 and more broken if used without --lower-case

Hi Felix,

I have mistaken code page, Eastern Europe is 1250. There is no
conversion to first upper-case then lower for maps with CP1250
regardless of compiler - the same problem for mkgmap and cgpsmapper.

--
Best regards,
Andrzej
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev



--
Felix Hartman - Openmtbmap.org & VeloMap.org
Schusterbergweg 32/8
6020 Innsbruck
Austria - Österreich

_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev