Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

classic Classic list List threaded Threaded
26 messages Options
12
Reply | Threaded
Open this post in threaded view
|

Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Felix Hartmann-2
Well two days ago someone told me, that if he puts my map onto his GPS it's not booting anymore (or bootlooping after trying to load maps).

The really strange thing is, I cannot find out at all why this happens. If I only transfer half of the map, it is not bootlooping, if I transfer the other half, not bootlooping. If I transfer both halves as separate gmapsupp.img files, still okay. However if I transfer the map as one full gmapsupp.img - then neither Oregon 550 (newest beta firmware) nor etrex 30 (several firmwares tried) doesn't start anymore.
It does not matter if I create the gmapsupp.img with Mapsource, Mapinstall/Basecamp or mkgmap. It does not matter if I create --index with mkgmap on sending it.
And it's not about the integrated contourlines (7*.img) -- exclude them, same problem.

So here is the file for testing (do not install it on internal memory, else your GPS device may be ready forĀ  sending it in to Garmin).
ftp://ftp5.gwdg.de/pub/misc/openstreetmap/openmtbmap/mtbfrance_broke.exe
(note simply unpack this installer with 7zip-full on Linux - its lzma packed).

Note, old GPS devices like Vista HCx cope fine with this map.

I more or less give up trying to find the fault. However as this is the first time since a very long time, mkgmap created maps can potentially break a Garmin GPS - I post it to the list without knowing a way to figure the problem out.
It has nothing to do with my style either I would suppose, only map for me where this happens.

_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Steve Ratcliffe
Hi

> So here is the file for testing (do not install it on internal memory,
> else your GPS device may be ready for  sending it in to Garmin).
> _*/ftp://ftp5.gwdg.de/pub/misc/openstreetmap/openmtbmap/mtbfrance_broke.exe/*_
> (note simply unpack this installer with 7zip-full on Linux - its lzma
> packed).

Well I've downloaded it, although I don't know if I will be able to do
anything with it since I don't have an Oregon or new Etrex, so may not
be able to reproduce. In fact I don't even have a large enough microSD
card...

Just to be clear if I do:

   mkgmap --latin1 --gmapsupp 6391*.img

then that will produce a map that doesn't work?

..Steve
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Felix Hartmann-2
well I used:
mkgmap.jar --family-id=6391 --description="some_name"
--series-name="some_name" --family-name="some_name" --product-id=1
--gmapsupp 6391*.img clas*.TYP

and that puts the GPS into bootloop. (Oregon and etrex 30...).
(I don't think the .TYP-file can be in any way responsible, as it works
on all other maps without probs, and also small extracts..  - nor the
other options).
As told, my old Vista HCx copes fine with the map.

On 23.02.2012 15:40, Steve Ratcliffe wrote:

> Hi
>
>> So here is the file for testing (do not install it on internal memory,
>> else your GPS device may be ready for  sending it in to Garmin).
>> _*/ftp://ftp5.gwdg.de/pub/misc/openstreetmap/openmtbmap/mtbfrance_broke.exe/*_
>> (note simply unpack this installer with 7zip-full on Linux - its lzma
>> packed).
> Well I've downloaded it, although I don't know if I will be able to do
> anything with it since I don't have an Oregon or new Etrex, so may not
> be able to reproduce. In fact I don't even have a large enough microSD
> card...
>
> Just to be clear if I do:
>
>     mkgmap --latin1 --gmapsupp 6391*.img
>
> then that will produce a map that doesn't work?
>
> ..Steve
> _______________________________________________
> mkgmap-dev mailing list
> [hidden email]
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

ligfietser
Felix,
Someone on the Dutch forum.gps.nl reported that this is caused by a corrupt tile
(either Corsica or the Bay of Biscay) in your Velomap/Openmtbmap.
When he left it out there were no problems anymore on his Etrex 30.
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Felix Hartmann-2

That's not possible because also with new map data it's still broken and if I use halve of the tiles it's okay and also other halve is okay -- there must be some structruralĀ  problem - though maybe some tile together with a second is responsible - can you provide a link to the topic?

On Feb 23, 2012 7:13 PM, "Minko" <[hidden email]> wrote:
Felix,
Someone on the Dutch forum.gps.nl reported that this is caused by a corrupt tile
(either Corsica or the Bay of Biscay) in your Velomap/Openmtbmap.
When he left it out there were no problems anymore on his Etrex 30.

_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Steve Ratcliffe
On 23/02/12 19:23, Felix Hartmann wrote:
> That's not possible because also with new map data it's still broken and
> if I use halve of the tiles it's okay and also other halve is okay --
> there must be some structrural  problem - though maybe some tile

It might be that removing any tile allows it to work.

I guess that the thread is: http://forum.gps.nl/viewtopic.php?f=75&t=36983

..Steve
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

ligfietser
Yes, that's the thread, Jaap van Maanen wrote he has got no problem anymore if he deselected the Bay of Biscay tile.


Steve wrote:
It might be that removing any tile allows it to work.
I guess that the thread is: http://forum.gps.nl/viewtopic.php?f=75&t=36983
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Steve Ratcliffe
On 23/02/12 20:32, Minko wrote:
> Yes, that's the thread, Jaap van Maanen wrote he has got no problem anymore if he deselected the Bay of Biscay tile.
>

It wasn't clear which tile he meant as there are two that it could be.
Or if he meant both as the last message seems to suggest it is both as
it uses the word deselects in the plural (via google translate).

There is mention of an attachment, but I don't see anything.

..Steve
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

ligfietser
Thats google's awful translation by Google ;-)

He wrote that he had deselected the Bay of Biskay
when sending the tiles with Mapsource.
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Steve Ratcliffe
On 23/02/12 20:54, Minko wrote:
> Thats google's awful translation by Google ;-)
>
> He wrote that he had deselected the Bay of Biskay
> when sending the tiles with Mapsource.

OK, but there are two tiles 63910019 63910035 both of which
are almost empty and are both located in the bay of biscay.

..Steve
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

ligfietser
On a Dakota 20 I can confirm this behaviour.
If I leave only tile 63910019 out of it, it still won't boot up.
I did not try it without tile 63910035.
With a smaller mapset with 63910019 and 63910035 and a few others, no problems.
Also tried to leave out two other tiles in the north, but then it still won't boot.
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Felix Hartmann-2
I just tried - I left out the two main tiles of the Bay of Biscay, and
it booted (and to confirm I created the gmapsupp.img with both mkgmap
with and without address search, and also Mapsource). Leaving out either
of the two tiles,
So leaves us to wonder, why is it not booting with them.

The main thing inside those two tiles, is the ferry line, go straight
across. Is it possible, that we have to use shorter staight lines? Where
could I patch mkgmap to split up straight lines say 5x as often?
The other thing could be - that there must be at least one city POI in
each tile (or at least any?? POI in each tile) - as both tiles don't
have any city. And only one of the two tiles has a POI at all.

I'll also try what happens if I create the map with default style-file.
But I think it will crash the gps device too.
BTW -- I split france from geofabrik with max-nodes=1200000 and
maxnodes=1300000 and both results in the same problem.

Or do we have to make sure, that mkgmap never creates such empty tiles?

On 23.02.2012 23:44, Minko wrote:
> On a Dakota 20 I can confirm this behaviour.
> If I leave only tile 63910019 out of it, it still won't boot up.
> I did not try it without tile 63910035.
> With a smaller mapset with 63910019 and 63910035 and a few others, no problems.
> Also tried to leave out two other tiles in the north, but then it still won't boot.
> _______________________________________________
> mkgmap-dev mailing list
> [hidden email]
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Felix Hartmann-2
Bang, I think that's it. I now managed to sent a map including the bay
of biscay (one tile), and looked if the other really small tiles
included cities/islands. Found one that didn't, left it out and the GPS
booted.

IMHO (I'll try to simply include a city POI into the tiles of biscay) -
we would need to make sure, that each tile has a city or island
(0x650c)! Maybe that could be related to how the search function is
organised? Loading maps the GPS usually tries to set up the POI index
internally. Maybe that's why it crashes. Too few/no cities or no POI at
all, and bang.

My next try will be to simply include city POIs with gpsmapedit into
each tile of the gulf of biscay, and recompile...

On 24.02.2012 10:04, Felix Hartmann wrote:

> I just tried - I left out the two main tiles of the Bay of Biscay, and
> it booted (and to confirm I created the gmapsupp.img with both mkgmap
> with and without address search, and also Mapsource). Leaving out
> either of the two tiles,
> So leaves us to wonder, why is it not booting with them.
>
> The main thing inside those two tiles, is the ferry line, go straight
> across. Is it possible, that we have to use shorter staight lines?
> Where could I patch mkgmap to split up straight lines say 5x as often?
> The other thing could be - that there must be at least one city POI in
> each tile (or at least any?? POI in each tile) - as both tiles don't
> have any city. And only one of the two tiles has a POI at all.
>
> I'll also try what happens if I create the map with default
> style-file. But I think it will crash the gps device too.
> BTW -- I split france from geofabrik with max-nodes=1200000 and
> maxnodes=1300000 and both results in the same problem.
>
> Or do we have to make sure, that mkgmap never creates such empty tiles?
>
> On 23.02.2012 23:44, Minko wrote:
>> On a Dakota 20 I can confirm this behaviour.
>> If I leave only tile 63910019 out of it, it still won't boot up.
>> I did not try it without tile 63910035.
>> With a smaller mapset with 63910019 and 63910035 and a few others, no
>> problems.
>> Also tried to leave out two other tiles in the north, but then it
>> still won't boot.
>> _______________________________________________
>> mkgmap-dev mailing list
>> [hidden email]
>> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

ligfietser
But if you send just the two of those Bay of Biscay tiles
or a bigger mapset with those two included, everything seems normal.
It only happens with the big France mapset including those tiles.
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

ligfietser
In reply to this post by Felix Hartmann-2
Felix,
Do you use no-trim in your splitter parameters and how does your generate-sea parameters looks like?
Maybe a European coastline file will help?
Your sea and coastline will definitely look better with it (it now shows land in the Bay of Biscay) and
maybe these bugs will be solved too.

_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Felix Hartmann-2
No I used neither.
and my generate-sea parameters are:
--generate-sea=extend-sea-sectors,close-gaps=6000,floodblocker,fbgap=50,fbthres=50,fbratio=0.5

I don't mind that much when sea is empty. Sea has not much real use
anyhow except looking nice.
As for the tiles being too small - yeah it's right. But I still think it
has something to do with it. I now rerun France with max-nodes twice as
high - to see if problems are gone then (I would assume so)...
I'm still very positive that is has something to do with the POI index
being empty or nonexistent in those tiles.

The thing is, if you split the map in two halves - and send them in
separate gmapsupp.img files, but at the same time, then there is no
crash. So it seems at some point the GPS devices crash down after X
errors, but the errors are counted per gmapsupp or mapset (I could try
what happens if I merge the two gmapsupp.img into 1 gmapsupp.img but
with then of course different FID.

On 24.02.2012 11:39, Minko wrote:
> Felix,
> Do you use no-trim in your splitter parameters and how does your generate-sea parameters looks like?
> Maybe a European coastline file will help?
> Your sea and coastline will definitely look better with it (it now shows land in the Bay of Biscay) and
> maybe these bugs will be solved too.
>
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Felix Hartmann-2
In reply to this post by ligfietser
Oh well, I can also send all of France, as long as I take out the 3rd
tile, that contains not cities....
Maybe there are even more such tiles, however for all of them that I
could identify, one thing was common -- and that is no city inside the
whole tile.

Maybe the free cgpsmapper version, is including the cgpsmapper text on
0xb00 for some reason, not only advertisement.....

On 24.02.2012 11:20, Minko wrote:
> But if you send just the two of those Bay of Biscay tiles
> or a bigger mapset with those two included, everything seems normal.
> It only happens with the big France mapset including those tiles.
> _______________________________________________
> mkgmap-dev mailing list
> [hidden email]
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Felix Hartmann-2
In reply to this post by Felix Hartmann-2
Well I increased the maxnodes for the splitter, and even though the two
tiles in the bay of Biscay, remained unchanged, it works without
problems on my GPS now. The big problem remains, that for some countries
with maxnodes 800000 I run into too large files, while for France
(opposite side of the coin -- have a look into your maps of Europe - the
smallest tiles will all be in France) with maxnodes 2400000 it compiles
fine.
I tried before with default style-file, and the map also crashed the GPS.

So there is indeed the main problem, that the tiles become too small,
and miss some information that they should include. Maybe somehow
related to the POI index stuff??

I think the only real way out of it, would be to somehow merge mkgmap
and mgkmap splitter functionality (e.g. somehow take into account the
style-file for the splitters maxnode calculation). Or change mkgmap in
such a way, that if a tile cannot be compiled because it is too big, it
would automatically be split, and recompiled (but using a mapname that
doesn't conflict...).





On 24.02.2012 10:24, Felix Hartmann wrote:

> Bang, I think that's it. I now managed to sent a map including the bay
> of biscay (one tile), and looked if the other really small tiles
> included cities/islands. Found one that didn't, left it out and the
> GPS booted.
>
> IMHO (I'll try to simply include a city POI into the tiles of biscay)
> - we would need to make sure, that each tile has a city or island
> (0x650c)! Maybe that could be related to how the search function is
> organised? Loading maps the GPS usually tries to set up the POI index
> internally. Maybe that's why it crashes. Too few/no cities or no POI
> at all, and bang.
>
> My next try will be to simply include city POIs with gpsmapedit into
> each tile of the gulf of biscay, and recompile...
>
> On 24.02.2012 10:04, Felix Hartmann wrote:
>> I just tried - I left out the two main tiles of the Bay of Biscay,
>> and it booted (and to confirm I created the gmapsupp.img with both
>> mkgmap with and without address search, and also Mapsource). Leaving
>> out either of the two tiles,
>> So leaves us to wonder, why is it not booting with them.
>>
>> The main thing inside those two tiles, is the ferry line, go straight
>> across. Is it possible, that we have to use shorter staight lines?
>> Where could I patch mkgmap to split up straight lines say 5x as often?
>> The other thing could be - that there must be at least one city POI
>> in each tile (or at least any?? POI in each tile) - as both tiles
>> don't have any city. And only one of the two tiles has a POI at all.
>>
>> I'll also try what happens if I create the map with default
>> style-file. But I think it will crash the gps device too.
>> BTW -- I split france from geofabrik with max-nodes=1200000 and
>> maxnodes=1300000 and both results in the same problem.
>>
>> Or do we have to make sure, that mkgmap never creates such empty tiles?
>>
>> On 23.02.2012 23:44, Minko wrote:
>>> On a Dakota 20 I can confirm this behaviour.
>>> If I leave only tile 63910019 out of it, it still won't boot up.
>>> I did not try it without tile 63910035.
>>> With a smaller mapset with 63910019 and 63910035 and a few others,
>>> no problems.
>>> Also tried to leave out two other tiles in the north, but then it
>>> still won't boot.
>>> _______________________________________________
>>> mkgmap-dev mailing list
>>> [hidden email]
>>> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

ligfietser
If your observation of missing place nodes is right,maybe you can try to render place=bay or place=sea?

http://www.openstreetmap.org/browse/node/1195287137

I will try to render those next time with my maps, was missing the sea/bay names anyway and maybe this will prevent those booting problems too.
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Reply | Threaded
Open this post in threaded view
|

Re: Serious Bug - Mkgmap creating map that puts news GPS (confirmed etrex 30, Oregon 550) into bootloop

Felix Hartmann-2


On 24.02.2012 13:25, Minko wrote:
> If your observation of missing place nodes is right,maybe you can try to render place=bay or place=sea?
>
> http://www.openstreetmap.org/browse/node/1195287137
>
> I will try to render those next time with my maps, was missing the sea/bay names anyway and maybe this will prevent those booting problems too.

Well I'll include them, but I also had too small tiles inside the
mountains at the boarder (one of the 3 main offending tiles was inside
the mountains). I think there is some problem with indexed pois/adresses
without the city that belongs to them inside the same or neighbouring tile??
Fact is, those nearly empty tiles are the main problem - and somewhere
mkgmap has a big bug related to it.
> _______________________________________________
> mkgmap-dev mailing list
> [hidden email]
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________
mkgmap-dev mailing list
[hidden email]
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
12