way not found after download_clone

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

way not found after download_clone

marc marc
Hello,

I have run download_clone to create a attic db
It run without any error (starting 22/9 ~16h30 UTC finished 23/9 ~7h30).
I then launched diff process with a change in fetch_osc_and_apply.sh
to update by reduced number of diff and to add minor log improvement
<   while [[ ( -s "$TEMP_SOURCE_DIR/$TARGET_FILE.state.txt" ) && (
$(($START + 1440)) -ge $(($TARGET)) ) && ( `du -m "$TEMP_TARGET_DIR" |
awk '{ print $1; }'` -le 64 ) ]];
 >   while [[ ( -s "$TEMP_SOURCE_DIR/$TARGET_FILE.state.txt" ) && (
$(($START + 10)) -ge $(($TARGET)) ) && ( `du -m "$TEMP_TARGET_DIR" | awk
'{ print $1; }'` -le 5 ) ]];

1st update was ok
2017-09-23 09:33:13: current replicate_id is 2632939
2017-09-23 09:33:15: diff found and downloaded. updating to replicate_id
2632950
2017-09-23 09:35:08: update complete 2632950

2nd not
2017-09-23 09:35:08: current replicate_id is 2632950
2017-09-23 09:35:10: diff found and downloaded. updating to replicate_id
2632961
Reading XML file ... finished reading nodes. Flushing to database ......
done.
Reading XML file ... finished reading ways. Flushing to database ......
done.
Reading XML file ... finished reading relations. Way 526615193 used in
relation 2537567 not found.
Way 526615192 used in relation 2537567 not found.
This way was create on 22/9 1h29, before I run clone_update
so it seems to be a bug in download_clone (missing objects or
replicate_id inconsistent with the data sent)

a few updates later, fatal error
terminate called after throwing an instance of 'std::logic_error'
   what():  Bad geometry for way 458303501

I have the full log if needed.

Regards,
Marc
Reply | Threaded
Open this post in threaded view
|

Re: way not found after download_clone

Roland Olbricht
Hello,

> 1st update was ok
> 2017-09-23 09:33:13: current replicate_id is 2632939
> 2017-09-23 09:33:15: diff found and downloaded. updating to replicate_id
> 2632950
> 2017-09-23 09:35:08: update complete 2632950
>
> 2nd not
> 2017-09-23 09:35:08: current replicate_id is 2632950
> 2017-09-23 09:35:10: diff found and downloaded. updating to replicate_id
> 2632961
> Reading XML file ... finished reading nodes. Flushing to database ......
> done.
> Reading XML file ... finished reading ways. Flushing to database ......
> done.
> Reading XML file ... finished reading relations. Way 526615193 used in
> relation 2537567 not found.

Please note that way 526615193 comes from the replication file 2632950
and neither could nor should have been contained in the cloned files.
Could you please check whether other data from that replication file has
been written to the database, i.e. is

echo 'way(526615194);out meta;' | bin/osm3s_query
--db-dir=/var/www/clone/2017-09-28

empty or not?

Regards,
Roland