Missing Tiles in OruxMaps (Android) after creating Atlas

Hello,

I’m visiting this forum following a recommendation of the MOBAC-Forum Master, who said:

In the end it may also be a problem of the atlas format itself. The implementation of both OruxMaps atlas creators were created by the author of OruxMaps and I just integrated then in MOBAC. Therefore I recommend you to also ask in the OruxMaps forum.

At first sight, the problem appears to be not directly related to OruxMaps, but I think the MOBAC-Forum Master advice is in the right direction. Anyway, I’ll repeat most of what I have already said in the previous Forum.

I have the opinion that OruxMaps is the most complete and flexible Android GPS software. Therefore, I decided to implement my own offline maps in OruxMaps after evaluating many other Android Applications.
Since then, I have been learning a bit related to GIS software, so I have made my own topo maps and converted them onto OruxMaps SQLite format, uploaded them into my cell phone and hopefully will navigate using them during my hiking trips.

Unfortunately, when I upload the OruxMaps-Sqlite-format-map into my Cell phone and open it, there are missing tiles predominantly at the bottom edge and bottom right corner of the most populated tiled zoom levels [levels or layers 17 and above, 18, 19, etc].

I have checked everything I can think of with no success. I have run the map-making-process and the SQLite-conversion-process on different computers, uploaded the data into several cell phones (with single, double and quad processors), used different versions of MOBAC (to discard software and hardware issues), but the bug still persists.

The only thing left I can think of is to come to this forum and ask for help.

I’m linking the following document:
*.doc - https://dl.dropbox.com/u/76546851/MOBAC_Issue.doc
*.pdf - https://dl.dropbox.com/u/76546851/MOBAC_Issue.pdf
which is kind of self explanatory with all the data and information I can think of could be helpful for a start.

When I was thinking about coming to this Forum following the MOBAC-Forum Master advise, I wanted as much as I could be sure that the problem was strictly related to OruxMaps, so I made the following exercise: I looked up for SQLite database managers to be able to see inside the database generated by the SQLite Atlas Creation process of MOBAC. I used two that I found on the Internet:
SQLite Database Browser - http://sourceforge.net/projects/sqlitebrowser/
SQLite Maestro - http://www.sqlmaestro.com/products/#sqlite

Using those tools, I got the following results:

Tiles
Level	There should be	Thera are in the SQLite DataBase	Missing
12	2	2		1 Row x 2 Colums
13	6	6		2 Rows x 3 Colums
14	24	24		4 Rows x 6 Colums
15	96	96		8 Rows x 12 Colums
16	384	384		16 Rows x 24 Colums
17	1536	1001	535	32 Rows x 48 Colums
18	6144	6006	138	64 Rows x 96 Colums
Total	8192	7519	673

I have mapped the outcome using a simple schema by means of MS Excel:
*.xls - https://dl.dropbox.com/u/76546851/AvilaTable/Tiles_Table.xls
where you can see the location of the missing tiles, which also matches exactly the missing tiles of the map opened in OruxMaps.

In conclusion, OruxMaps obviously can NOT show the tiles that are not in the database. In other words, it seems to be more likely a problem of MOBAC, but the MOBAC developer hands are tied. In this particular case, he is just the integrator, not the developer. I think there is not much he/she can do.

Well, if there is anyone who can help, I’ll truly appreciate it so I’ll like to be able to use my topo maps in OruxMaps as soon as I could.

I’m attaching other links to data that I think can be helpful in case it is needed:

Original topo map tiles (syntax: z/x/y.png) (tile size: 256x256):
https://dl.dropbox.com/u/76546851/AvilaTileStore/AvilaTiles.zip

Tilestore created by MOBAC’s Atlas process:
https://dl.dropbox.com/u/76546851/AvilaTileStore/tilestoreAvila.zip

Links to the audit logs generated by the MOBAC Atlas creation process:
System Report - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_00_System_Report.log
Trace Log - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_01_Trace.log
Debug Log - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_02_Debug.log
Info Log - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_03_Info.log
Error Log - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_04_Error.log
Fatal Log - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_05_Fatal.log

rlebrun1 wrote:Hello,

I’m visiting this forum following a recommendation of the MOBAC-Forum Master, who said:

In the end it may also be a problem of the atlas format itself. The implementation of both OruxMaps atlas creators were created by the author of OruxMaps and I just integrated then in MOBAC. Therefore I recommend you to also ask in the OruxMaps forum.

At first sight, the problem appears to be not directly related to OruxMaps, but I think the MOBAC-Forum Master advice is in the right direction. Anyway, I’ll repeat most of what I have already said in the previous Forum.

I have the opinion that OruxMaps is the most complete and flexible Android GPS software. Therefore, I decided to implement my own offline maps in OruxMaps after evaluating many other Android Applications.
Since then, I have been learning a bit related to GIS software, so I have made my own topo maps and converted them onto OruxMaps SQLite format, uploaded them into my cell phone and hopefully will navigate using them during my hiking trips.

Unfortunately, when I upload the OruxMaps-Sqlite-format-map into my Cell phone and open it, there are missing tiles predominantly at the bottom edge and bottom right corner of the most populated tiled zoom levels [levels or layers 17 and above, 18, 19, etc].

I have checked everything I can think of with no success. I have run the map-making-process and the SQLite-conversion-process on different computers, uploaded the data into several cell phones (with single, double and quad processors), used different versions of MOBAC (to discard software and hardware issues), but the bug still persists.

The only thing left I can think of is to come to this forum and ask for help.

I’m linking the following document:
*.doc - https://dl.dropbox.com/u/76546851/MOBAC_Issue.doc
*.pdf - https://dl.dropbox.com/u/76546851/MOBAC_Issue.pdf
which is kind of self explanatory with all the data and information I can think of could be helpful for a start.

When I was thinking about coming to this Forum following the MOBAC-Forum Master advise, I wanted as much as I could be sure that the problem was strictly related to OruxMaps, so I made the following exercise: I looked up for SQLite database managers to be able to see inside the database generated by the SQLite Atlas Creation process of MOBAC. I used two that I found on the Internet:
SQLite Database Browser - http://sourceforge.net/projects/sqlitebrowser/
SQLite Maestro - http://www.sqlmaestro.com/products/#sqlite

Using those tools, I got the following results:

Tiles
Level	There should be	Thera are in the SQLite DataBase	Missing
12	2	2		1 Row x 2 Colums
13	6	6		2 Rows x 3 Colums
14	24	24		4 Rows x 6 Colums
15	96	96		8 Rows x 12 Colums
16	384	384		16 Rows x 24 Colums
17	1536	1001	535	32 Rows x 48 Colums
18	6144	6006	138	64 Rows x 96 Colums
Total	8192	7519	673

I have mapped the outcome using a simple schema by means of MS Excel:
*.xls - https://dl.dropbox.com/u/76546851/AvilaTable/Tiles_Table.xls
where you can see the location of the missing tiles, which also matches exactly the missing tiles of the map opened in OruxMaps.

In conclusion, OruxMaps obviously can NOT show the tiles that are not in the database. In other words, it seems to be more likely a problem of MOBAC, but the MOBAC developer hands are tied. In this particular case, he is just the integrator, not the developer. I think there is not much he/she can do.

Well, if there is anyone who can help, I’ll truly appreciate it so I’ll like to be able to use my topo maps in OruxMaps as soon as I could.

I’m attaching other links to data that I think can be helpful in case it is needed:

Original topo map tiles (syntax: z/x/y.png) (tile size: 256x256):
https://dl.dropbox.com/u/76546851/AvilaTileStore/AvilaTiles.zip

Tilestore created by MOBAC’s Atlas process:
https://dl.dropbox.com/u/76546851/AvilaTileStore/tilestoreAvila.zip

Links to the audit logs generated by the MOBAC Atlas creation process:
System Report - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_00_System_Report.log
Trace Log - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_01_Trace.log
Debug Log - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_02_Debug.log
Info Log - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_03_Info.log
Error Log - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_04_Error.log
Fatal Log - https://dl.dropbox.com/u/76546851/AvilaAuditLogs/MOBAC_05_Fatal.log

Hello;

Please, check if the value of MOBAC--settings--map size is the larger value; if not, the map created is not correct. I sent a patch to MOBAC to solve that problem months ago, I do not know if it is implemented,

orux

Hello Mr. Orux,

As you may see in the first document of the topic opener, one of the first screen captures posted in such a document is the setting of the given parameter in the Atlas settings window:
*.doc https://dl.dropbox.com/u/76546851/MOBAC_Issue.doc
*.pdf https://dl.dropbox.com/u/76546851/MOBAC_Issue.pdf

Also, in the Custom Data section of the same document can be observed that the maps never exceed the maximum pixel size (width & height) of 1048575, as follows:

Level	Qtty Tiles (256x256)	Tile Rows	Tile Columns	Map Width (pixels)	Map Height (pixels)
12	6	2	3	768	512
13	24	4	6	1536	1024
14	96	8	12	3072	2048
15	384	16	24	6144	4096
16	1536	32	48	12288	8192
17	6144	64	96	24576	16384
18	24576	128	192	49152	32768

Thanks for your attention,

Hello Mr. Orux,

Are you planning in the near future to fix the bug that the Oruxmaps SQLite atlas creation process has in MOBAC?
I really would like to know if you are going to fix it, so that way I'll know if I'll be able to use the Androig OruxMap application.

I'm sure you are quite busy with the implementation of many new interesting Oruxmap application features, but to fix this bug shouldn't take you much time. I trully thank if you can make the effort...

The tiles are missing in small maps too!

I've been able to recreate the problem with a map of 4096 tiles or 85 MiBytes.

The MOBAC saved profile is:

Code:

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<atlas outputFormat="OruxMapsSqlite" name="Test 13" version="1">
    <Layer name="Test 13">
        <Map name="Test 13 13" zoom="13" mapSource="CycleMap" minTileCoordinate="1034240/684032" maxTileCoordinate="1050623/700415"/>
    </Layer>
</atlas>

It shows a row of missing tiles just south of London.

rlebrun1 wrote:Hello Mr. Orux,

Are you planning in the near future to fix the bug that the Oruxmaps SQLite atlas creation process has in MOBAC?
I really would like to know if you are going to fix it, so that way I'll know if I'll be able to use the Androig OruxMap application.

I'm sure you are quite busy with the implementation of many new interesting Oruxmap application features, but to fix this bug shouldn't take you much time. I trully thank if you can make the effort...

Hi;

the bug should be fixed in the last betas of MOBAC.

I think MOBAC supports rmap format; also OruxMaps, please try with that format.

orux

orux wrote:

rlebrun1 wrote:Hello Mr. Orux,

Are you planning in the near future to fix the bug that the Oruxmaps SQLite atlas creation process has in MOBAC?
I really would like to know if you are going to fix it, so that way I'll know if I'll be able to use the Androig OruxMap application.

I'm sure you are quite busy with the implementation of many new interesting Oruxmap application features, but to fix this bug shouldn't take you much time. I trully thank if you can make the effort...

Hi;

the bug should be fixed in the last betas of MOBAC.

I think MOBAC supports rmap format; also OruxMaps, please try with that format.

orux

Hi,

The latest official MOBAC release is 1.9.9 made on 9-Oct-2012 and includes "OruxMaps: Patch #3300055 applied". There were a couple of updates to the source code after 30-Oct, none of them relates to Orux. I hope it's safe to assume the above bug fix was released then.

Using MOBAC 1.9.9 I was able to recreate the "missing row" problem with a 64x64 tile OruxMaps SQLite map (see map definition above).
A "TwoNav rmap" mp created by MOBAC 1.9.9 of the same area shows all tiles, but has issues of its own.

It looks like MOBAC developer r_x was correct in confining the error to the contributed code for creating OruxMaps SQLite maps.


Orux,

I would like to ask you to take a second look at the "OruxMaps SQLite" code contributed to MOBAC, use the 64x64 tiles example above, and try to locate the bug.

Thanks!!!
Steed

steed wrote:

orux wrote:

rlebrun1 wrote:Hello Mr. Orux,

Are you planning in the near future to fix the bug that the Oruxmaps SQLite atlas creation process has in MOBAC?
I really would like to know if you are going to fix it, so that way I'll know if I'll be able to use the Androig OruxMap application.

I'm sure you are quite busy with the implementation of many new interesting Oruxmap application features, but to fix this bug shouldn't take you much time. I trully thank if you can make the effort...

Hi;

the bug should be fixed in the last betas of MOBAC.

I think MOBAC supports rmap format; also OruxMaps, please try with that format.

orux

Hi,

The latest official MOBAC release is 1.9.9 made on 9-Oct-2012 and includes "OruxMaps: Patch #3300055 applied". There were a couple of updates to the source code after 30-Oct, none of them relates to Orux. I hope it's safe to assume the above bug fix was released then.

Using MOBAC 1.9.9 I was able to recreate the "missing row" problem with a 64x64 tile OruxMaps SQLite map (see map definition above).
A "TwoNav rmap" mp created by MOBAC 1.9.9 of the same area shows all tiles, but has issues of its own.

It looks like MOBAC developer r_x was correct in confining the error to the contributed code for creating OruxMaps SQLite maps.


Orux,

I would like to ask you to take a second look at the "OruxMaps SQLite" code contributed to MOBAC, use the 64x64 tiles example above, and try to locate the bug.

Thanks!!!
Steed

Hello;

You are right;

A recent change prevents the final commit to the database.

Sending a patch...

orux

Thanks!!!!

Hi @ll!

I realized, that the problem I reported in another thread (see the other thread) seems to be identical with the problem in this thread here.
Are there any news about the implementation of the patch anounced by orux? I'm using the latest version of MOBAC (1.9.10) but the bug still exists.

So I add another table similar to rlebrun1. Maybe it helps to solve the problem once and for all.

In my case it's a map of Norway in zoom levels 7 - 12. The number of tiles of the same map in Orux non-SQLite format is used as comparison because this map seems to be complete.

Here are the results:
[[

Tiles
	There are in Orux	There are in the
Level	(non SQLITE!) format	SQLite DataBase	Missing
7	36	36	0
8	120	120	0
9	460	460	0
10	1794	1001	793
11	7176	7007	169
12	28704	28028	676
Total	38290	36652	1638

The MOBAC saved profile is:

Code:

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<atlas version="1" name="Topo" outputFormat="OruxMapsSqlite">
    <Layer name="Norwegen">
        <Map maxTileCoordinate="19455/9983" minTileCoordinate="16640/6912" mapSource="Statkart Toporaster 2" zoom="7" name="Topo 07"/>
        <Map maxTileCoordinate="38655/19967" minTileCoordinate="33536/13824" mapSource="Statkart Topo 2" zoom="8" name="Topo 08"/>
        <Map maxTileCoordinate="77055/39679" minTileCoordinate="67072/27904" mapSource="Statkart Toporaster 2" zoom="9" name="Topo 09"/>
        <Map maxTileCoordinate="154111/79359" minTileCoordinate="134144/55808" mapSource="Statkart Toporaster 2" zoom="10" name="Topo 10"/>
        <Map maxTileCoordinate="308223/158719" minTileCoordinate="268288/111616" mapSource="Statkart Toporaster 2" zoom="11" name="Topo 11"/>
        <Map maxTileCoordinate="616447/317439" minTileCoordinate="536576/223232" mapSource="Statkart Toporaster 2" zoom="12" name="Topo 12"/>
    </Layer>
</atlas>


Thanks!

theudebert

P.S.: I'm not a coder, but I think it's eye-catching, that the number 1001 and multiples of it exist in both tables. So maybe this could be a starting point for finding the bug.

orux wrote:Hello;

You are right;

A recent change prevents the final commit to the database.

Sending a patch...

orux

Hi Orux,
Did you eventually send the patch to MOBAC?
There were no such updates to the MOBAC source since the above post.
Thanks!!
Steed

steed wrote:

orux wrote:Hello;

You are right;

A recent change prevents the final commit to the database.

Sending a patch...

orux

Hi Orux,
Did you eventually send the patch to MOBAC?
There were no such updates to the MOBAC source since the above post.
Thanks!!
Steed

It was sent, but it was not applied till-->Applied in SVN rev 2083

orux

I tested MOBAC 1.9.11 and the bug of the missing tiles on the Orux SQlite persists.

Is there any solution?

Thanks
Bruno

bj wrote:I tested MOBAC 1.9.11 and the bug of the missing tiles on the Orux SQlite persists.

Is there any solution?

Thanks
Bruno

And what is the size of sqlite DB?

I have similar problems with sqlite db bigger them 2GB.