https://issues.qgis.org/https://issues.qgis.org/favicon.ico2018-03-06T08:32:28ZQGIS Issue TrackingQGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883332018-03-06T08:32:28ZJérôme Guélat
<ul></ul><p>Confirmed here with QGIS 3.0 and 2.18.17... The opening time seems to be similar with the ESRI FileGDB driver.</p>
<p>Interestingly the problem doesn't happen if you use the browser to open the File Geodatabase in QGIS 3.0.</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883342018-03-06T08:46:06ZGiovanni Manghigiovanni.manghi@gmail.com
<ul><li><strong>Status</strong> changed from <i>Open</i> to <i>Feedback</i></li><li><strong>Priority</strong> changed from <i>Normal</i> to <i>High</i></li><li><strong>Regression?</strong> changed from <i>No</i> to <i>Yes</i></li></ul><p>Can you attach sample data? thanks!</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883402018-03-06T09:51:01ZCasper Børgesen
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>Open</i></li><li><strong>File</strong> <a href="/attachments/download/12364/testdata.gdb.zip">testdata.gdb.zip</a> added</li></ul><p>I have created a new dummy data set with 40 feature types inside a schema and each feature type has 20 attributes.</p>
<p>Using this data set I get the following timings:</p>
<ul>
<li>QGIS 3.1 (871132eae6): 30 seconds</li>
<li>QGIS 3.0: 25 seconds</li>
<li>QGIS 2.18.17: 1 second</li>
</ul> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883662018-03-06T11:19:53ZGiovanni Manghigiovanni.manghi@gmail.com
<ul><li><strong>Status</strong> changed from <i>Open</i> to <i>Feedback</i></li></ul><p>I just tried your dataset in my Win 10 testing VM and doing what you say (" I measured the time from dropping the folder until I got the dialog box asking me to select which feature types to load as layers") and is almost instantaneous. Anyway your layers seems empty, is that right?</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883722018-03-06T11:46:37ZCasper Børgesen
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>Open</i></li></ul><p>Giovanni Manghi wrote:</p>
<blockquote>
<p>I just tried your dataset in my Win 10 testing VM and doing what you say (" I measured the time from dropping the folder until I got the dialog box asking me to select which feature types to load as layers") and is almost instantaneous. Anyway your layers seems empty, is that right?</p>
</blockquote>
<p>Yes, there are no features in the data set.</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883732018-03-06T11:49:31ZGiovanni Manghigiovanni.manghi@gmail.com
<ul><li><strong>Status</strong> changed from <i>Open</i> to <i>Feedback</i></li></ul><blockquote>
<p>Yes, there are no features in the data set.</p>
</blockquote>
<p>so... have you tried on another system or doing a clean install?</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883742018-03-06T11:57:52ZCasper Børgesen
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>Open</i></li></ul><p>Giovanni Manghi wrote:</p>
<blockquote><blockquote>
<p>Yes, there are no features in the data set.</p>
</blockquote>
<p>so... have you tried on another system or doing a clean install?</p>
</blockquote>
<p>I have just tried on two more powerful machines and they both take around 13 seconds in QGIS 3, while still only use about 1 second in QGIS 2.18.17.</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883752018-03-06T12:00:21ZGiovanni Manghigiovanni.manghi@gmail.com
<ul><li><strong>Status</strong> changed from <i>Open</i> to <i>Feedback</i></li></ul><blockquote>
<p>I have just tried on two more powerful machines and they both take around 13 seconds in QGIS 3, while still only use about 1 second in QGIS 2.18.17.</p>
</blockquote>
<p>so is not instantaneous as here, but also is not minutes as in the original report. What about after adding the layers, any difference (in performance)?</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883762018-03-06T12:13:13ZCasper Børgesen
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>Open</i></li></ul><p>Giovanni Manghi wrote:</p>
<blockquote><blockquote>
<p>I have just tried on two more powerful machines and they both take around 13 seconds in QGIS 3, while still only use about 1 second in QGIS 2.18.17.</p>
</blockquote>
<p>so is not instantaneous as here, but also is not minutes as in the original report. What about after adding the layers, any difference (in performance)?</p>
</blockquote>
<p>I haven't added the layers since they doesn't contain anything. I was trying to keep the issue simple, since just opening a data set doesn't include panning or zooming or other user interactions to make performance measurements more complex.</p>
<p>But I guess something has happened from 2.18 to 3.x that significantly increases time consumption when trying to load a GDB data set.</p>
<p>Do you use your own compiled QGIS or the one from OSGeo?</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883792018-03-06T12:31:14ZGiovanni Manghigiovanni.manghi@gmail.com
<ul><li><strong>Status</strong> changed from <i>Open</i> to <i>Feedback</i></li></ul><blockquote>
<p>But I guess something has happened from 2.18 to 3.x that significantly increases time consumption when trying to load a GDB data set.</p>
</blockquote>
<p>I can't see any difference here (between 2.18 and 3, with your dataset)</p>
<blockquote>
<p>Do you use your own compiled QGIS or the one from OSGeo?</p>
</blockquote>
<p>osgeo4w on a clean testing Win10 VM.</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883832018-03-06T12:55:38ZJérôme Guélat
<ul></ul><p>I'm having the same problem using a clean install (from OSGeo4W) on Windows 7.</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883842018-03-06T12:57:06ZGiovanni Manghigiovanni.manghi@gmail.com
<ul></ul><p>Jérôme Guélat wrote:</p>
<blockquote>
<p>I'm having the same problem using a clean install (from OSGeo4W) on Windows 7.</p>
</blockquote>
<p>are your datasources in the local disk? network share? else?</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=883902018-03-06T13:14:52ZCasper Børgesen
<ul></ul><p>Giovanni Manghi wrote:</p>
<blockquote>
<p>Jérôme Guélat wrote:</p>
<blockquote>
<p>I'm having the same problem using a clean install (from OSGeo4W) on Windows 7.</p>
</blockquote>
<p>are your datasources in the local disk? network share? else?</p>
</blockquote>
<p>Mine are located on a local SSD.</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=884382018-03-07T07:26:33ZJérôme Guélat
<ul></ul><p>Mine are located on a network drive.</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=884432018-03-07T08:58:09ZGiovanni Manghigiovanni.manghi@gmail.com
<ul></ul><p>Jérôme Guélat wrote:</p>
<blockquote>
<p>Mine are located on a network drive.</p>
</blockquote>
<p>and if you copy them on a local drive?</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=884442018-03-07T08:59:20ZGiovanni Manghigiovanni.manghi@gmail.com
<ul></ul><blockquote>
<p>I have just tried on two more powerful machines and they both take around 13 seconds in QGIS 3, while still only use about 1 second in QGIS 2.18.17.</p>
</blockquote>
<p>should we change the description (that reports several minutes, not seconds)?</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=884532018-03-07T09:41:24ZCasper Børgesen
<ul></ul><p>Giovanni Manghi wrote:</p>
<blockquote><blockquote>
<p>I have just tried on two more powerful machines and they both take around 13 seconds in QGIS 3, while still only use about 1 second in QGIS 2.18.17.</p>
</blockquote>
<p>should we change the description (that reports several minutes, not seconds)?</p>
</blockquote>
<p>I am working on creating a data set matching the one I used in my initial timings. I will report back with my results.</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=884542018-03-07T09:55:00ZJérôme Guélat
<ul></ul><p>Giovanni Manghi wrote:</p>
<blockquote>
<p>Jérôme Guélat wrote:</p>
<blockquote>
<p>Mine are located on a network drive.</p>
</blockquote>
<p>and if you copy them on a local drive?</p>
</blockquote>
<p>Same problem with the dataset on a local SSD.</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=884862018-03-07T15:21:13ZCasper Børgesen
<ul><li><strong>File</strong> <a href="/attachments/download/12382/testdata_2.gdb.zip">testdata_2.gdb.zip</a> added</li><li><strong>Status</strong> changed from <i>Feedback</i> to <i>Open</i></li></ul><p>I have created a data set (testdata_2) that matches my initial timings more accurately. The data set has no features but a lot of feature types with corresponding attributes and some of them has domain values.</p>
Laptop timings (corresponding to the original):
<ul>
<li>QGIS 3.1: 03:53</li>
<li>QGIS 3.0: 04:01</li>
<li>QGIS 2.18.17: 00:06</li>
</ul>
Workstation (corresponding to the latter timings):
<ul>
<li>QGIS 3.1: 01:50</li>
<li>QGIS 3.0: 01:37</li>
<li>QGIS 2.18.17: 00:03</li>
</ul> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=900332018-06-02T21:23:50ZEven Rouaulteven.rouault@spatialys.com
<ul><li><strong>Category</strong> changed from <i>Data Provider</i> to <i>Data Provider/OGR</i></li><li><strong>Assignee</strong> set to <i>Even Rouault</i></li></ul> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=900362018-06-03T10:41:29ZEven Rouaulteven.rouault@spatialys.com
<ul><li><strong>% Done</strong> changed from <i>0</i> to <i>100</i></li><li><strong>Status</strong> changed from <i>Open</i> to <i>Closed</i></li></ul><p>Applied in changeset <a class="changeset" href="https://issues.qgis.org/projects/qgis/repository/revisions/55aa7a86be56ce098a6c0596d4e4bb191c3a52f5" title="[OGR provider] Improve performance of subLayers(), particularly on FileGDB with the proprietary d...">qgis|55aa7a86be56ce098a6c0596d4e4bb191c3a52f5</a>.</p> QGIS Application - Bug report #18342: Loading FileGDB's are really really slowhttps://issues.qgis.org/issues/18342?journal_id=900722018-06-04T07:49:50ZCasper Børgesen
<ul></ul><p>Even Rouault wrote:</p>
<blockquote>
<p>Applied in changeset <a class="changeset" href="https://issues.qgis.org/projects/qgis/repository/revisions/55aa7a86be56ce098a6c0596d4e4bb191c3a52f5" title="[OGR provider] Improve performance of subLayers(), particularly on FileGDB with the proprietary d...">qgis|55aa7a86be56ce098a6c0596d4e4bb191c3a52f5</a>.</p>
</blockquote>
<p>Hi Even, Thanks a lot.</p>
<p>I can confirm that the change really improves the loading performance! It is still 2-3 seconds slower than with QGIS 2.18 but that is negligible compared to the previous timings.</p>