Bug report #16577

Extremely slower time to open attribute table in 2.18.7 compared to 2.14.14

Added by Giovanni Manghi 6 days ago. Updated about 4 hours ago.

Status:Closed
Priority:High
Assignee:-
Category:Attribute table
Affected QGIS version:2.18.7 Regression?:Yes
Operating System: Easy fix?:No
Pull Request or Patch supplied:No Resolution:fixed/implemented
Crashes QGIS or corrupts data:No

Description

This could be related to #16239 and/or #15752

I have tested a 758719 polygon features on 2.18.7 (no debug output) and to open the table it takes over 6 minutes!
The same table on 2.14.14 (no debug output) open in a few seconds.

Can provide the dataset.

Rendering time is very similar.


Related issues

Related to QGIS Application - Bug report #16239: master: (much) slower rendering (and attribute table open... Open 02/27/2017
Related to QGIS Application - Bug report #15752: Slow render time Closed 10/25/2016

Associated revisions

Revision b97a980b
Added by Nyall Dawson 3 days ago

Greatly speed up attribute table loading

Don't advise for rows added when a model reset is in progress.
Otherwise the rows are tested for sort order, etc triggering
a bunch of useless calculations, given that the model is in
the process of being reset anyway.

Tested using a 150k point shapefile, decreased attribute table
load times from 50+ seconds to 4 seconds.

Refs #16577, #16239

Revision ebd3e0d7
Added by Nyall Dawson 2 days ago

Greatly speed up attribute table loading

Don't advise for rows added when a model reset is in progress.
Otherwise the rows are tested for sort order, etc triggering
a bunch of useless calculations, given that the model is in
the process of being reset anyway.

Tested using a 150k point shapefile, decreased attribute table
load times from 50+ seconds to 4 seconds.

Refs #16577, #16239

(forward port from b97a980b99a32f7cbbb8cc32ac6a781246df1171)

Revision 0b95c776
Added by Nyall Dawson 2 days ago

Don't prefetch attribute table sort values when no sorting set

Shaves some seconds off opening the attribute table in certain
circumstances (no sorting applied)

Refs #16577, #16239

Revision 4acc4805
Added by Nyall Dawson 2 days ago

Don't prefetch attribute table sort values when no sorting set
Shaves some seconds off opening the attribute table in certain
circumstances (no sorting applied)

Drops load time for table from 100 seconds to 50 seconds for a
2.6 million feature shapefile, and from 6.5 seconds to 3.5 seconds
for a 160k feature shapefile.

Refs #16577, #16239

(cherry-picked from 0b95c77)

History

#1 Updated by Alessandro Pasotti 6 days ago

Is that a point release build or a particular commit?

#2 Updated by Jürgen Fischer 6 days ago

  • Description updated (diff)

#3 Updated by Jürgen Fischer 6 days ago

  • Related to Bug report #16239: master: (much) slower rendering (and attribute table opening) time compared to 2.18.4 added

#4 Updated by Jürgen Fischer 6 days ago

#5 Updated by Giovanni Manghi 6 days ago

Alessandro Pasotti wrote:

Is that a point release build or a particular commit?

qgis 2.14.14 and 2.18.7 as installed by a normal user from osgeo4w under a clean Windows 7 environment.

Same observation on Ubuntu Linux from qgis repositories (the ones using also ubuntugis).

#7 Updated by Nyall Dawson about 4 hours ago

  • Resolution set to fixed/implemented
  • Status changed from Open to Closed

A bunch of fixes have been implemented in master and 2.18 which restore the performance to 2.14.0 levels

Also available in: Atom PDF