Bug report #1472

Very slow shapefile editing, CPU usage maxes out. 1.0, on Intrepid AMD64

Added by Ilija Milicevic - almost 16 years ago. Updated over 15 years ago.

Status:Closed
Priority:Low
Assignee:Marco Hugentobler
Category:-
Affected QGIS version: Regression?:No
Operating System:Linux Easy fix?:No
Pull Request or Patch supplied: Resolution:fixed
Crashes QGIS or corrupts data: Copied to github as #:11532

Description

When I open a reasonably small shapefile and toggle editing, it takes a very long time (30-60sec for this particular 1.7Mb dataset) to toggle editing, then to open the attribute table and each time I select a new feature. My CPU usage maxes out in the process.. This issue was not present with 0.11, with the same datasets.
The package was downloaded through Synaptic, using http://ppa.launchpad.net/qgis/ubuntu intrepid main

History

#1 Updated by Ilija Milicevic - almost 16 years ago

Download link for the dataset in question. Larger datasets took even longer to perform the editing operations. http://mesa.geographynetwork.com/out/data/at_tigeresri6709103134.zip

#2 Updated by Jürgen Fischer almost 16 years ago

Replying to [comment:1 FiReSTaRT]:

Download link for the dataset in question. Larger datasets took even longer to perform the editing operations. http://mesa.geographynetwork.com/out/data/at_tigeresri6709103134.zip

The link didn't work for me, but I downloaded http://www2.census.gov/geo/tiger/TIGER2008/tl_2008_us_state.zip and could reproduce your problems.

Are you sure you used the same datasets with 0.11? Looks like QGIS is very slow on polygons (or all features) with an huge number of points (ie. drawing of polygons (Qt), highlighting polygons, area calculations and more).

80a8b8b6 (SVN r9917) speeds up highlighting of polygons a bit.

#3 Updated by Ilija Milicevic - almost 16 years ago

I'm positive that toggling editing, opening the attribute table and switching between highlighted features (with editing on) worked A LOT faster on 0.11 and without the huge CPU usage. With 0.11 I have been able to switch between various attribute table entries and edit them in real time.
I just tested QGIS on a 32bit machine (P4 1.4, 1Gb) and also replicated every aspect of the problem. Ofcourse everything took even longer than on my regular 64bit machine (AMD QL-60 2x2.0Ghz, 4Gb).

#4 Updated by Jürgen Fischer almost 16 years ago

Replying to [comment:4 FiReSTaRT]:

I'm positive that toggling editing, opening the attribute table and switching between highlighted features (with editing on) worked A LOT faster on 0.11 and without the huge CPU usage.

Just to be clear. You did use the same dataset (ie. polygons with lots of points. for example in the above dataset Texas has ~60000 points).

#5 Updated by Jürgen Fischer almost 16 years ago

I built 0.11 again and don't see much difference - except it's a bit slower. I don't see painful delays though.

#6 Updated by Ilija Milicevic - almost 16 years ago

Jef, I'm open to suggestions on how to demonstrate the issues.. I could do a screenshot video of the process, but it would be too large to post over here. If you can e-mail me ftp server info or your msn or an e-mail account that would be ok for 10megs and change, I'd be more than happy to send you all of the relevant info.
The bottom line is that commercial packages (well, at least ESRI) can perform the same functions on the same datasets in real time. If Open Source apps are ever going to become a viable alternative, they need to be able to handle 1-3MB shapefiles downloaded from government sites with reasonable speed.
In any case, I truly appreciate your work gentlemen and will try to assist you to the best of my limited ability.

#7 Updated by Jürgen Fischer almost 16 years ago

Replying to [comment:7 FiReSTaRT]:

Jef, I'm open to suggestions on how to demonstrate the issues.. I could do a screenshot video of the process, but it would be too large to post over here.

You didn't answer the question, if you were using the same dataset with 0.11 and 1.0.
Can you reproduce the problem with the dataset I posted?

If not, please provide a working link to the data you use or the arguments necessary to produce a similar download at mesa.geographynetwork.com.

The bottom line is that commercial packages (well, at least ESRI) can perform the same functions on the same datasets in real time. If Open Source apps are ever going to become a viable alternative, they need to be able to handle 1-3MB shapefiles downloaded from government sites with reasonable speed.

Well, obviously there must be something different between your setups and mine. I tried on my 64bit Linux box and on Windows. Both show reasonable speed. And I tried with 0.11 and didn't see a big performance difference - except for identify on polygons with many points, which is much quicker in 1.0 now, than it was on 0.11.

#8 Updated by Jürgen Fischer almost 16 years ago

  • Status changed from Open to Closed
  • Resolution set to fixed

thanks for supplying your dataset.

Closing this bug, as it turned out to be the rendering problem related to semi-transparent vertex markers.

For reference: http://lists.osgeo.org/pipermail/qgis-developer/2008-April/003582.html

#9 Updated by Anonymous over 15 years ago

Milestone Version 1.0.1 deleted

Also available in: Atom PDF