Feature request #16578

Add the ability to bulk load or update dataset to databases

Added by Regis Haubourg 3 months ago. Updated 3 months ago.

Status:Open
Priority:Normal
Assignee:-
Category:DB Manager
Pull Request or Patch supplied:No Resolution:
Easy fix?:No

Description

Hi, currently, loading into postgres (or any other DB) just do individual INSERT commands.
This can be really slow.
Adding an option to load using COPY statements would speed up things a LOT. :)

see previous thread here :
[[http://osgeo-org.1560.x6.nabble.com/QGIS-Developer-Postgis-loading-using-COPY-instead-of-INSERTS-td5320528.html#a5321038]]

History

#1 Updated by Giovanni Manghi 3 months ago

  • Status changed from Open to Feedback

Or just use the Processing/ogr based tools to import data in postgis as they use COPY and are a whole lot faster than any other option in QGIS (and I created exactly for that reason).

#2 Updated by Regis Haubourg 3 months ago

  • Status changed from Feedback to Open

Yeah, and thank you for creating that algorithm. I tested it and it's nice. Anyway that sounds more like and alternative option in the UX. My opinion is that features exposed directly to users must be the most effective ones, and users should'nt have to dig into processing and know that ogr has a lot more options.
From a developer point of view, having a unique loader code, using OGR can be interesting to avoid code cluterring and efforts being duplicated.

#3 Updated by Giovanni Manghi 3 months ago

Regis Haubourg wrote:

Yeah, and thank you for creating that algorithm. I tested it and it's nice. Anyway that sounds more like and alternative option in the UX. My opinion is that features exposed directly to users must be the most effective ones, and users should'nt have to dig into processing and know that ogr has a lot more options.
From a developer point of view, having a unique loader code, using OGR can be interesting to avoid code cluterring and efforts being duplicated.

I asked over and over to improve the situation of the DB manager loader, the d&d loader etc. has it didn't get any attention I had to implement what I needed... a blazing fast tool to load vectors in Postgis, in this sense I don't care if is duplicate of other tools are others don't care of users needs.

Also available in: Atom PDF