https://issues.qgis.org/https://issues.qgis.org/favicon.ico2018-07-03T07:36:17ZQGIS Issue TrackingQGIS Application - Bug report #19315: QGIS 3.2 clean install misses many dependencieshttps://issues.qgis.org/issues/19315?journal_id=906322018-07-03T07:36:17ZJürgen Fischerjef@norbit.de
<ul><li><strong>Status</strong> changed from <i>Open</i> to <i>Feedback</i></li></ul><p>Not reproducable.</p>
<blockquote>
<p>A clean install (all previous QGis versions purged and directories manually deleted) of Bonn on Ubuntu 16.04 misses many files.<br />We installed using sudo apt install qgis python-gis qgis-plugin-grass with repo <a class="external" href="https://qgis.org/ubuntugis">https://qgis.org/ubuntugis</a> and <a class="external" href="http://ppa.launchpad.net/ubuntugis/ubuntugis-unstable/ubuntu">http://ppa.launchpad.net/ubuntugis/ubuntugis-unstable/ubuntu</a>, both xenial main. The installation ran without complaint and dpkg.log showed no errors.</p>
</blockquote>
<p>You probably installed <code>python-qgis</code>.</p>
<blockquote>
<p>On starting QGIS we got a stream of errors starting with an inability to find the grass configuration file, then a failure to authenticate.</p>
</blockquote>
<p>Quoting the error messages would have been nice.</p>
<blockquote>
<p>Directories we copied which were missing from the clean system were /usr/share/qgis/python, /usr/share/qgis/grass and /usr/share/qgis/svg (probably not required but needed for our use in the long run anyway)</p>
</blockquote>
<blockquote>
<p>We also copied /usr/share/qgis/resources/cpt-city-qgis-min/ which was not on the clean machine - again not sure whether that was important.<br />The clean machine was missing qgis.db, the two srs dbs and the symbology-style.xml file from /usr/share/qgis/resources/ so copied those.<br />Finally half the object code from /usr/lib/qgis/plugins/ was missing including all the data providers so copied them across as well</p>
</blockquote>
<p>The directories you mention should be in these packages (on your machine the package versions should just be <code>1:3.2.0+24xenial-ubuntugis</code> instead of <code>1:3.2.0+99unstable</code>):</p>
<pre>
$ dpkg -S /usr/share/qgis/python
python-qgis-common: /usr/share/qgis/python
$ dpkg -S /usr/share/qgis/grass
qgis-plugin-grass-common: /usr/share/qgis/grass
$ dpkg -S /usr/share/qgis/svg
qgis-providers-common: /usr/share/qgis/svg
$ dpkg -S /usr/share/qgis/resources/cpt-city-qgis-min/
qgis-providers-common: /usr/share/qgis/resources/cpt-city-qgis-min
$ dpkg -S /usr/lib/qgis/plugins
qgis-plugin-grass, qgis-providers, qgis, qgis-provider-grass: /usr/lib/qgis/plugins
$ dpkg -l qgis-plugin-grass qgis-providers qgis qgis-provider-grass python-qgis-common qgis-plugin-grass-common qgis-providers-common
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-=====================================-=======================-=======================-================================================================================
ii python-qgis-common 1:3.2.0+99unstable all Python bindings to QGIS - architecture-independent files
ii qgis 1:3.2.0+99unstable amd64 Geographic Information System (GIS)
ii qgis-plugin-grass 1:3.2.0+99unstable amd64 GRASS plugin for QGIS
ii qgis-plugin-grass-common 1:3.2.0+99unstable all GRASS plugin for QGIS - architecture-independent data
ii qgis-provider-grass 1:3.2.0+99unstable amd64 GRASS provider for QGIS
ii qgis-providers 1:3.2.0+99unstable amd64 collection of data providers to QGIS
ii qgis-providers-common 1:3.2.0+99unstable all collection of data providers to QGIS - architecture-independent files
</pre>
<blockquote>
<p>I wondered if it might be a permissions issue for some of the install scripts but if so they are not being reported.</p>
</blockquote>
<p>Me too. Can you verify which packages got installed?</p> QGIS Application - Bug report #19315: QGIS 3.2 clean install misses many dependencieshttps://issues.qgis.org/issues/19315?journal_id=906332018-07-03T08:22:47ZKim Frankcombekim@exploregeo.com.au
<ul></ul><p>Thanks Jürgen</p>
<p>Some answers;</p>
<p>On checking the CL in the terminal I see that yes it was python-qgis not python-gis that was installed. They had cut and pasted from the QGIS website so got it right whereas I had written from memory and missed it, sorry.</p>
<p>I did feel guilty about not quoting the error messages but hadn't written them down as they happened. However I had googled them so I got the user to go back through the Firefox history for the past couple of days google searches and list them. In order of appearance they are;</p>
<pre>
The config file (/usr/share/qgis/grass/modules/default.qgc) not found
Authentication System: DISABLED. Resources authenticating via the system can not be accessed
ImportError: No module named 'pyplugin_installer'
</pre>
<p>No error was given for the lack of CRS's or data handlers they just didn't show when you went to the relevant dialogue.</p>
<pre>
$ dpkg -S /usr/share/qgis/python
python-qgis-common: /usr/share/qgis/python
$ dpkg -S /usr/share/qgis/grass
qgis-plugin-grass-common: /usr/share/qgis/grass
$ dpkg -S /usr/share/qgis/svg
qgis-providers-common: /usr/share/qgis/svg
$ dpkg -S /usr/share/qgis/resources/cpt-city-qgis-min/
qgis-providers-common: /usr/share/qgis/resources/cpt-city-qgis-min
$ dpkg -S /usr/lib/qgis/plugins
qgis-provider-grass, qgis-plugin-grass, qgis: /usr/lib/qgis/plugins
$ dpkg -l qgis-plugin-grass qgis-providers qgis qgis-provider-grass python-qgis-common qgis-plugin-grass-common qgis-providers-common
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-==============-============-============-=================================
ii python-qgis-co 1:3.2.0+24xe all Python bindings to QGIS - archite
ii qgis 1:3.2.0+24xe amd64 Geographic Information System (GI
ii qgis-plugin-gr 1:3.2.0+24xe amd64 GRASS plugin for QGIS
ii qgis-plugin-gr 1:3.2.0+24xe all GRASS plugin for QGIS - architect
ii qgis-provider- 1:3.2.0+24xe amd64 GRASS provider for QGIS
ii qgis-providers 1:3.2.0+24xe amd64 collection of data providers to Q
ii qgis-providers 1:3.2.0+24xe all collection of data providers to Q
</pre>
<p>Unfortunately this is all on the "patched" machine so we would have got a different result had I tried it first thing this morning.</p>
<p>Does that help?</p>
<p>Cheers<br />Kim</p> QGIS Application - Bug report #19315: QGIS 3.2 clean install misses many dependencieshttps://issues.qgis.org/issues/19315?journal_id=906342018-07-03T08:52:41ZJürgen Fischerjef@norbit.de
<ul><li><strong>Priority</strong> changed from <i>High</i> to <i>Normal</i></li></ul><p>Kim Frankcombe wrote:</p>
<blockquote>
<p>The config file (/usr/share/qgis/grass/modules/default.qgc) not found <br />Authentication System: DISABLED. Resources authenticating via the system can not be accessed<br />ImportError: No module named 'pyplugin_installer'</p>
</blockquote>
<p><code>/usr/share/qgis/grass/modules/default.qgc</code> is in <code>qgis-plugin-grass-common</code> and <code>pyplugin_installer</code> in <code>python-qgis-common</code>.</p>
<p>You should see the it in the packages:</p>
<pre>
$ dpkg -S default.qgc
qgis-plugin-grass-common: /usr/share/qgis/grass/modules/default.qgc
$ dpkg --contents /var/cache/apt/archives/qgis-plugin-grass-common_1%3a3.2.0+*all.deb | grep default.qgc
-rw-r--r-- root/root 26758 2018-06-22 09:00 ./usr/share/qgis/grass/modules/default.qgc
</pre>
<p>So after installing they should be there. If <code>dpkg -S</code> has stuff that the file system doesn't have there seems to be a puzzling local instead of a packaging issue.</p> QGIS Application - Bug report #19315: QGIS 3.2 clean install misses many dependencieshttps://issues.qgis.org/issues/19315?journal_id=906352018-07-03T09:15:06ZKim Frankcombekim@exploregeo.com.au
<ul></ul><p>Remember that after the initial installation and re-installation there was no grass or python directory in /usr/share/qgis/ we had to add them manually.</p>
<pre>
$ dpkg -S default.qgc
qgis-plugin-grass-common: /usr/share/qgis/grass/modules/default.qgc
$ dpkg --contents /var/cache/apt/archives/qgis-plugin-grass-common_1%3a3.2.0+*all.deb | grep default.qgc
dpkg-deb: error: failed to read archive '/var/cache/apt/archives/qgis-plugin-grass-common_1%3a3.2.0+*all.deb': No such file or directory
</pre>
<p>Finally an error!</p>
<pre>
$ ls -l /var/cache/apt/archives/qgis*
-rw-r--r-- 1 root root 6519822 Jan 20 12:37 /var/cache/apt/archives/qgis_1%3a2.18.16+24xenial_amd64.deb
-rw-r--r-- 1 root root 6853746 May 19 09:52 /var/cache/apt/archives/qgis_1%3a3.0.3+24xenial-ubuntugis_amd64.deb
-rw-r--r-- 1 root root 10898914 May 19 09:52 /var/cache/apt/archives/qgis-common_1%3a3.0.3+24xenial-ubuntugis_all.deb
-rw-r--r-- 1 root root 3246386 May 19 09:52 /var/cache/apt/archives/qgis-providers_1%3a3.0.3+24xenial-ubuntugis_amd64.deb
-rw-r--r-- 1 root root 2527282 May 19 09:52 /var/cache/apt/archives/qgis-providers-common_1%3a3.0.3+24xenial-ubuntugis_all.deb
-rw-r--r-- 1 root root 1759874 Jan 20 12:37 /var/cache/apt/archives/qgis-server_1%3a2.18.16+24xenial_amd64.deb
-rw-r--r-- 1 root root 2094140 May 19 09:52 /var/cache/apt/archives/qgis-server_1%3a3.0.3+24xenial-ubuntugis_amd64.deb
</pre>
<p>It's not there</p>
<p>I'm not sure why they decided to install the server but I hav't got them to delete it yet as I wasn't sure what its dependencies were.</p> QGIS Application - Bug report #19315: QGIS 3.2 clean install misses many dependencieshttps://issues.qgis.org/issues/19315?journal_id=906362018-07-03T12:32:57ZJürgen Fischerjef@norbit.de
<ul></ul><p>Kim Frankcombe wrote:</p>
<blockquote>
<p>Remember that after the initial installation and re-installation there was no grass or python directory in /usr/share/qgis/ we had to add them manually.</p>
</blockquote>
<p>I thought you copied the files, because the files were missing. You also said that <code>qgis-plugin-grass</code> was installed without an error - which implies that <code>qgis-plugin-grass-common</code> was also installed. Which is also what your package listing shows:</p>
<pre>
ii qgis-plugin-gr 1:3.2.0+24xe all GRASS plugin for QGIS - architect
</pre>
<p>That should be <code>qgis-plugin-grass-common</code>. If it was a freshly (re-)installed, it should still be in the cache - unless you meanwhile ran <code>apt-get clean</code> or the like. Odd that it isn't there anymore.</p>
<blockquote>
<p>I'm not sure why they decided to install the server but I hav't got them to delete it yet as I wasn't sure what its dependencies were.</p>
</blockquote>
<p><code>qgis</code> and <code>qgis-server</code> both depend on eg. <code>qgis-providers</code> corresponding to their version. So installing <code>qgis</code> should also have initiate an upgrade of <code>qgis-server</code> to 3.2.</p>
<p>The question still is, why <code>qgis-plugin-grass-common</code> among others was apparently installed, although the files were not there. Please run <code>debsums -s qgis-plugin-grass-common</code> which will verify the the installed files are available and unmodified (without the package name it'll check all packages).</p> QGIS Application - Bug report #19315: QGIS 3.2 clean install misses many dependencieshttps://issues.qgis.org/issues/19315?journal_id=906382018-07-03T12:54:13ZKim Frankcombekim@exploregeo.com.au
<ul></ul><p>Yes we copied the whole directories from my machine because they were missing from the clean machine. Also true that no errors were reported either to the terminal or dpkg log. No they did not run apt-get clean, I've been trying to encourage them to use apt rather than apt-get. They may have run apt autoclean after installing the new kernel update this morning though. However why would that selectively remove qgis-grass-plugin-common and not older packages like the V2.18 packages in there?</p>
<p>Could it be a typo or broken package list on the ubuntugis xenial repo?</p>
<p>I'll answer the last question tomorrow when I'm back in the office. Thanks for your attention to this.</p> QGIS Application - Bug report #19315: QGIS 3.2 clean install misses many dependencieshttps://issues.qgis.org/issues/19315?journal_id=906482018-07-04T03:13:07ZKim Frankcombekim@exploregeo.com.au
<ul><li><strong>File</strong> <a href="/attachments/download/12921/dpkg.log">dpkg.log</a><a href="/attachments/12921/dpkg.log"><img alt="Magnifier" src="/images/magnifier.png" /></a> added</li></ul><p>OK. debsums -s qgis-plugin-grass-common returns nothing. On checking with my machine where I worked through from 2.18 to the early adopter to 3.2 successively I get the same result.</p>
<p>In case it helps I've attached the section of the dpkg log from the clean machine and it shows qgis-plugin-grass as installed. apt list sees ...-common</p>
<p>$ sudo apt list |grep grass-common</p>
<p>WARNING: apt does not have a stable CLI interface. Use with caution in scripts.</p>
<p>qgis-plugin-grass-common/xenial,xenial,now 1:3.2.0+24xenial-ubuntugis all [installed]</p> QGIS Application - Bug report #19315: QGIS 3.2 clean install misses many dependencieshttps://issues.qgis.org/issues/19315?journal_id=906522018-07-04T07:23:42ZJürgen Fischerjef@norbit.de
<ul></ul><p>Kim Frankcombe wrote:</p>
<blockquote>
<p>OK. debsums -s qgis-plugin-grass-common returns nothing. On checking with my machine where I worked through from 2.18 to the early adopter to 3.2 successively I get the same result.</p>
<p>In case it helps I've attached the section of the dpkg log from the clean machine and it shows qgis-plugin-grass as installed. apt list sees ...-common</p>
</blockquote>
<p>Not really. Except for <code>qgis-common</code>, which doesn't have any of the missing files, none of the <code>-common</code> packages are mentioned in <code>dpkg.log</code> - although they are installed in the current version. So it's an older problem…</p> QGIS Application - Bug report #19315: QGIS 3.2 clean install misses many dependencieshttps://issues.qgis.org/issues/19315?journal_id=934262018-09-25T11:18:10ZJürgen Fischerjef@norbit.de
<ul><li><strong>Subject</strong> changed from <i>QGIS 3.2 clean install misses many dependencies</i> to <i>QGIS 3.2 clean install misses many dependencies</i></li><li><strong>Status</strong> changed from <i>Feedback</i> to <i>Closed</i></li><li><strong>Resolution</strong> set to <i>worksforme</i></li></ul><p>Looks like an local issue to me.</p> QGIS Application - Bug report #19315: QGIS 3.2 clean install misses many dependencieshttps://issues.qgis.org/issues/19315?journal_id=934382018-09-25T12:08:18ZKim Frankcombekim@exploregeo.com.au
<ul></ul><p>For the benefit of anyone suffering from the same symptoms. Check the ownership of /usr/lib I can not be sure that this was the cause of this particular problem but I did notice that instead of being root:root it was local_user:local_user. At the time I though the user most likely responsible but over the next 3 months all of our four similarly configured systems had the same thing happen with mine being the second. I knew I had not changed the ownership so it has something to do with one of the packages we have installed. The final system to suffer the same problem only showed up last week so I'm at a loss to understand what it is that is is modifying the ownership. Either way if you see these symptoms check that all the key subdirectories of /usr are owned by root.</p>
<p>HTH<br />Kim</p>