Bug report #9552

Strange errors working with 10 digit real or integers

Added by magerlin - over 10 years ago. Updated over 10 years ago.

Status:Closed
Priority:High
Assignee:-
Category:-
Affected QGIS version:2.0.1 Regression?:No
Operating System:Win Easy fix?:No
Pull Request or Patch supplied:No Resolution:
Crashes QGIS or corrupts data:No Copied to github as #:18139

Description

When doing this calculation in field calculator on a shape file:

FromToStop = 100000 * From_stop + To_stop

results are sometimes negative even though From_stop and TO_stop are positive.

Error occurs both with integers and real numbers.

Directly writing a 10 digit number in an attribute in Field Calculater gives strange results too at least if the field is real 20.0:

Writing 1111111111 is OK but writing 2222222222 returns the value -2147483648 after saving.

See more here: http://osgeo-org.1560.x6.nabble.com/Error-in-simple-calculation-in-Field-Calculator-td5102486.html

I am using version 2.0.1 installed from OSGeo4W.

Test.zip - Test data (1.43 KB) magerlin -, 2014-02-13 12:37 AM

History

#1 Updated by magerlin - over 10 years ago

  • Status changed from Open to Closed

Also available in: Atom PDF