Bug report #60
digitizing shapefile: REAL values are not stored properly
| Status: | Closed | ||
|---|---|---|---|
| Priority: | Low | ||
| Assignee: |  Marco Hugentobler | ||
| Category: | Digitising | ||
| Affected QGIS version: | Regression?: | No | |
| Operating System: | Debian | Easy fix?: | No |
| Pull Request or Patch supplied: | Resolution: | fixed | |
| Crashes QGIS or corrupts data: | Copied to github as #: | 10119 |
Description
1. start a new shapefile
2. add a REAL column
3. draw line, put 100.1 into table
4. stop editing, query the line
5. you see that 100.099999999999994 is stored instead of 100.1
Maciek
History
#1
Updated by Gary Sherman almost 18 years ago
Confirmed
#2
Updated by Marco Hugentobler almost 18 years ago
- Resolution set to fixed
- Status changed from Open to Closed
This has to do with the formatting width and precision of the OFTReal field. For 0.8, i hardcoded this to a width of 32 characters and a precision of 3 digits behind the dot. For the long term it would be good to make both a user option.
Tested against gdal-1.3.2
#3 Updated by Anonymous over 14 years ago
Milestone Version 0.8 deleted