Opened 18 years ago

Closed 18 years ago

Last modified 15 years ago

#60 closed bug (fixed)

digitizing shapefile: REAL values are not stored properly

Reported by: werchowyna@… Owned by: mhugent
Priority: major: does not work as expected Milestone:
Component: Digitising Version: Trunk
Keywords: Cc:
Must Fix for Release: No Platform: Debian
Platform Version: ubuntu breezy Awaiting user input: no

Description

  1. start a new shapefile
  1. add a REAL column
  1. draw line, put 100.1 into table
  1. stop editing, query the line
  1. you see that 100.099999999999994 is stored instead of 100.1

Maciek

Change History (4)

comment:1 by gsherman, 18 years ago

Owner: changed from gsherman to mhugent

Confirmed

comment:2 by mhugent, 18 years ago

Resolution: → fixed
Status: new → closed

This has to do with the formatting width and precision of the OFTReal field. For 0.8, i hardcoded this to a width of 32 characters and a precision of 3 digits behind the dot. For the long term it would be good to make both a user option.

Tested against gdal-1.3.2

comment:3 by anonymous, 17 years ago

Awaiting user input: unset
Must Fix for Release: → No

comment:4 by (none), 15 years ago

Milestone: Version 0.8

Milestone Version 0.8 deleted

Note: See TracTickets for help on using tickets.