• Registered: 2010-06-26
  • Posts: 2

Topic: Floating point map output

I performed the Convert to Floating Point Map operation on a 24 bit color jpeg image 640 pixels x 427 pixels. Then I saved the resulting file as text. I opened the text file in Word and noticed that the values were delimited by a variable number of spaces. I replaced the spaces in between values with a single tab character per value and re-saved the file. I then opened the file in Excel. I do find 427 rows of data, but I find a variable number of columns of data, the maximum of which is 755, not the 676 I expected. Should I have done something different when replacing the spaces with tabs? Also, I notice that the values range from 0 to 255. Are these grayscale values or color values?
Thanks,
ffdavid

  • Registered: 2010-06-26
  • Posts: 2

Re: Floating point map output

My mistake on the first question - I didn't do the substitution of tabs correctly. But I still don't quite know what I am seeing when I see a number like 39.6666666666666.

  • admin
  • Administrator
  • Offline
  • From: Denmark
  • Registered: 2003-09-17
  • Posts: 947

Re: Floating point map output

The values are grayscale values converted from your original color image, so if a 24bit RGB  pixel has a value like r=39, g=40, b=40 then the grayscale value will end up between 39 and 40. I must say that I don't remember exactly how the algorithm was done but I assume that this is what happens.
You might also see values like 39.9999999999999999 but that is because some integer values cannot be represented exactly as floating point values.

Michael Vinther

> software developer <

admin's Website