Yahoo Groups archive

Datacolor User to User Support Group.

Index last updated: 2026-04-28 23:18 UTC

Thread

Profiling without calibration and monitor matching (newbie questions)

Profiling without calibration and monitor matching (newbie questions)

2008-02-13 by fluppeteer

Greetings, everyone. I'm new to the group, and fairly new to
colour management, so I'm hoping this isn't a FAQ, and that
the resident experts can help me.

I've had a GretagMacbeth i1Display2 for a while now. and it's
gone largely unused. The primary reason for this is that I've
struggled to get the software to do what I want (at least at
the time); I'm wondering whether I'd have more luck with a
Spyder.

I have a set-up with two monitors - one a high-resolution LCD
(T221) with a relatively limited gamut, and one a relatively cheap
and nasty (Iiyama) CRT with a better dynamic range. I'm using XP,
and (for lack of need to have upgraded) the original version of
Adobe CS - mostly Photoshop, with a bit of InDesign thrown in.
My output is currently an elderly Epson Photo printer, of a
vintage from the last millennium, and this may eventually get
an upgrade. I don't do anything commercial with any of this;
it's all for personal photo printing and the occasional club
magazine.

The first thing I should say is that I pretty much couldn't
care less about how the screen looks in non-colour managed
applications (if I want to watch video and care about the cinema
experience, I'll use my TV). All I care about is whether I can
get a document to look right on screen (compared with what the
software thinks the colours are), and getting printed output
in the right ball-park (so far achieved, poorly, solely through
Epson's default drivers).

Regarding the LCD, I would like to set it to an appropriate
brightness (the only control I have), and then produce a profile
for it. Where I fell down with the i1Photo was that the Gretag
software insisted on trying to calibrate the screen first - and
by "calibrate", they meant "mangle the graphics card LUTs". This
is perfectly sensible behaviour for a CRT, driven from 10-bit
LUTs on the graphics card, where sensibly-spaced samples are
useful. For a DVI connection with 8 bits per channel on the
screen and 8 bits in the display, anything other than a 1:1
mapping can do nothing but harm.

So, question number one: Can I use a Spyder to produce a
Photoshop-friendly profile without touching the graphics card
LUTs? Gretag described this as an "advanced feature" when I
last spoke to them, but it seems a logically obvious thing to
want to do (use a colour-managed application with an LCD? how
dare I...)

Secondly, as mentioned, I used two monitors, with different
gamuts. This leads me to two scenarios:

a) The file I'm processing is fully contained within the smaller
gamut of the LCD. In this case, it would be useful for the CRT
and the LCD to match (i.e. the CRT should, as much as possible
for in-channel mapping, be calibrated using the graphics card
LUTs - because I don't want to keep fiddling with it manually -
to match the LCD, and I should be able to use the profile from
the LCD). Or...

b) The file I'm processing needs the expanded gamut of the CRT,
and I should use the CRT's profile with it calibrated to use
as large a gamut as possible (which at least means that the
limits of the RGB LUTs should be at full range, no matter what
this says for the intervening values and the native white point).
It would be nice to be able to apply some profile which would
keep the LCD correct except for the clipped colours, but I
appreciate that XP's CMS doesn't support doing that, so under
these circumstances I'm going to have to accept that the LCD
won't be "right".

I'm assuming that I'd have to switch between the scenarios
manually - I'm not expecting a Photoshop plug-in to automate
the process!

Question two: any chance of this being easy/possible to set up?

Any help would be welcome. My photos have looked a bit off
for far too long.

Thanks in advance, and I hope my questions make a basic kind
of sense,

-- 
Fluppeteer

Re: [colorvision_group] Profiling without calibration and monitor matching (newbie questions)

2008-02-13 by CDTobie@aol.com

In a message dated 2/13/08 4:38:24 PM, yahoo@... writes:


> So, question number one: Can I use a Spyder to produce a
> Photoshop-friendly profile without touching the graphics card
> LUTs? Gretag described this as an "advanced feature" when I
> last spoke to them, but it seems a logically obvious thing to
> want to do (use a colour-managed application with an LCD? how
> dare I...)
> 
You seem to want to get under the hood and soup up your car before you even 
try driving it. Making LUT-less profiles is NOT standard fare, not even a very 
good idea, and certainly NOT what you should be doing first,   though for some 
reason it seems to you like the obvious thing to do. The color ramps of an 
LCD are not nice smooth gamma shaped curves like those on a CRT; they need some 
pretty significant LUT adjustments to neutralize and match them channel to 
channel. Not doing that, and asking Photoshop to fix it all for you on the fly, 
to that very nonlinear, misbalanced screen is just not reasonable. Thats why 
neither of the major monitor calibration companies are recommending it to you.

> 
> Secondly, as mentioned, I used two monitors, with different
> gamuts. 
> 
Not only that, you use two different TYPES of monitors, which require rather 
different viewing conditions, and which should not be used side by side, or 
frankly even in the same room. You also describe one of them as nasty... you 
should get the best displays you can afford, and work from there, rather than 
work with nasty stuff...

> This leads me to two scenarios:
> 
> a) The file I'm processing is fully contained within the smaller
> gamut of the LCD. In this case, it would be useful for the CRT
> and the LCD to match (i.e. the CRT should, as much as possible
> for in-channel mapping, be calibrated using the graphics card
> LUTs - because I don't want to keep fiddling with it manually -
> to match the LCD, and I should be able to use the profile from
> the LCD). Or...
> 
> b) The file I'm processing needs the expanded gamut of the CRT,
> and I should use the CRT's profile with it calibrated to use
> as large a gamut as possible (which at least means that the
> limits of the RGB LUTs should be at full range, no matter what
> this says for the intervening values and the native white point).
> It would be nice to be able to apply some profile which would
> keep the LCD correct except for the clipped colours, but I
> appreciate that XP's CMS doesn't support doing that, so under
> these circumstances I'm going to have to accept that the LCD
> won't be "right".
> 
You are working way too hard at this. Just profile both displays (with LUT 
corrections, please) and if you don't quite trust the most saturated colors on 
one, then use Photoshop's Gamut Limit tool to check which colors in it are out 
of gamut... you won't need to do this often to figure out what colors are not 
going to be quite as satuated as they should be on that screen. And don't 
assume (until you do a 3d gamut comparison) that the LCD is notably smaller than 
the CRT, it may not be that much different, in fact it may be larger in some 
areas.
> 
> I'm assuming that I'd have to switch between the scenarios
> manually - I'm not expecting a Photoshop plug-in to automate
> the process!
> 
> You don't need to switch between anything, just use your display profiles for 
each display. The two will match, where they can match, and top out where 
they top out. There is no manual switching or manipulation needed. But you will 
need to use appropriate ambient light for both, and appropriate white lumiance 
for each. You won't get a side by side match unless you set both to the same 
white luminance, and have reasonably similar black points (thus dynamic ranges) 
on each, and thats not likely to happen with one LCD and one CRT.

C. David Tobie
WW Product Technology Manager
Digital Imaging & Home Theater
Datacolor Inc.
CDTobie@...
www.datacolor.com/spyder3


**************
The year's hottest artists on the red 
carpet at the Grammy Awards. Go to AOL Music.
      
(http://music.aol.com/grammys?NCID=aolcmp00300000002565)

Re: Profiling without calibration and monitor matching (newbie questions)

2008-02-14 by fluppeteer

Thanks for getting back to me, David. I'm going to sound
argumentative here not because I'm disagreeing with you,
just because I'm trying to understand where there's a flaw
in my logic; I hope you'll take it in the manner intended...

--- In colorvision_group@yahoogroups.com, CDTobie@... wrote:
>
> In a message dated 2/13/08 4:38:24 PM, yahoo@... writes:
>  
> > So, question number one: Can I use a Spyder to produce a
> > Photoshop-friendly profile without touching the graphics card
> > LUTs? Gretag described this as an "advanced feature" when I
> > last spoke to them, but it seems a logically obvious thing to
> > want to do (use a colour-managed application with an LCD? how
> > dare I...)
> 
> You seem to want to get under the hood and soup up your car before
you even 
> try driving it.

:-) I'm a software engineer. My approach to getting colour
management on my computer was to read the ICC profile spec.,
boggle that "perceptual intent" appears to mean "do whatever
you like", and then try to find products which use the profile
to do what I want. I'm more like a taxi customer that's looked
up a route on Google Maps in advance, and wonders why the taxi
seems to be taking a non-obvious route - I'm prepared to believe
that the difference from what I expected is sensible, but I'd
still like it explained to me so that I know I'm not being, er,
taken for a ride.

> Making LUT-less profiles is NOT standard fare, not even a very 
> good idea, and certainly NOT what you should be doing first,  
though for some 
> reason it seems to you like the obvious thing to do. The color ramps
of an 
> LCD are not nice smooth gamma shaped curves like those on a CRT;
they need some 
> pretty significant LUT adjustments to neutralize and match them
channel to 
> channel. Not doing that, and asking Photoshop to fix it all for you
on the fly, 
> to that very nonlinear, misbalanced screen is just not reasonable.
Thats why 
> neither of the major monitor calibration companies are recommending
it to you.

Hmm. Okay, two issues here. As a starting point, I should say
that I completely accept that the LCD colour ramps are going to
be all over the shop, and that I expect them to need to be
corrected. I'm just going to argue that the LUT is not the place
to do it. Please forgive the long explanation - I'm just trying
to be clear.

1) The LUT is, for your average DVI connection (excluding
dithering, ignoring NEC's dual-link high colour displays,
assuming the LUT is going into the graphics card and not any
internal LUT in the display, and ignoring high colour depth
HDMI/DisplayPort), a mapping from 256 shades of red to another
256 shades of red, from 256 shades of green to another 256
shades of green, and 256 shades of blue to another 256 shades
of blue.

This isn't true for a CRT - most graphics cards have 10-bit
DACs. In this case, it's completely sensible to get the best
colour reproduction possible by trying to space out the
representable colours nice and evenly, and being able to
represent 1024 shades of each colour means that the samples
can be jiggled around usefully.

For DVI, with only 256 shades of each colour, doing anything
other than a direct 1:1 mapping of each colour shade (or,
admittedly, a permutation - but a LUT with an inflection point
would only be useful for a *really* broken monitor) cannot
improve the position of the possible representable colours;
all it can do is remove possible representable colours from
the "list", by mapping more than one frame buffer value to
the same DVI output and correspondingly leaving some possible
DVI outputs unreachable.

For non-colour-managed applications, this might still be a
good thing: if the application puts 128,128,128 in a frame
buffer, it's more important that you get mid grey out than
that colours 200,200,200 and 201,201,201 happen to come out
the same on the monitor.

For a colour-managed application, which knows which colour
it wants to represent and finds out which colour it should
be putting into the frame buffer to get it, it doesn't matter
whether 128,128,128 or 72,51,93 is mid-grey, because it can
find this out and put the right value in the frame buffer
regardless. It *does* matter if 200,200,200 and 201,201,201
are the same, because it would only use one of the two values
anyway; the fact that the two are the same implies that there's
a gap somewhere which represents a unique colour that the monitor
can display, and which cannot now be produced by any possible
value placed in the frame buffer. There has been no improvement
in the range of colours that can be displayed, and the actual
number of displayable colours has been reduced.

Because of the 10-bit DACs, this isn't an issue for CRTs, and
the LUT turns an unevenly-spaced set of 256 colours on each
channel into a more-evenly-spaced different set of 256 colours,
which are more useful for creating a smooth profile. Over DVI,
the LUT turns an unevenly-spaced set of 256 colours into a
more-evenly spaced set of fewer-than-256 colours, all of which
were already present before the LUT was set up. The CMS will
already pick whichever colour most closely matches what it
needs, so (assuming the application is colour managed) the
evenness of the colours is irrelevant, but whether a given
colour can be represented at all *is* relevant. It might be
nicer to have more colours where the LCD doesn't provide them
(which is why the 10-bit LUT helps a CRT), but given that this
isn't an option, using all the colours that *are* available is
better than not doing so.

FWIW, I'd have exactly the same objections to changing the
LUT on a CRT if the application were using a 30-bit display
mode - but these modes are very rarely used. It's possible
that, for an extreme correction, even a 10-bit LUT will
alias two frame buffer values to the same output, but it's
not guaranteed in the way that it is for an 8-bit to 8-bit
mapping.

Given that, and given my assertion that I only care about
the colour quality from applications which use a CMS, why
is it so odd not to want to change the LUT? (Or, to put it
another way, why *would* you want to change it?)

2) Regarding asking Photoshop to fix the display... but
Photoshop internally represents the image in the colour
space chosen for that file. When displaying, it uses the
CMS to map from the internal representation, through the
profile, to the values that it needs to put into the frame
buffer for final display on the monitor.

I appreciate that there are various possible formats for
profiles, and that the variants which rely on 1-D LUTs
and matrix transforms can't represent an arbitrary
nonlinearity. However, the graphics card LUTs are also
only 1-D, and correspond exactly to the "B" and "M"
curves in section 0.5 of the ICC profile specification
- every possible profile representation can do this,
unless I'm completely misinterpreting it.

My understanding is that calibrating a display is about
controlling what colours the monitor displays for given
frame buffer contents, and that profiling a display is
about *determining* what colours a monitor displays for
a given frame buffer contents. A CMS-aware application
should then be able to use the profile to decide what
value to put in the frame buffer in order to get what
it wants. So long as the profile is accurate, calibration
can change the range of colours that the profile can be
used to create (if you calibrate the monitor to a higher
brightness, you can represent brighter colours; if a CRT's
LUT is calibrated to produce more evenly-spaced shades
then the profile has a more evenly-spaced range of colours
from which to pick), but - especially if the application
tries to dither between representable colours in the way
that Photoshop (I'm told) does - the profile is what
determines how a given in-gamut colour is displayed.

Given my objections to reducing the abilities of my monitor
by altering the LUT, why is there a problem in representing
the equivalent attempt to linearise the display in the
profile? I thought that was (partly) what the profile is
*for*!


I appreciate that some people using a colorimetry solution
will be wanting non-colour-managed applications (especially
video) to look better, and that changing the LUT is, for
them, important. However, it seems to me that there should
be a substantial subset of the owners of colorimeters who
want the best output of colour-managed applications, at the
cost of non-CMS-aware apps not producing the right colours.
I don't understand why changing the LUT (for an LCD) can ever
be useful for this subset of people, and therefore why it's
such an obscure thing to ask about.

I'll be completely happy to be wrong about this, and live
with what products can actually do, but not being able to
understand why the available products seem to be "doing it
wrong" is bugging me. :-)

> > Secondly, as mentioned, I used two monitors, with different
> > gamuts. 
>
> Not only that, you use two different TYPES of monitors, which
require rather 
> different viewing conditions, and which should not be used side by
side, or 
> frankly even in the same room.

Said like a true colour professional! I'd love to have a
room full of CG221s. I have what I have, pending any visits to
eBay; I accept that they're not going to match perfectly, and
that I can only rely on one of them at a time for trying to
get nominally correct colours. I can turn one of them off (or
block it from view) when I want to get an exact tone right.
However, for more general photo editing, it would be nice if
they weren't the million miles apart that they currently are,
and that I could make use of the combined screen real-estate
with only subtle colour differences.

> You also describe one of them as nasty... you 
> should get the best displays you can afford, and work from there,
rather than 
> work with nasty stuff...

:-) I might have over-stated my situation. The CRT is a half-
decent Iiyama 19" panel (VisionMaster Pro 454, AKA HM903DT),
chosen because (by that time, when CRTs started to be phased
out) it was pretty much all I could find which can be talked
into 2048x1536 for that money. Previous attempts at calibrating
it suggest that the green gun can't be set low enough, relative
to red and blue. It also crashes occasionally. It was a $400
monitor some years ago; not the shoddy 17" Dells sitting on my
desk at work, which can't even do SXGA properly and have a minimum
black level that's not black even in daylight, but no GDM-900FW
either.

My LCD's a T221, which means it's got a 2001-vintage panel
and correspondingly dubious gamut. I'll gladly swap for any
panel with similar (3840x2400) resolution which covers Adobe
RGB. Oh, wait...

It's not a colour professional's set-up, is what I was trying
to say (I'm an amateur photographer with an academic interest
in colorimetry, and a vague desire to be able to print photos ok
in fewer attempts). Even were I to add a modern LCD with a better
gamut, to replace the CRT, it's not likely to match the existing
LCD very well, and there is simply no alternative to the T221.

> > This leads me to two scenarios:
> > 
> > a) The file I'm processing is fully contained within the smaller
> > gamut of the LCD. In this case, it would be useful for the CRT
> > and the LCD to match (i.e. the CRT should, as much as possible
> > for in-channel mapping, be calibrated using the graphics card
> > LUTs - because I don't want to keep fiddling with it manually -
> > to match the LCD, and I should be able to use the profile from
> > the LCD). Or...
> > 
> > b) The file I'm processing needs the expanded gamut of the CRT,
> > and I should use the CRT's profile with it calibrated to use
> > as large a gamut as possible (which at least means that the
> > limits of the RGB LUTs should be at full range, no matter what
> > this says for the intervening values and the native white point).
> > It would be nice to be able to apply some profile which would
> > keep the LCD correct except for the clipped colours, but I
> > appreciate that XP's CMS doesn't support doing that, so under
> > these circumstances I'm going to have to accept that the LCD
> > won't be "right".
>
> You are working way too hard at this.

:-) *That* I'm quite prepared to believe.

> Just profile both displays (with LUT 
> corrections, please) and if you don't quite trust the most saturated
colors on 
> one, then use Photoshop's Gamut Limit tool to check which colors in
it are out 
> of gamut... you won't need to do this often to figure out what
colors are not 
> going to be quite as satuated as they should be on that screen.

I'm a little confused, I think for the same reason as below:
I'm talking about running two displays on the same computer,
and unless something's changed about XP while I wasn't looking,
although I can fiddle with the LUTs for the monitors independently,
I can only have one active profile at a time.

> And don't 
> assume (until you do a 3d gamut comparison) that the LCD is notably
smaller than 
> the CRT, it may not be that much different, in fact it may be larger
in some 
> areas.

Good point. The LCD predates the time when LCDs suddenly got
better with the colour blue (having found, I believe, a new
filter material), and it's certainly not got an ideal black
level, but it might still have some colour within range that
the CRT doesn't. However, there are certainly colours which
the CRT can handle and the LCD can't, so I still need to be
able to pick and choose.

> > I'm assuming that I'd have to switch between the scenarios
> > manually - I'm not expecting a Photoshop plug-in to automate
> > the process!
>
> You don't need to switch between anything, just use your display
profiles for 
> each display. The two will match, where they can match, and top out
where 
> they top out. There is no manual switching or manipulation needed.

? XP. Two displays, one machine. One profile at a time, no?
(Otherwise dragging a window from one screen to another would
require more than a copy blit.) I understand that Apple and/or
Vista might do a better job of this. If there's a way to tell
Photoshop to render different pixel values into the frame
buffer for each output, my situation is, indeed, simplified.

I'm not sure whether I'm missing something, or whether I've
failed to explain myself. In case it's the latter, I'll
have another go, and try to be brief:

Scenario a: The image fits within the gamut of the LCD. I
can use the LCD's profile (preferably *without* changing
its LUT entries, for reasons explained earlier). In order
to look vaguely like the LCD, the CRT's LUTs can be tuned
to map the frame buffer contents for a given colour on the
LCD to a similar colour on the CRT. There may be colours
outside the CRT's gamut (but probably not many), and,
because it's only a 1-D mapping (red to red, etc.), it
won't compensate fully for the differences between the
phosphors and the colour filters (the CRT's "red" may be,
e.g., more yellow than the LCD's, and there may be bleeding
between the colours).

However, it'll be better than nothing, it *will* be able to
compensate for the nonlinearity of the LCD's voltage/luminance
curves, and it can obviously map the white/black points to
match (gamut permitting). A Photoshop window on the LCD will
be "correct", and dragging it to the CRT will be near enough
that it's not distracting to make use of the combined screen
real-estate. I'm not too concerned with using the CRT's LUTs
in this way because they'll have 10-bit accuracy, which should
be enough to avoid aliasing even after severe abuse of the
gamut. I don't want to adjust the CRT manually, however, since
this would require manual recalibration every time; loading
the LUTs is a level of inconvenience with which I can cope.

Scenario b: The image is out-of-gamut on the LCD, but in-gamut
on the (native gamut of the) CRT. Here, I use the CRT's
profile, with an appropriate LUT setting for it that gives
the best profiling (full range, evenly-spaced samples).
I have a choice when it comes to the LCD: either accept that
the colours on it are wrong, and keep a 1:1 LUT mapping, or
set up a mapping which approximately match the CRT for colours
inside its gamut, and clamp the end-of-range LUT entries. This
particularly has the disadvantage that it'll make the GUI look
odd (unless I fiddle with a lot of settings to move every GUI
colour in-gamut), but the illusion of one continuous monitor
would be better - although, again, the match won't be perfect.
It also, obviously, messes up the display on the LCD, for all
the reasons I argued against LUT mangling for DVI - but since
the LCD is already incapable of displaying the image properly,
I'm prepared to accept it for the unusual scenario of images
with extreme colours (I'm not Ken Rockwell, my cameras have
normal saturation settings).

I could get a better match to the LCD by tuning the CRT at
calibration time. I specifically don't want to do this: part
of the reason for having the CRT in the first place is that
it's a cheap way to achieve a better gamut than the LCD can
provide. It's within my levels of competence to make sure
I'm looking at the right monitor if I'm fine-tuning a colour
against a print-out. Most of the time, I just like having
the screen space to see what I'm doing while I'm editing,
and not having the differences distractingly huge would be
nice.

It would be better to have both monitors producing their
best output (appropriately-calibrated CRT, 1:1 LUT on the
LCD at an appropriate brightness) with correct and
independent profiles. I don't believe this is possible
under XP, which is why I'm talking about trying to have
two lots of optional profiles and trying to get two
completely different monitors to match (and understanding
that they won't, perfectly). I'm happy to be wrong, and
to find out that they can both be profiled independently
and concurrently. Otherwise, I appreciate that trying to
have multiple optional profiles on multiple monitors could
be considered as an "advanced feature".

> But you will 
> need to use appropriate ambient light for both, and appropriate
white lumiance 
> for each. You won't get a side by side match unless you set both to
the same 
> white luminance, and have reasonably similar black points (thus
dynamic ranges) 
> on each, and thats not likely to happen with one LCD and one CRT.

Understood. It ought to be possible for the CRT's LUTs to
match the white point of the LCD (it usually runs brighter),
and for the black points to be similarly matched; I *do* have
control over the ambient light conditions (i.e. heavy curtains).
Whether I can talk the colorimetry software into producing the
appropriate LUTs for me might be another matter.

I may be spoilt by looking at how the profiling works, and
then trying to abstract from that to what I want it to do;
I work in computer graphics, so unfortunately theory tends to
be my starting point for anything like this (this is nothing
compared with the arguments I have with TV salesmen who try
to tell me that 1366x768 is a sensible HDTV resolutions).
It may be that if I'd started with an existing colorimetry
solution, rather than trying to do my research before I
bought, I might not be frustrated with what ought to be
possible, but apparently isn't.

Thanks again for your help, and for that of anyone who cares
to chime in and tell me exactly where I'm being an idiot.

-- 
Fluppeteer

Re: [colorvision_group] Re: Profiling without calibration and monitor matching (newbie questions)

2008-02-14 by CDTobie@aol.com


In a message dated 2/14/08 11:55:18 AM, yahoo@... writes:


Thanks for getting back to me, David. I'm going to sound
argumentative here not because I'm disagreeing with you,
just because I'm trying to understand where there's a flaw
in my logic; I hope you'll take it in the manner intended...


No, it was me that started sounding argumentative (I'm in the aftermath of a major icestorm, no electricity at home, up all night feeding the woodstove, etc... ). But I really can't teach an entire course in color management theory via email for an interested programmer, so I will decline to answer your long list of theoretical questions here. Sorry. Reading the ICC spec, and attempting to learn color management from first principles is an admirable thing, its just unrelated to end user usage of commercial color management programs. Besides, if I attempt to answer your questions here, it will only create a second, then a third generation of theoretical questions.

Let me give you a couple hints: display profiles do not use rendering intents, that is restricted to output profiles. And one more: data going to displays from Mac or Windows videocards is eight bit per channel, so there is no magic way to make adjustments without levels losses except in the display.

C. David Tobie
WW Product Technology Manager
Digital Imaging & Home Theater
Datacolor
CDTobie@...
www.datacolor.com/Spyder3



**************
The year's hottest artists on the red carpet at the Grammy Awards. Go to AOL Music.
(http://music.aol.com/grammys?NCID=aolcmp00300000002565)

Re: Profiling without calibration and monitor matching (newbie questions)

2008-02-14 by fluppeteer

--- In colorvision_group@yahoogroups.com, CDTobie@... wrote:
> In a message dated 2/14/08 11:55:18 AM, yahoo@... writes:
> > Thanks for getting back to me, David. I'm going to sound
> > argumentative here not because I'm disagreeing with you,
> > just because I'm trying to understand where there's a flaw
> > in my logic; I hope you'll take it in the manner intended...
> 
> No, it was me that started sounding argumentative (I'm in the
aftermath of a 
> major icestorm, no electricity at home, up all night feeding the
woodstove, 
> etc... ).

Ouch. (And I certainly didn't think you were being argumentative,
don't worry.) I hope reading through frustrating questions at
least keeps you warm!

> But I really can't teach an entire course in color management theory 
> via email for an interested programmer, so I will decline to answer
your long 
> list of theoretical questions here. Sorry.

:-) No problem; thank you for humouring me as much as you have.

> Reading the ICC spec, and attempting 
> to learn color management from first principles is an admirable
thing, its 
> just unrelated to end user usage of commercial color management
programs.

(In my defence, I've also read a couple of books on the
subject and tried some web research, but I remain confused.)

> Besides, if I attempt to answer your questions here, it will only
create a second, 
> then a third generation of theoretical questions.

Yes, you're probably right; I'm terminally curious. I
have a clear mental model of colour management, but it's
apparently not the correct one!

> Let me give you a couple hints: display profiles do not use rendering 
> intents, that is restricted to output profiles.

Yes, this is one of the things that bothers me. Other than
that they're emissive, I don't see what's special about
displays: the question of what to do with an out-of-gamut
source is just as valid. I fail to see how a monitor under
a fixed set of viewing conditions differs from printed
output viewed under a fixed set of conditions, even if the
monitor's set of conditions has to include a restriction
on ambient light and the printed output's conditions has
to include a specific light level and spectrum. Saying that
metamerism means you can't *always* match perfectly is all
very well, but I get the impression that *never* matching
perfectly is for some reason an acceptable option, whereas
I'd view "perfect under a given set of viewing conditions"
as a good starting point. Just musing about my frustrations
with the ICC; I'm not expecting to be set right!

> And one more: data going to displays 
> from Mac or Windows videocards is eight bit per channel, so there is
no magic 
> way to make adjustments without levels losses except in the display.

Um, this is kind of my point. You can't do it in the LUT,
which is why fiddling with the LUT is a bad idea. It certainly
won't help, assuming the CMS is already picking unique colours
out of the profile, and as such insisting on adjusting the LUT
before generating a profile seems arbitrarily unconstructive.
A CRT *does* have more than eight bits per channel being
output (only 256 possible values, but selected out of 1024
in the look-up table for a 10-bit DAC), so what makes no sense
for an LCD *does* make sense for a CRT.

However, you *can* do it in the CMS before the 8 bits per
channel are put in the frame buffer, which ought to be
performing the colour transformations specified by the
(display) profile in, I hope, more than 8 bits of accuracy,
given that it's being fed 16 bits per channel by Photoshop.
If the CMS and/or profile are really only working in 8 bits
per channel, I'm underwhelmed and surprised. (It's true that
this would be a moot point if I only had 8 bits per channel
in the image colour space. I never do: I'm far too keen on
sorting out the exposure after the event, and always shoot
raw; even with JPEG, I'd still work with 16bpp as an
intermediate step.)

If the source image contains colours which can be represented
by the monitor, it should be possible to select that colour
by putting the corresponding value in the frame buffer. Whether
these colours are distributed evenly, and therefore would work
for an application that's not using the profile/CMS to decide
which values to put in the buffer in the first place, shouldn't
be a factor.

Sorry - I'm not meaning to drag this out, I'm just surprised
that there isn't a simple explanation for where I'm going
wrong! It may be my failure to communicate.

Thanks for listening (and, in advance, for anyone who has
more spare time and the willingness to put me out of my
misery).

-- 
Fluppeteer

Re: [colorvision_group] Re: Profiling without calibration and monitor matching (newbie questions)

2008-02-14 by CDTobie@aol.com


In a message dated 2/14/08 2:42:11 PM, yahoo@... writes:


However, you *can* do it in the CMS before the 8 bits per
channel are put in the frame buffer, which ought to be
performing the colour transformations specified by the
(display) profile in, I hope, more than 8 bits of accuracy,
given that it's being fed 16 bits per channel by Photoshop.
If the CMS and/or profile are really only working in 8 bits
per channel, I'm underwhelmed and surprised. (It's true that
this would be a moot point if I only had 8 bits per channel
in the image colour space. I never do: I'm far too keen on
sorting out the exposure after the event, and always shoot
raw; even with JPEG, I'd still work with 16bpp as an
intermediate step.)


Calcs can be done in a larger space, but when all is said and done, you are sending 8 bits per channel to the videocard, and from there to the display. No highbit pipeline yet. However, some printer export modules and RIPs offer a highbit pipeline, and I don't find it to improve prints, so I'm not hanging my hopes on magic from a highbit pipeline to displays (if and when it comes). But its great for corrections, even if the actual pipeline is only 8 bits/channel. Thats why loading the same LUT tables to the display, instead of the videocard, can smooth the visible result onscreen, to some degree. But only if you are asking for fairly radical corrections in the LUT, like shifting the entire gamma significantly... and its only an on-screen thing, it doesn't effect the files, or the prints, just the screen preview.

C. David Tobie
WW Product Technology Manager
Digital Imaging & Home Theater
Datacolor
CDTobie@datacolor.com
www.datacolor.com/Spyder3



**************
The year's hottest artists on the red carpet at the Grammy Awards. Go to AOL Music.
(http://music.aol.com/grammys?NCID=aolcmp00300000002565)

Re: Profiling without calibration and monitor matching (newbie questions)

2008-02-16 by fluppeteer

> Calcs can be done in a larger space, but when all is said and done,
you are 
> sending 8 bits per channel to the videocard, and from there to the
display. No 
> highbit pipeline yet. However, some printer export modules and RIPs
offer a 
> highbit pipeline, and I don't find it to improve prints, so I'm not
hanging my 
> hopes on magic from a highbit pipeline to displays (if and when it
comes). But 
> its great for corrections, even if the actual pipeline is only 8
bits/channel. 
> Thats why loading the same LUT tables to the display, instead of the 
> videocard, can smooth the visible result onscreen, to some degree.
But only if you are 
> asking for fairly radical corrections in the LUT, like shifting the
entire 
> gamma significantly... and its only an on-screen thing, it doesn't
effect the 
> files, or the prints, just the screen preview.

Sorry to keep banging on about this, but I still think we have
crossed wires here. I'm going to have another go at making my
point, with a simplified (if extended) example, and put a big
disclaimer here to anyone who stumbles across this thread out of
context: my understanding of colour management is likely to be
flawed, and I present the following so that its errors can be
pointed out to me by anyone with the patience, not because it's
gospel. David: I'm very grateful for your assistance, and I'll
understand if you feel you've done your duty regarding me
(especially given your climatic conditions) and want to leave it
for someone else with the patience to unconfuse me, but I'll be
most grateful if you have time to tell me where I'm going wrong.

Are you sitting comfortably? Then I'll begin.

Let's say we have a hypothetical two-bit display, on which we'd
like to display evenly-distributed greys between 0 (our black
point) and 1 (our white point); that is, we'd like our four possible
frame buffer values to be:

(bit pattern -> intensity)
00 -> 0.0
01 -> 1/3
10 -> 2/3
11 -> 1.0

[I realise the definition of "evenly-distributed" sweeps a can
of worms under the carpet. This is irrelevant for the purposes
of this hypothetical discussion.]

Now, say our actual monitor isn't nicely linear, like this. The
actual intensity it outputs when fed the four frame buffer values
are:

00 -> 0.0
01 -> 0.1
10 -> 0.35
11 -> 1.0

(Note that our end points are correct - we've done our best to
set the white and black levels. We know the values from our
attempt to profile/calibrate the monitor.)

A colour editing application which doesn't know about colour
management will place bit patterns "00", "01", "10" and "11" in
the frame buffer and magically expect them to map to "0", "1/3",
"2/3" and "1" respectively. We can't make this happen, but if
there's a look-up table on the graphics card, we can map each of
the frame buffer values to the nearest possible colour that the
monitor can display. In this case, we end up with the following
look-up table:

00 -> 00 -> 0.0 (= 0)
01 -> 10 -> 0.35 (the nearest match to 1/3)
10 -> 10 -> 0.35 (the nearest match to 2/3, just)
11 -> 11 -> 1.0 (= 1)

Now an application trying to get 1/3 and 2/3 by putting 01 and
10 in the display will get the best approximation that our
display can manage.

However, there are two obvious disadvantages to having done
this:

1) It may matter more to the display that bit patterns 01 and 10
are different than what exactly they map to. This is likely to
be the case for GUI features with subtle shading, and for a less
hypothetical display, it's most likely to be a problem where the
display's gamut is clipped and a larger possible colour range are
all mapped to the same colour.

2) There is now no value that we can place into the frame buffer
in order to reproduce colour 0.1, which is a colour which the
display is perfectly capable of reproducing. Our four-colour
display has become a three-colour display.

If we look at an application which uses a colour management system,
it no longer puts a fixed value into the frame buffer, expecting
a fixed output. Instead, the application passes the colour it wants
to the CMS, which responds with the value which needs to be placed
into the frame buffer.

On a perfect (0, 1/3, 2/3, 1) display, if an application asks for
1/3, it will be told to place "01" in the frame buffer. For our
display, 0.35 is the best approximation to 1/3; the CMS will tell
the application to use a bit pattern which results in 0.35 if "1/3"
is asked for. If no look-up table is used, and our possible frame
buffer values map to 0, 0.1, 0.35 and 1, the CMS will tell the
application to use "10", which corresponds to 0.35. If the
graphics card LUT is in use, the CMS could tell the application to
use either "01" or "10", since they both result in the same output.

If the application asks for colour "2/3", there's only so much
that our display can do. The CMS will return the best colour match
that it can produce, which is a bit pattern that corresponds to
0.35 whether the LUT is in use or not (the LUT has done nothing
to improve matters).

If the application wants to display "1/6", there's a difference.
Without the look-up table, the best approximation to "1/6" that
the display can reproduce is 0.1; the CMS will return the bit
pattern that produces this (01). With the look-up table, we no
longer have a bit pattern which can produce 0.1, and our best
match to "1/6" is "0".

While the error in approximating "1/6" as 0 is less than the error
in trying to produce "2/3" and getting 0.35, the LUT still reduces
the ability of the display to reproduce colours accurately across
*some* of its gamut. While the LUT has not made the worst errors
in reproduction any worse in this case, it has still had a
detrimental effect on the display.


To extend the analogy, let's see what happens if our graphics
card LUT has an extra bit of output quality (as with the extra
two bits from a CRT being driven from a 10-bit DAC via an 8-bit
-per-channel frame buffer, or a high-bit-depth digital link
such as dual-link DVI, HDMI, or DisplayPort). Let's say the
eight possible colours from our three bits of output now map
to:

000 -> 0.0
001 -> 0.04
010 -> 0.1
011 -> 0.17
100 -> 0.25
101 -> 0.35
110 -> 0.6
111 -> 1.0

Before we update the look-up table, it contains:

00 -> 000 = 0.0
01 -> 010 = 0.1
10 -> 101 = 0.35
11 -> 111 = 1.0

In calibrating the monitor, we can set up the look-up table to
produce a better approximation to 0, 1/3, 2/3, 0:

00 -> 000 = 0.0
01 -> 101 = 0.35
10 -> 110 = 0.6
11 -> 111 = 1.0

In addition to making non-colour-managed applications produce
better colour, this *does* help with a colour-managed app. We've
lost the ability to display 0.1, but - rather than gaining a
duplicate value mapped to 0.35 - this time we've gained a new
colour, "0.6". While we'll lose a small amount of accuracy in
reproducing colour in the 0.05 to 0.225 (the range of colours
nearer to 0.1 than anything else available), the much larger
range from 0.475 to 0.8 is now more accurately represented
by the new colour. So setting the LUT on a CRT is a good thing,
but only (from the point of view of CMS-aware apps) because
previously-unavailable colours are added which are more useful
in filling "gaps" in the colour space than the unmodified range
of colours that we can reach.

Note that I'm assuming that a colour-managed app is capable of
asking for a colour such as "1/6", even though the frame buffer
has less accuracy than this. I don't see a problem with that:
firstly, Photoshop (et al.) can work with 16-bit internal
representations of documents. Secondly, in general the document
colour space won't have values which line up nicely to values
which the monitor can display (unless the document colour space
*is* the monitor colour space); even if the document only had
four shades of grey, there's every chance that one of them
could be best represented by "0.1".

I've over-simplified the job of the CMS here; in reality, it's
likely that an application would use the nearest colours that
the monitor can display, and dither between them to produce
a better approximation to the desired colour. Nonetheless, it
helps for as many of the monitor's available colours to be
available as possible. ATI's AVIVO cards can take a 10-bit
LUT and dither the output over DVI to approximate more than
the native 256 colours, but this dithering clashes with the
dithering performed in the CMS; it's better to maximise the
number of colours which can appear in any single pixel, and
for your average 8-bit-per-channel LCD and DVI connection,
that's best achieved by leaving the LUT alone. (Monitors with
internal look-up tables may or may not be able to do better,
depending on whether they also produce more colours through
spatial dithering.)

Obviously the deletion of a few closely-spaced colours is less
of a problem when 256 colours are reduced to (say) 248 than
when 4 are reduced to 3. Nonetheless, the argument holds that
the display has lost the ability to reproduce some colours
as accurately as it initially could. Additionally, although
the colours may be more accurately positioned along the 0..1
range, it's likely that any nonlinear arrangement will make
the spacing between nearby colours less even: there will be
jumps (most obviously, in our simplified example, the gap
from 01 to 10 is 0.0, since they map to the same colour,
whereas the gap from 10 to 11 is 0.65). This lack of smoothness
may be more disconcerting than the absolute accuracy of the
colour (which, without using a profile, is always going to
be hit-and-miss), for some applications.

Hence, I still claim, at least for a colour-managed application
and on a standard DVI display, doing anything but leaving the
LUT alone can only be harmful. I'm happy to have it explained
to me where the flaw in my logic is. Failing that, I don't
suppose there's a developer API available for the Spyder
colorimeters, is there? (I'm prepared to roll my own profile,
if I have to, but I still need the data...)

As you say, all of this is "only an on-screen thing" - but
since my needs of colour management don't extend to matching
two printers, or accurately reproducing scanned colour, my
sole concern is being able to edit an image on-screen and
have it look (reasonably) "right" after I print it out. I'm
quite keen that the display part of colour management work
correctly; otherwise I wouldn't have started my attempts at
colour management with a display colorimeter and the printer
manufacturer's profiles.

I realise I'm making a bit of a pain of myself with my first
appearance on this group; for that I apologise. My thanks
again to anyone who's got this far, and who can help me, and
to David for his previous help.

-- 
Fluppeteer

Re: Profiling without calibration and monitor matching (newbie questions)

2008-02-16 by John Vitollo

--- In colorvision_group@yahoogroups.com, "fluppeteer" <yahoo@...> wrote:
>

> Sorry to keep banging on about this, but I still think we have
> crossed wires here. I'm going to have another go at making my
> point, with a simplified (if extended) example, and put a big
> disclaimer here to anyone who stumbles across this thread out of........

> Are you sitting comfortably? Then I'll begin.
> 

Regarding your previous post...

Thems there are a lot of words! 8-} You should of warned us to take ten aspirins.

Actually probably a better Yahoo forum to ask this question is called "colortheory":

http://tech.groups.yahoo.com/group/colortheory/

I'm sure David T. would have an answer for you but it seems like he'd have to teach a semester 
course on color science on this list. I don't think he has the time. :-)

Re: Profiling without calibration and monitor matching (newbie questions)

2008-02-16 by fluppeteer

--- In colorvision_group@yahoogroups.com, "John Vitollo" <jvlist@...> 
wrote:
>
> --- In colorvision_group@yahoogroups.com, "fluppeteer" <yahoo@> 
wrote:
> >
> 
> > Sorry to keep banging on about this, but I still think we have
> > crossed wires here. I'm going to have another go at making my
> > point, with a simplified (if extended) example, and put a big
> > disclaimer here to anyone who stumbles across this thread out of..
......
> 
> > Are you sitting comfortably? Then I'll begin.
> 
> Regarding your previous post...
> 
> Thems there are a lot of words! 8-} You should of warned us to take 
ten aspirins.

Sorry! Concision has never been a strong point of mine. I
generally rely on boredom to provide its own analgesia.

> Actually probably a better Yahoo forum to ask this question is 
called "colortheory":
> 
> http://tech.groups.yahoo.com/group/colortheory/

Ahah - much appreciated. I'll try there, and not darken the
doors of this groups again except with Colorvision-specific
questions. :-)

> I'm sure David T. would have an answer for you but it seems like 
he'd have to teach a semester 
> course on color science on this list. I don't think he has the time. 
:-)

:-) I can believe it. Thanks to both of you for your kind
assistance.

-- 
Fluppeteer

Move to quarantaine

This moves the raw source file on disk only. The archive index is not changed automatically, so you still need to run a manual refresh afterward.