OK, I just answer it myself. The clue is to look at the schematics of 74LS05 hex inverter with open collector. Can't get much easier than that:

So when input is Low, it sinks current. That means it pulls the base of the first transistor low, so the first transistor is shut off. When that first transistor is shut off, then the following output transistor is also shut off. So that means no current is sunk through its open collector.
Now, if this is called an "inverter", it means an inverter with open collector is a gate which when given a Low input causes the output transistor to shut off, i.e., when used with a pull-up resistor on the output, it would cause the output to be High.
Conversely, a High input would cause the first transistor to be on, and the output transistor to also be on and therefore sink current.
Therefore, if what I want is to sink a current (e.g., to turn on an LED) on High with an open-collector, then indeed I need an inverter! But the state of the output transistor sinking current is Low. So a Low state on an open-collector output means current is flowing.
Now, to never again forget that, the thing to remember is that in all TTL (and I suppose CMOS logic) for a pin to be Low means it sinks current. For a pin to be high means it does not sink current, and optionally emits some current on its high voltage. This is the same regardless whether its a High driven gate or an open collector gate. Low = sink current. High = output voltage is optional.
I will add the use case that I had in distant memory was those Nixie tube drivers, that say H H L H H H H H H H for "2" in their truth table, meaning low sinks current, output transistor on, so that the 60V or whatever high voltage can be sunk driven by 5V TTL input signal that is high. I think this is also why 3 to 8 line selectors (74LS138) are output active low and this, in turn, I believe, is why all memory chips have come to use active low signals of /CS, /OE, and /WE. One would really wonder otherwise why else the first maker of memory had decided to just flip a coin to make his control inputs active low, he didn't say "let me confuse people in posterity by saying 'if you want to turn it on, give it a zero and not a one!' [evil laughter]", no it's because the selectors were intended to primarily sink current to drive Nixie tubes on higher voltage.
This is also why I think it is misleading to teach that TTL "High means high voltage" it is better to say "Low" means lower potential so that current flows into the gate onto lower ground. "High" means that the potential is high so nothing flows down. Most standard gate outputs can sink way more current in Low state than they can spit out in high state.