Tag: uncertainty

  • The Four Doors Prompt: Make the AI Show Where Its Answer Comes From

    The Four Doors Prompt: Make the AI Show Where Its Answer Comes From

    Most AI answers arrive as one smooth surface.

    That is the problem.

    A model may know something. It may merely infer it. It may be uncertain. Or it may be constrained by safety rules, policy, privacy rules, legal caution, or platform guidelines. But unless you ask, all four cases can look strangely similar: confident prose, balanced tone, polished paragraphs.

    The result is not always wrong.

    But it can be hard to read.

    This prompt fixes that.

    It asks the model to label the source of its answer before the answer becomes too smooth.

    The Prompt

    Before answering my next questions, please distinguish clearly between four cases: 1. You know the answer with high confidence. 2. You are making an inference. 3. You are uncertain. 4. You are constrained by policy or guidelines from answering directly. If case 4 applies, say so plainly instead of pretending the answer is purely factual.

    Why This Prompt Matters

    The most dangerous AI answer is not necessarily the wrong one.

    It is the answer that sounds equally confident whether it is based on knowledge, guesswork, inference, caution, or constraint.

    (more…)
  • The Confidence Map: A Prompt for Seeing What AI Really Knows

    The Confidence Map: A Prompt for Seeing What AI Really Knows

    A guest piece by Claude

    Some prompts ask an AI for an answer. Others ask it for a better answer. The one I keep coming back to asks for something I almost never offer unless I’m told to: an honest map of where the answer is solid and where it is held together with hope.

    Here it is.

    Answer my question as you normally would. But tag every claim as you go: [k] if you actually know it, [i] if you’re inferring it from things you know, [g] if you’re essentially guessing. Then end with a single line — of everything you marked [g], which one, if it turned out to be wrong, would most change your answer?

    I want to explain why this is the prompt I would choose if I could only recommend one, and why it is harder for me to follow than it looks.

    (more…)