Logic and Probability: Deduction, Uncertainty, and Evidence
Logic constrains what follows from premises; probability represents uncertainty and evidential support. This essay separates truth, validity, credence, conditional probability, Bayes, causation, and AI generation.
Logic and probability both discipline inference, but they do not ask the same question.
Logic asks what follows from what. Probability asks how strongly the available information supports competing possibilities.
That distinction matters whenever evidence is incomplete. A conclusion can be logically valid but based on false premises. A hypothesis can be strongly supported without being entailed. A probability can equal one inside a model without expressing a logical truth.
Logic provides structure. Probability represents uncertainty within a structure. Neither can replace the other.
This essay focuses on their interface: why entailment is not conditional probability, and how deductive consequence relates to graded evidential support. Logic treats consequence in its own right; Probability and Bayes examines interpretations of probability and belief revision.
The scope of “logic”
Logic includes many systems: classical and non-classical logics, modal logic, temporal logic, inductive logic, and accounts of defeasible reasoning. The clearest starting point for comparison is classical deductive logic.
Classical logic studies propositions, truth values, and consequence. An argument is valid when there is no interpretation in which all its premises are true and its conclusion is false.Stanford Encyclopedia of Philosophy: Classical Logic
All humans are mortal.
Socrates is human.
Therefore Socrates is mortal.
If both premises are true, the conclusion cannot be false. The relation can be written:
D ⊨ C
This says that every interpretation satisfying premises D also satisfies conclusion C.
Validity, truth, and soundness
Validity concerns the form of an inference. It does not verify the premises.
All fish can fly.
Carp are fish.
Therefore carp can fly.
The form is valid. The first premise is false. A sound argument therefore requires both:
valid inference
+ true premises
This produces three separate questions:
- Are the concepts and propositions clear?
- Are the premises true or adequately supported?
- Does the conclusion follow from them?
Probability often enters the second question. Evidence may support a premise to some degree even when it cannot establish it deductively.
What probability represents
Probability assigns values between zero and one to events or propositions, but the meaning of those values depends on interpretation.
Probability may represent:
- long-run frequency across repeated trials;
- an objective chance or propensity in a physical system;
- evidential support for a proposition;
- a rational or personal degree of belief;
- the output distribution of a statistical model.
These interpretations share mathematical rules without making the same philosophical claim about what probability is.Stanford Encyclopedia of Philosophy: Interpretations of Probability
“There is a 70% probability of rain tomorrow” may summarize a calibrated forecast over comparable cases, a model distribution, or a degree of belief given current evidence. It does not say that rain is logically required.
Two different relations
| Question | Logic | Probability |
|---|---|---|
| Central concern | Does the conclusion follow from the premises? | How much support does the evidence give a possibility? |
| Typical expression | If A, then B | P(B | A) = 0.7 |
| Strength | necessary, possible, impossible | a degree from 0 to 1 |
| Main failures | contradiction, invalid inference, equivocation | bad conditioning, ignored base rates, misspecified models |
| Response to new information | add, remove, or revise premises | update a probability distribution |
Logical consequence is categorical relative to the premises:
A ⊨ B
Conditional probability is graded:
P(B | A) = 0.9
The second expression still allows cases in which A is true and B is false. A high conditional probability is not an entailment.
Truth is not a probability value
In classical logic, a proposition under an interpretation is true or false. Probability describes uncertainty about events or propositions; it does not turn truth into a percentage.
Before tomorrow arrives, a forecast may assign a 70% probability to rain. After time, place, and the criterion for rain are fixed, the proposition “it rained” is either true or false. The earlier probability described an uncertain epistemic or predictive state.
It helps to distinguish:
| Level | Question |
|---|---|
| truth | Is the proposition actually the case? |
| evidential support | How strongly does the available evidence support it? |
| credence | How strongly does an agent believe it? |
Evidence and credence can be represented probabilistically. Neither is identical to truth.
Probability one is not always logical necessity
If D logically entails C, and P(D) > 0, a probability model that respects the logical relation must satisfy:
D ⊨ C
→ P(C | D) = 1
The converse does not generally hold:
P(C | D) = 1
⇏ D ⊨ C
Probability one means that the model assigns all relevant probability mass to the event. Logical necessity means that no interpretation satisfying the premises makes the proposition false.
Continuous distributions make the difference vivid. A single exact point can have probability zero while remaining a possible value. Probability zero therefore need not mean contradiction, just as probability one need not mean logical truth.
Invalid deduction can still contain evidence
Consider:
If it rains, the ground becomes wet.
The ground is wet.
Therefore it rained.
As a deductive argument, this affirms the consequent and is invalid. Sprinklers, cleaning, or a leak could also wet the ground.
Yet wet ground may raise the probability of rain when:
- rain nearly always wets the ground;
- other causes of wet ground are uncommon;
- rain itself is not extremely rare.
The observation can support the hypothesis without proving it:
not deductively entailed
but probabilistically confirmed
Inductive logic studies relations of this kind: premises may make a conclusion more credible without guaranteeing it.Stanford Encyclopedia of Philosophy: Inductive Logic
Probability depends on logical structure
Probabilities cannot be assigned coherently until the events or propositions are specified.
One must know:
- which events exclude one another;
- which can occur together;
- whether one event includes another;
- what the condition in a conditional probability means;
- what counts as the negation of an event;
- whether the listed possibilities are exhaustive.
Suppose:
A = a user clicked an advertisement
B = a user completed a purchase attributed to that click
If the operational definition makes B a subset of A, then:
B → A
P(B) ≤ P(A)
A report showing more attributed buyers than recorded clickers signals a definition, attribution, collection, or data-integration problem. A more sophisticated probability formula will not repair an incoherent event structure.
Bayes connects evidence and belief revision
Bayes’ theorem is:
P(H | E) = P(E | H) × P(H) / P(E)
Here:
His a hypothesis;Eis evidence;P(H)is the prior probability;P(E | H)is the likelihood of the evidence if the hypothesis is true;P(H | E)is the posterior probability after observing the evidence.
Bayesian reasoning does not assert:
E occurred
→ H must be true
It compares how expected the evidence would be under rival hypotheses, then reallocates confidence. Logical relations define hypotheses, evidence, exclusions, and implications. Probability quantifies the resulting uncertainty. Bayesian epistemology develops this into a normative account of rational belief revision.Stanford Encyclopedia of Philosophy: Bayesian Epistemology
Bayes also exposes a common error: confusing P(E | H) with P(H | E). A test may be highly likely to return positive when a condition is present while the probability of the condition given a positive result remains much lower, especially when the condition is rare.
Probability is not causation
Logic, probability, and causation answer different questions:
| Relation | Question |
|---|---|
| logical | What must be accepted if the premises are accepted? |
| probabilistic | How does conditioning on information change uncertainty? |
| causal | What would change under an intervention, and through what process? |
A strong association may arise from reverse causation, a common cause, selection, measurement, or random variation. Causal analysis adds temporal order, counterfactual comparisons, interventions, mechanisms, and assumptions that identify an effect. The fuller account is developed in What Causation Means.
Probability does not choose an action
A well-calibrated probability still leaves practical questions unresolved:
logic: is the reasoning coherent?
probability: how likely are the outcomes?
value: how good or bad are the outcomes?
risk: which losses are tolerable?
authority: who may make the choice?
decision: which action is selected?
The option with the highest probability of success may have a trivial benefit, an unacceptable downside, or costs imposed on people who did not authorize the decision. Probability supplies inputs to decision-making; it does not settle values and responsibility.
Logic and probability in AI systems
A language model assigns probabilities to possible next tokens given context, then a decoding procedure selects outputs:
context
→ probability distribution over next tokens
→ token selection
→ generated text
High generation probability does not establish that a sentence is true, logically entailed, responsive to the user’s actual aim, or authorized for action.
An AI system therefore needs more than probabilistic generation. Depending on the task, it may need:
- factual retrieval and source checks;
- consistency and schema validation;
- explicit rules and permission checks;
- calculations or formal proofs;
- execution results and external feedback.
A fluent answer may be probable but contradictory. A valid derivation may be built on false retrieved facts. A calibrated prediction may still identify no useful intervention. These are different failure modes and require different checks.
An audit for uncertain inference
When reading or constructing an argument under uncertainty, ask:
- What exactly are the propositions or events?
- Which statements are premises, observations, assumptions, or definitions?
- Is the conclusion entailed or only supported to a degree?
- What evidence supports the premises?
- What interpretation does the probability number have?
- Is the conditioning information stated correctly?
- Have base rates and rival hypotheses been considered?
- Has an association or prediction been mistaken for a cause?
- Which values, risks, and permissions remain outside the probability model?
- What new evidence would change the conclusion?
Conclusion
Logic and probability impose different kinds of discipline on reasoning.
Logic specifies constraints among propositions and identifies what follows from accepted premises. Probability represents uncertainty about events or propositions and constrains how confidence should respond to evidence.
Their connection can be summarized as:
logic defines the structure
→ probability represents uncertainty within it
→ evidence updates probabilities
→ causal inquiry asks what changes what
→ values and risks enter decisions
→ action produces new evidence
Logic cannot replace probability when evidence is incomplete. Probability cannot replace logic when definitions conflict, possibilities are omitted, or an inference is invalid. Sound reasoning requires both the structure of consequence and the discipline of uncertainty.
References
- Stanford Encyclopedia of Philosophy: Classical Logic
- Stanford Encyclopedia of Philosophy: Logical Consequence
- Stanford Encyclopedia of Philosophy: Interpretations of Probability
- Stanford Encyclopedia of Philosophy: Inductive Logic
- Stanford Encyclopedia of Philosophy: Bayesian Epistemology
If this was useful, subscribe via RSS.
Content is open for citation with attribution; please link back to the source.