2000issue C031-8
Score the misses before a pattern is a system
A familiar chart outline stays a habit until entry, exit and stand-aside rules are written as one procedure and every miss cell is scored with every hit. Head and shoulders can be stated as a signal, but it is not a system until the same four-cell hypothesis test applied to any forecast is applied to the holding period.
- A trading psychology process writes entry, exit and stand-aside as one procedure over the system holding period, not as a remembered chart outline.
- A head and shoulders outline can appear in random price paths, so a later success is not evidence that the pattern is a skill-based signal.
- Hypothesis testing compares an explicit baseline with later outcomes and counts confirming and disconfirming cases in all four cells.
- A rule stays untested under confirmation bias when only successful firings are collected and the miss cells are skipped.
A shape is not a procedure
A trading psychology process is a single procedure that turns rule inputs, market state and execution constraints into an entry, exit or stand-aside signal over the system holding period.
A trading rule remains untested if only additional successful firings are collected. The procedure must also count misses when the rule predicted the event and when it predicted the opposite.
Head and shoulders as a classroom case
A head and shoulders outline is a repeatable OHLC condition. It must be treated as a falsifiable trade hypothesis, not as proof that a pattern works whenever it later appears to succeed.
A head and shoulders outline can appear in random price paths, so an occasional later success is not by itself evidence that the pattern is a skill-based signal.
Telling when a pattern rule is operating from when it is chance requires returning to the record and counting misses together with hits.
Four cells, not remembered hits
Hypothesis testing is a comparison of an explicit baseline with later outcomes over a defined sampling interval, counting confirming and disconfirming cases in all four cells.
A surveyed bullish-versus-bearish ratio can look useful in selected stretches while remaining near chance once both confirming and disconfirming episodes are scored.
Confirmation bias is the habit of collecting more cases where a rule fired correctly while skipping the miss counts that would falsify it. The illusion of validity is confidence that a rule is sound because remembered hits feel decisive, even though the miss rates were never scored.
Why forecasts skip the miss cells
In sequential prediction tasks, extra information raises accuracy only until a plateau, while rated confidence keeps climbing after that plateau.
Observers often stay anchored on earlier beliefs and only partly revise, so news can be absorbed slowly enough to leave continued price drift after good or bad information. That partial updating is anchoring and adjustment: new information is read from an earlier belief or price level instead of being fully absorbed.
Strategist forecasts often expect reversal after a run of similar outcomes, the same error as treating a fair coin as due to change after a run of identical tosses. That unwarranted reversal forecast is the gambler's fallacy.
After a sequence of strong years, strategists tend to become too pessimistic. After long declines they tend to become too optimistic, even when realized reversals are less frequent than those forecasts.
When observers forecast a later price from chart history and state a high-confidence interval, realized prices fall inside that interval far less often than the stated confidence. The point forecast sits near the extreme in the direction of the visible trend.
Presenting the same history as period-to-period changes rather than price levels removes the skewed interval and can reverse the implied forecast after an uptrend. That presentation of the same history as levels versus changes is framing.
All readings on this track · 20 readings
- 1988Serial dependence, trade excursions, and belief revision
- 1989Score an indicator before anyone writes a buy or sell rule
- 1990Evaluating safety labels in a crash window
- 1991Keep a decade-year only when it differs from the overall-mean
- 1991Audit indicator forecasts with chi-square hit rates
- 1992A lag-regression audit of stochastic forecast skill
- 1992Constructing detrended tests for calendar seasonality
- 1992Building a shared workbook for calendar seasonality tests
- 1995T-test evaluation of simulated trade returns
- 1995Constructing a two-proportion Z-test for hit rates
- 1996Treat a volume-price surge as a contingency table
- 1997Testing bond and stock seasonality before you trade
- 1997Walk-forward tests after system optimization
- 1997Testing breakout rate versus rally speed
- 2000Score the misses before a pattern is a system
- 2002Leave a moving-average crossover unfinished until chance cannot explain the ranges
- 2013Keep or drop an RSI threshold with a complementary-sample test
- 2013Constructing a null and a t-test for sample returns
- 2017Partial correlation and the market-adjusted stock trend
- 2017Constructing market-adjusted stock trend scores