Skip to main content
Track Walk-forward analysis
28 / 50
Library

2002issue C091-5

Evaluating mechanical systems before position sizing

Evaluation is the gate between a coded mechanical trading system and any position-sizing rule. Robustness checks, walk-forward tests, and a match between sizing and system behavior come before money-management overlays.

  • The five-step performance analysis process codes a methodology, tests robustness, evaluates the system, applies system-level position sizing, and only then combines systems with portfolio-level sizing.
  • Robustness analysis asks whether a coded system is curve-fitted before deeper evaluation or a money-management overlay is applied.
  • Walk-forward and related out-of-sample checks are necessary because a single historical test is not a fixed forecast of future system behavior.
  • An aggressive sizing algorithm on an erratic system can make the whole plan fail, so the sizing method should match the system's behavior and the trader.
Entries in this reading3 entries

Evaluation as a gate

Editorial reading: treat evaluation as the gate that decides whether a mechanical trading system is stable enough to receive any position-sizing rule, rather than as a scoreboard after the system is already being sized.

A mechanical trading system is a fully specified procedure that turns rule inputs, market state, and execution constraints into entry, exit, or abstention signals over the system's holding period. Until that procedure has been checked, a sizing rule only scales an unevaluated design.

The five-step process

The archive presents a five-step performance analysis process: code the methodology, run robustness analysis for curve-fitting, evaluate the individual system, apply system-level position sizing, then combine systems in a portfolio with portfolio-level sizing.

Robustness analysis is the check, after coding, that tries to determine whether a methodology is curve-fitted. The archive places that check before deeper evaluation and before any money-management overlay.

Walk-forward checks and optimization

Walk-forward analysis is a sequential out-of-sample evaluation method that tests whether coded rules remain usable as market conditions change. The archive treats walk-forward and related out-of-sample checks as necessary because a single historical test is not a fixed forecast of future system behavior.

System optimization, in this workflow, means adjusting a system's rules or parameters only after robustness and evaluation checks show the design is not merely fitted to one historical path.

Sizing after evaluation

Position sizing is a separate algorithm that changes how many contracts or shares a system trades as its environment changes, rather than rewriting the system's entry and exit rules.

System-level money management is described as using approaches such as maximum adverse excursion or maximum favorable excursion to change position size rather than a constant share or contract count. Maximum favorable excursion is associated with trend-oriented systems that scale exposure from favorable price movement.

The archive argues that matching a sizing method to a system's behavior and to the trader matters, because an aggressive sizing algorithm on an erratic system can make the whole plan fail.

The archive also states that systems can remain useful in an unfriendly regime if position size is reduced, instead of rewriting trend rules to avoid consolidation.

Portfolios and a normalized display

Portfolio construction is described as combining multiple methodologies across markets so diversification and sizing, not only the individual signal rules, determine account outcomes. Fixed-fractional sizing is presented as a portfolio-level method that changes position size by market after several systems have been combined.

Value Charts are described as a normalized price display that marks moderately and significantly overbought or oversold conditions at plus or minus 4 and plus or minus 8, and that can be used across markets and time horizons.

Educational research material, not investment advice. Historical source context does not establish present-day performance.
28 of 50 in the Walk-forward analysis track
20031-4 pp.Next on Walk-forward analysisWalk-forward construction of rule-based market-position systemsA complete market-position procedure can be built from three scored inputs, three discrete weights, a summed output, and explicit buy, sell, and stay-out rules.
All readings on this track · 50 readings
  1. 1990Three-window walk-forward system evaluation
  2. 1990Building the construction layer of a mechanical trading system
  3. 1991Constructing walk-forward neural trading rules
  4. 1991Constructing neural trading systems from facts to walk-forward
  5. 1992Walk-forward evaluation of stop overlays on average crossovers
  6. 1992Audit mechanical system tests for fills and regimes
  7. 1993Walk-forward evaluation of monthly yield and real-rate forecasts
  8. 1993Constructing walk-forward forecasts with linear and moving-average baselines
  9. 1993Walk-forward hybrid rules for intermarket forecast stacks
  10. 1994Neural-net construction as a mechanical trading-system problem
  11. 1995Constructing an intermarket neural net trading system
  12. 1996Weekly market breadth as one procedure on an unused window
  13. 1996Walk-forward evaluation of gold-index bond-fund rules
  14. 1996Evaluating weekday-in-month filters for index day trades
  15. 1996Require both a trend filter and a cycle oscillator before entry
  16. 1997Walk-forward windows as a diagnostic of parameter instability
  17. 1997Walk-forward validation of a market-breadth timing rule
  18. 1997Sunspot spikes and walk-forward evaluation of an adaptive cycle rule
  19. 1997A walk-forward check for bond-breadth timing
  20. 1998Walk-forward audit of regression trend forecasts
  21. 1998Evaluating a cubic least-squares currency trend with walk-forward segments
  22. 1998Walk-forward evaluation of recursive yen trend signals
  23. 1999Personal system design under crowd psychology
  24. 1999Walk-forward evaluation of a polynomial price forecast
  25. 2000Walk-forward optimization of regression-slope-angle rules
  26. 2001Construct a winter seasonal window as one procedure
  27. 2001Inspectable rules when system write-ups dry up
  28. 2002Evaluating mechanical systems before position sizing
  29. 2003Walk-forward construction of rule-based market-position systems
  30. 2007Evaluating metal seasonal windows across regimes
  31. 2007Evaluating mechanical timing systems against hold baselines
  32. 2011Walk-forward reoptimization as a system design gate
  33. 2011Evaluate generated systems on holdouts, then add stops
  34. 2012Walk-forward analysis and out-of-sample tests for a mechanical trading system
  35. 2012Personality-first trading system design
  36. 2012Scorecard-first mechanical system construction
  37. 2012Constructing an advancer-decliner moving average for market breadth
  38. 2012Formula search as mechanical system construction
  39. 2013Identity-first system construction
  40. 2013Construct a swing system from bias rules to walk-forward
  41. 2014Evaluate mechanical stock systems with stops and walk-forward
  42. 2014Walk-forward velocity filters on noisy intraday trends
  43. 2015Event-predictability versus position-constrained rules
  44. 2015Constructing mechanical systems for walk-forward tests
  45. 2016When a tested system must be retired
  46. 2016Walk-forward metric filters and chance-level checks for selected inputs
  47. 2018Evaluate mechanical trading systems without catalog rankings
  48. 2019Phased stop construction from entry risk to trailing exit
  49. 2020Stockpiling simple ideas for mechanical system construction
  50. 2020A pretty first draft is not a walk-forward waiver
All 95 readings tagged Walk-forward analysis
Also on Walk-forward analysis5 readings