Skip to main content
Track Walk-forward analysis
27 / 50
Library

2001issue C021

Inspectable rules when system write-ups dry up

Complete system submissions fell while sealed products multiplied and indicator notes arrived less often. TradersWeek editorial view: finish one mechanical trading system, constrain any optimization, and check entry, exit, and abstention on unused data.

  • Submissions of complete trading systems fell over several years even as more people traded, while sealed systems for sale increased and moved from postal pitches to internet distribution.
  • New indicator write-ups arrived less often than they once did, even as more people took up the subject.
  • The archive asked for an original idea written as a replicable procedure and checked on older and then-current data, by hand or with software, on any tradable.
  • TradersWeek editorial view: treat that drought as a design critique, constrain system optimization to one candidate, and confirm the mechanical trading system with walk-forward analysis outside the fit window.
Entries in this reading3 entries

Fewer complete systems, more sealed products

Submissions that described complete trading systems fell over several years even as the number of people trading rose sharply. Over the same interval, sealed systems offered for sale increased and shifted from postal pitches to internet distribution.

New indicator write-ups also arrived less often than they once did, despite many more people taking up the subject.

What the assignment asked for

The magazine printed many system articles on the view that a specified procedure is a better novice start than informal discretion. Readers were asked to produce a new, replicable procedure for an issue reserved for trading systems.

Work could be done by hand or with software, on any tradable, using any procedure another person could repeat. Procedures that remained usable across several trading vehicles were to receive extra attention.

The assigned practice was to take an original idea, implement it as a complete procedure, and test it on both older and then-current data. A replicable procedure can include chart patterns and probability scans, as long as another person can execute the technique the same way.

Finish one inspectable procedure

The indicator-to-system path is the learning sequence from a chart mark to a trendline to an indicator to a complete mechanical procedure. A mechanical trading system is a signal procedure whose inputs are rule settings, market state, and execution constraints, whose horizon is the system holding period, and whose purpose is to make entry, exit, and abstention testable as one process.

TradersWeek editorial view: system optimization is useful only when the search over those same rule inputs yields a candidate procedure. Walk-forward analysis then reapplies that candidate to later or unused data so the same entry, exit, and abstention rules are judged outside the fit window. The archive check on older and then-current data is the historical form of that confirmation.

Educational research material, not investment advice. Historical source context does not establish present-day performance.
27 of 50 in the Walk-forward analysis track
20021-5 pp.Next on Walk-forward analysisEvaluating mechanical systems before position sizingThe five-step performance analysis process codes a methodology, tests robustness, evaluates the system, applies system-level position sizing, and only then combines systems with portfolio-level sizing.
All readings on this track · 50 readings
  1. 1990Three-window walk-forward system evaluation
  2. 1990Building the construction layer of a mechanical trading system
  3. 1991Constructing walk-forward neural trading rules
  4. 1991Constructing neural trading systems from facts to walk-forward
  5. 1992Walk-forward evaluation of stop overlays on average crossovers
  6. 1992Audit mechanical system tests for fills and regimes
  7. 1993Walk-forward evaluation of monthly yield and real-rate forecasts
  8. 1993Constructing walk-forward forecasts with linear and moving-average baselines
  9. 1993Walk-forward hybrid rules for intermarket forecast stacks
  10. 1994Neural-net construction as a mechanical trading-system problem
  11. 1995Constructing an intermarket neural net trading system
  12. 1996Weekly market breadth as one procedure on an unused window
  13. 1996Walk-forward evaluation of gold-index bond-fund rules
  14. 1996Evaluating weekday-in-month filters for index day trades
  15. 1996Require both a trend filter and a cycle oscillator before entry
  16. 1997Walk-forward windows as a diagnostic of parameter instability
  17. 1997Walk-forward validation of a market-breadth timing rule
  18. 1997Sunspot spikes and walk-forward evaluation of an adaptive cycle rule
  19. 1997A walk-forward check for bond-breadth timing
  20. 1998Walk-forward audit of regression trend forecasts
  21. 1998Evaluating a cubic least-squares currency trend with walk-forward segments
  22. 1998Walk-forward evaluation of recursive yen trend signals
  23. 1999Personal system design under crowd psychology
  24. 1999Walk-forward evaluation of a polynomial price forecast
  25. 2000Walk-forward optimization of regression-slope-angle rules
  26. 2001Construct a winter seasonal window as one procedure
  27. 2001Inspectable rules when system write-ups dry up
  28. 2002Evaluating mechanical systems before position sizing
  29. 2003Walk-forward construction of rule-based market-position systems
  30. 2007Evaluating metal seasonal windows across regimes
  31. 2007Evaluating mechanical timing systems against hold baselines
  32. 2011Walk-forward reoptimization as a system design gate
  33. 2011Evaluate generated systems on holdouts, then add stops
  34. 2012Walk-forward analysis and out-of-sample tests for a mechanical trading system
  35. 2012Personality-first trading system design
  36. 2012Scorecard-first mechanical system construction
  37. 2012Constructing an advancer-decliner moving average for market breadth
  38. 2012Formula search as mechanical system construction
  39. 2013Identity-first system construction
  40. 2013Construct a swing system from bias rules to walk-forward
  41. 2014Evaluate mechanical stock systems with stops and walk-forward
  42. 2014Walk-forward velocity filters on noisy intraday trends
  43. 2015Event-predictability versus position-constrained rules
  44. 2015Constructing mechanical systems for walk-forward tests
  45. 2016When a tested system must be retired
  46. 2016Walk-forward metric filters and chance-level checks for selected inputs
  47. 2018Evaluate mechanical trading systems without catalog rankings
  48. 2019Phased stop construction from entry risk to trailing exit
  49. 2020Stockpiling simple ideas for mechanical system construction
  50. 2020A pretty first draft is not a walk-forward waiver
All 95 readings tagged Walk-forward analysis
Also on Walk-forward analysis5 readings