1993issue C091-9
Constructing walk-forward forecasts with linear and moving-average baselines
A forecast construction writes a linear-regression baseline and a moving-average lookback recipe first, then searches only hidden-layer capacity inside walk-forward-analysis. Scoring uses later unseen facts so the same observations are not reused to judge the model.
- Write the linear-regression baseline first: an explicit linear mapping from ordered price, volume, or breadth observations that later constructions are scored against out of sample.
- Encode each moving-average as one fixed-lookback coordinate of the input-vector, including five-day averages of the close, high, and low when those series are used.
- Treat hidden-layer unit count as the search variable, because too many hidden units fit training facts and fail on unseen test facts.
- Run walk-forward-analysis so training uses an earlier window and scoring uses only later unseen facts, keeping architecture search off the facts that judge the model.
Lock the construction before search
Linear statistical single-market constructions that historically simulated and backtested a market against its own past prices were described as the prevailing technical baseline of the prior decade. The modeling task was classified as prediction of price or trend, so candidate architectures were judged by whether they emitted a future value from ordered observations.
Editorial reading: write the linear-regression baseline and the moving-average lookback recipe first. After those pieces are locked, change only hidden-layer capacity inside a walk-forward holdout.
Write the linear-regression baseline
Linear-regression is an explicit linear mapping from ordered price, volume, or breadth observations to a forecast, kept as the quantitative baseline that later nonlinear constructions must beat out of sample. Those linear statistical single-market constructions were described as the prevailing technical baseline of the prior decade.
A forecast construction was allowed to combine technical, intermarket, and fundamental series in one mapping rather than restricting inputs to a single market's own past prices.
Place moving averages in the input-vector
A moving-average is a fixed-lookback summary of an ordered price, volume, or open-interest series that occupies one coordinate of the input-vector. Moving averages of prices, volume, and open interest were listed among the ordered series presented at the input layer of a multilayer forecast mapping.
The input-vector is the fixed-length bundle of contemporaneous features presented as one training or test fact. A feedforward construction had to encode lookback inside each input-vector, whereas a recurrent construction could receive one observation per step and learn temporal dependence from presentation order.
Two worked forecast mappings
One worked construction mapped a three-part input, high-low differences over the prior two days plus a five-day moving average of closes, onto the next day's median price.
For a close-change forecast built from five-day moving averages of the close, high, and low, the layout used three input units, one output unit, and at least one hidden-layer.
Search only hidden-layer capacity
A hidden-layer is an intermediate processing stage whose unit count is a construction choice found by search, not a market observation. Hidden-unit count was treated as a search variable, with a suggested start between half and twice the number of inputs, because too many hidden units fit the training facts and failed on unseen test facts.
That failure is overfitting: extra hidden capacity that reproduces training facts and then fails on facts withheld for testing. After each forward pass, output error was sent backward through the layers to adjust connection weights, and facts were reused until residual error reached a level the designer judged acceptable. Zero error was treated as unrealistic for market data.
Editorial vocabulary: a transfer-function is a smooth nonlinear map applied after a weighted sum so the constructed model can represent curved input-output relationships.
Data selection, preprocessing, training-parameter search, and the testing procedure were all said to control whether a constructed model generalized, so no single architectural setting was treated as sufficient.
Score later unseen facts
Walk-forward-analysis is a single testable procedure that trains on an earlier window and scores only later unseen facts, so entry, exit, and abstention rules are judged together.
Editorial reading: after the linear-regression baseline and the moving-average lookback recipe are written, change only hidden-layer capacity inside that holdout. Architecture search then cannot reuse the same facts used to score the model.
All readings on this track · 50 readings
- 1990Three-window walk-forward system evaluation
- 1990Building the construction layer of a mechanical trading system
- 1991Constructing walk-forward neural trading rules
- 1991Constructing neural trading systems from facts to walk-forward
- 1992Walk-forward evaluation of stop overlays on average crossovers
- 1992Audit mechanical system tests for fills and regimes
- 1993Walk-forward evaluation of monthly yield and real-rate forecasts
- 1993Constructing walk-forward forecasts with linear and moving-average baselines
- 1993Walk-forward hybrid rules for intermarket forecast stacks
- 1994Neural-net construction as a mechanical trading-system problem
- 1995Constructing an intermarket neural net trading system
- 1996Weekly market breadth as one procedure on an unused window
- 1996Walk-forward evaluation of gold-index bond-fund rules
- 1996Evaluating weekday-in-month filters for index day trades
- 1996Require both a trend filter and a cycle oscillator before entry
- 1997Walk-forward windows as a diagnostic of parameter instability
- 1997Walk-forward validation of a market-breadth timing rule
- 1997Sunspot spikes and walk-forward evaluation of an adaptive cycle rule
- 1997A walk-forward check for bond-breadth timing
- 1998Walk-forward audit of regression trend forecasts
- 1998Evaluating a cubic least-squares currency trend with walk-forward segments
- 1998Walk-forward evaluation of recursive yen trend signals
- 1999Personal system design under crowd psychology
- 1999Walk-forward evaluation of a polynomial price forecast
- 2000Walk-forward optimization of regression-slope-angle rules
- 2001Construct a winter seasonal window as one procedure
- 2001Inspectable rules when system write-ups dry up
- 2002Evaluating mechanical systems before position sizing
- 2003Walk-forward construction of rule-based market-position systems
- 2007Evaluating metal seasonal windows across regimes
- 2007Evaluating mechanical timing systems against hold baselines
- 2011Walk-forward reoptimization as a system design gate
- 2011Evaluate generated systems on holdouts, then add stops
- 2012Walk-forward analysis and out-of-sample tests for a mechanical trading system
- 2012Personality-first trading system design
- 2012Scorecard-first mechanical system construction
- 2012Constructing an advancer-decliner moving average for market breadth
- 2012Formula search as mechanical system construction
- 2013Identity-first system construction
- 2013Construct a swing system from bias rules to walk-forward
- 2014Evaluate mechanical stock systems with stops and walk-forward
- 2014Walk-forward velocity filters on noisy intraday trends
- 2015Event-predictability versus position-constrained rules
- 2015Constructing mechanical systems for walk-forward tests
- 2016When a tested system must be retired
- 2016Walk-forward metric filters and chance-level checks for selected inputs
- 2018Evaluate mechanical trading systems without catalog rankings
- 2019Phased stop construction from entry risk to trailing exit
- 2020Stockpiling simple ideas for mechanical system construction
- 2020A pretty first draft is not a walk-forward waiver