1995issue C011-2
T-test evaluation of simulated trade returns
A 24-trade simulation of the September 1994 Deutsche Mark futures contract was judged by whether the t-score on net dollar returns, after stated commission and slippage, exceeded a tabled critical value of 1.71.
- The evaluation used 24 simulated trades on the September 1994 Deutsche Mark futures contract and measured net return after a 20-dollar round-turn commission and stop-order slippage of 10 percent of the daily range.
- Hypothesis testing asked whether a t-score, built from the sample average return and the sample standard deviation, was large enough to reject the null hypothesis.
- The sample standard deviation of those trade dollar returns was 1027.28, and a statistical table set the critical value at 1.71.
- The computed t-score was 1.88, which exceeded 1.71, so the evaluation rejected the null hypothesis in favor of the alternate hypothesis.
The simulated sample and its costs
The evaluation used 24 trades generated in a simulation of the September 1994 Deutsche Mark futures contract. Cost assumptions included an estimated 20-dollar round-turn commission and a stop-order slippage penalty equal to 10 percent of the daily range.
Net return is the dollar result of each completed trade after those estimated costs. The t-test was applied to each trade's net dollar return, beginning with the sample average return and the sample standard deviation.
How the t-score was judged
Hypothesis testing is a formal check of whether a sample statistic is large enough, relative to a tabled threshold, to reject a stated null in favor of an alternate claim. The null hypothesis is the default claim under test, typically that average net trade return is not distinguishable from no edge.
The t-score is a standardized measure of how far the average trade result sits from the null, using the sample's own dispersion and trade count. The sample standard deviation of those trade dollar returns was 1027.28. Sample standard deviation measures how widely individual trade dollar results spread around their average.
A statistical table supplied a critical value of 1.71 that the t-score had to exceed in order to reject the null hypothesis. A critical value is the tabled cutoff a t-score must exceed before the null is rejected at the chosen significance level. The computed t-score was 1.88, which exceeded 1.71, so the evaluation rejected the null hypothesis in favor of the alternate hypothesis.
All readings on this track · 20 readings
- 1988Serial dependence, trade excursions, and belief revision
- 1989Score an indicator before anyone writes a buy or sell rule
- 1990Evaluating safety labels in a crash window
- 1991Keep a decade-year only when it differs from the overall-mean
- 1991Audit indicator forecasts with chi-square hit rates
- 1992A lag-regression audit of stochastic forecast skill
- 1992Constructing detrended tests for calendar seasonality
- 1992Building a shared workbook for calendar seasonality tests
- 1995T-test evaluation of simulated trade returns
- 1995Constructing a two-proportion Z-test for hit rates
- 1996Treat a volume-price surge as a contingency table
- 1997Testing bond and stock seasonality before you trade
- 1997Walk-forward tests after system optimization
- 1997Testing breakout rate versus rally speed
- 2000Score the misses before a pattern is a system
- 2002Leave a moving-average crossover unfinished until chance cannot explain the ranges
- 2013Keep or drop an RSI threshold with a complementary-sample test
- 2013Constructing a null and a t-test for sample returns
- 2017Partial correlation and the market-adjusted stock trend
- 2017Constructing market-adjusted stock trend scores