FAQ · Getting systematic research right

How do I test a trading system before I risk real money or buy a prop firm challenge?

Test it in steps, each of which catches a different way a system fails: a backtest with your real costs, a trade-by-trade inspection, a run on data you did not tune on, a Monte Carlo of the trade order, and paper trading at your broker with the same orders. Reamer Research, a Python and C++ backtesting and live trading engine, runs every step on your own machine, with byte-identical results, and its relay sends the orders you tested to a paper account and then a live one.

Test it in steps, each of which catches a different way a system fails, and put money behind it only once it has passed all of them. A challenge fee or a first live deposit buys you an answer you can get first, at your desk, for the cost of the data.

1. Backtest it with your real costs

Run the rules over historical bars with the commission, spread and slippage your broker or prop firm actually charges. A system that looks profitable with free fills can lose money once every fill pays the spread. Set costs per instrument, since they differ. See How realistic do slippage and spread need to be in a backtest?

2. Look at the trades, one by one

A summary hides the trades that make it. Open the run and check that each entry and exit happened where your rules say it should, at a price the bar allows. Reamer Research's visual trade diagnostics show every closed trade on its own bars beside every value your strategy printed, so a rule that fires on the wrong bar shows up at a glance.

3. Run it on data you did not tune on

A system tuned until the backtest looks good learns the past. Hold back a stretch of data, or walk forward through it, and judge the system only there. See How do I know if my backtest is overfit?

4. Shuffle the order of the trades

The same trades in a different order can produce a much deeper drawdown. Reamer Research's Monte Carlo resamples a run's per-trade returns and reports loss, ruin and maximum-drawdown percentiles, seeded so the numbers repeat. If you are buying a prop firm challenge, also replay the trades through its daily loss limit and drawdown rules: see How do I backtest a strategy against prop firm rules?

5. Paper trade the same orders

A backtest cannot test your connection, your data feed or your broker's order handling. Paper trading can. Reamer Research's relay sends the same orders your strategy returns in a backtest to your broker's paper or demo account through the open-source receiver. When you switch to the live account, the strategy stays the same. See Can I paper trade before going live?

6. Start small and compare

Go live with the smallest size your account allows, and compare the live fills, spread and slippage with what the backtest assumed. Where they differ, put the live figures back into step 1.

Why repeatable results matter here

Every step above compares one run with another: before and after a change, tuned data against held-back data, backtest against paper. Reamer Research gives the same result to the byte from the same data, settings and seed, and settles a bar that touches both your stop and your target on a seeded tick path inside the bar. So when a result changes, your system or your data changed.

Reamer Research runs on your own machine, on Linux, macOS, or Windows through WSL2. The free download runs steps 1 to 4 in Evaluation Mode, on one ticker over up to 30 days of bars. A licence, $20 per seat per month, cancel any time, removes every limit and adds paper and live trading through the relay.

Next questions

How do I know if my backtest is overfit?You cannot prove a backtest is not overfit, but you can test for the signs. An overfit result holds at one parameter set and collapses at its neighbours, fails on data it was not tuned on, rests on a handful of trades, or disappears once realistic costs are applied. Check each one, on a tool that gives the same answer every run.How realistic do slippage and spread need to be in a backtest?Realistic enough that the result survives them. Set spread, slippage and commission per instrument from what your broker actually charges, let spread and slippage widen when the market moves fast, and then rerun at one and a half and two times those costs. A strategy whose edge disappears under slightly higher costs was never a reliable edge.How do I backtest a strategy against prop firm rules like the daily loss limit and trailing drawdown?Run the backtest with the firm's account size and your real costs, then replay the closed trades day by day through the firm's rules: daily loss limit, maximum or trailing drawdown, profit target and minimum trading days. Reamer Research, a Python and C++ backtesting and live trading engine, gives you every closed trade with its time and net P&L, fills stops on a seeded tick path inside each bar, and repeats each run to the byte, so a pass or fail is the same every time you check it.Can I paper trade before going live?Yes, with either product on its own. Reamer Research's relay sends a strategy's orders through the open-source receiver to your broker's paper or demo account. With Reamer Server, a separate order-management core for firms, point your connector at the paper account instead. The licence allows paper and live trading for both. The Reamer Server kit's in-memory paper broker is a wiring check: it fills every order instantly at a made-up price to confirm your server is connected correctly.What is Reamer Research?Reamer Research is a deterministic backtesting and live trading engine for Python and C++, with a visual trade diagnostics tool; its relay sends live orders to your broker. You install it with pip or include one C++ header, on your own machine. It is built on a stable C ABI, so any other language that can call C can wrap it, live trading included. It tests a strategy, diagnoses it trade by trade, sweeps it, reports it, and sends its orders live, to your broker through the open-source receiver over the published protocol. Every order fills tick by tick on a seeded tick path the engine generates inside each bar, from bar data alone. Its visual trade diagnostics tool charts every closed trade on its own bars beside every value your strategy printed. The same data, settings and seed give byte-identical results every run. It costs $20 per seat per month, cancel any time.

Every answer here restates the documents that ship in the kit, which are authoritative. All questions.

Buy a licenceKey and kit by email on payment.