Markov Chains and the Markov Property foundational

How a state representation can compress history into current conditions, and why that matters for regime models and decision processes.

How a state representation can compress history into current conditions, and why that matters for regime models and decision processes.

Register to Read

Sign up for a free account to access all 112 primer topics.

Create Free Account

Already have an account? Sign in

References

A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle
James D. Hamilton (1989) — Econometrica
Recent Advances in Reinforcement Learning in Finance
Ben Hambly, Renyuan Xu, Huining Yang (2023)