April 15, 1994 book Markov Decision Processes Wiley series in probability and statistics DOI: 10.1002/9780470316887 OpenAlex Authors 0 Author list not loaded yet. Cited by 41 stored of 6,073 Search Sort Most cited Newest Oldest Patent citations Title Any typearticle review book-chapter conference-paper preprint dissertation book dataset other Any fieldAgricultural and Biological Sciences Arts and Humanities Biochemistry, Genetics and Molecular Biology Business, Management and Accounting Chemical Engineering Chemistry Computer Science Decision Sciences Dentistry Earth and Planetary Sciences Economics, Econometrics and Finance Energy Engineering Environmental Science Health Professions Immunology and Microbiology Materials Science Mathematics Medicine Neuroscience Nursing Pharmacology, Toxicology and Pharmaceutics Physics and Astronomy Psychology Social Sciences Veterinary Open access The revised practitioner’s guide to MDP model checking algorithms 2026 International Journal on Software Tools for Technology Transfer article Computer Science Formal Methods in Verification Open access 1 citations A Note on Piecewise Affine Decision Rules for Robust, Stochastic, and Data-Driven Optimization 2026 Operations Research article Decision Sciences Risk and Portfolio Optimization Open access 0 citations Search and explore: symbiotic policy synthesis in POMDPs 2026 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access 1 citations Highly Incremental: A Simple Programmatic Approach for Many Objectives 2026 Lecture notes in computer science conference-paper Computer Science Logic, programming, and type systems Open access 1 citations Multiple Long-Run and $$\omega $$-Regular Objectives in MDPs 2026 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access 0 citations Probabilistic Model Checking Taken by Storm 2026 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access 0 citations Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families 2026 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access 0 citations Deviation matrix in denumerable Markov processes: Characterisation, rank-one perturbation and restart 2025 The Annals of Applied Probability article Mathematics Probability and Statistical Research Open access 0 citations Computing Expected Visiting Times and Stationary Distributions in Markov Chains: Fast and Accurate 2025 Journal of Automated Reasoning article Computer Science Formal Methods in Verification Open access 3 citations What is the best algorithm for MDP model checking? 2025 International Journal on Software Tools for Technology Transfer article Computer Science Formal Methods in Verification Open access 2 citations Fixed Point Certificates for Reachability and Expected Rewards in MDPs 2025 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access 6 citations Efficient Probabilistic Model Checking for Relational Reachability 2025 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access 3 citations J-P: MDP. FP. PP 2024 Lecture notes in computer science conference-paper Computer Science Logic, programming, and type systems Open access 2 citations Tools at the Frontiers of Quantitative Verification 2024 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access 9 citations Learning to select the recombination operator for derivative-free optimization 2024 Science China Mathematics article Computer Science Metaheuristic Optimization Algorithms Research Open access 6 citations Parameter synthesis for Markov models: covering the parameter space 2024 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access 20 citations Programmatic Strategy Synthesis: Resolving Nondeterminism in Probabilistic Programs 2024 Proceedings of the ACM on Programming Languages article Computer Science Logic, programming, and type systems Open access 11 citations Accurately Computing Expected Visiting Times and Stationary Distributions in Markov Chains 2024 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access 2 citations Markov Decision Processes with Sure Parity and Multiple Reachability Objectives 2024 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification 0 citations A Practitioner’s Guide to MDP Model Checking Algorithms 2023 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access 35 citations 1–20 of 41 Page 1 / 3 Next → References 0