From

Institution

Field

Type

Open access only Cited by patents (Lens) Include non-Aachen papers (citing/cited)

Reset

Papers matching “Markov decision process” 117

Sort: Relevance Cited Newest Oldest Fwci Patents ⇩ CSV

Not finding it? Sign in to also search OpenAlex live.

Counterfactual Strategies for Markov Decision Processes
2025 International Joint Conference on Artificial Intelligence conference-paper Computer Science Formal Methods in Verification Open access

Paul Kobialka, Lina Gerlach, Francesco Leofante, Erika Ábrahám, Silvia Lizeth Tapia Tarifa, Einar Broch Johnsen

0

citations
Attribution-based Explanations for Markov Decision Processes
2026 International Joint Conference on Artificial Intelligence conference-paper Computer Science Explainable Artificial Intelligence (XAI) Open access

Paul Kobialka, Andrea Pferscher, Francesco Leofante, Erika Ábrahám, Silvia Lizeth Tapia Tarifa, Einar Broch Johnsen

0

citations
Optimal rates of convergence for entropy regularization in discounted Markov decision processes
2026 Information and Inference A Journal of the IMA article Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı

0

citations
On the convergence of projective-simulation–based reinforcement learning in Markov decision processes
2020 Quantum Machine Intelligence article Computer Science Quantum Computing Algorithms and Architecture Open access

Hans J. Briegel

16

citations
Life is Random, Time is Not: Markov Decision Processes with Window Objectives
2020 Logical Methods in Computer Science article Computer Science Formal Methods in Verification Open access

Thomas Brihaye, Florent Delgrange, Youssouf Oualhadj, Mickaël Randour

4

citations
Markov Decision Processes with Sure Parity and Multiple Reachability Objectives
2024 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler

0

citations
Model checking hyperproperties for Markov decision processes
2022 Information and Computation article Computer Science Formal Methods in Verification Open access

Oyendrila Dobe, Erika Ábrahám, Ezio Bartocci, Borzoo Bonakdarpour

5

citations
Automated Verification of Proofs in the Universal Composability Framework with Markov Decision Processes
2025 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification

Maxim Jourenko, Marcus Völker

0

citations
Markov Decision Processes with Sure Parity and Multiple Reachability Objectives
2024 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification

Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler

0

citations
The Complexity of Reachability in Parametric Markov Decision Processes
2020 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Sebastian Junges, Joost-Pieter Katoen, Guillermo A. Pérez, Tobias Winkler

10

citations
Parameter synthesis for Markov models: covering the parameter space
2024 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access

Sebastian Junges, Erika Ábrahám, Christian Hensel, Nils Jansen, Joost-Pieter Katoen, Tim Quatmann, +1 more

20

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

1

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Verification of Multi-Objective Markov Models: Replication Package
2023 Zenodo (CERN European Organization for Nuclear Research) dataset Computer Science Formal Methods in Verification Open access

Tim Quatmann

0

citations
Verification of Multi-Objective Markov Models: Replication Package
2023 Zenodo (CERN European Organization for Nuclear Research) dataset Computer Science Formal Methods in Verification Open access

Tim Quatmann

0

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 RWTH Publications (RWTH Aachen) article Computer Science Formal Methods in Verification Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Parameter synthesis in Markov models
2020 RWTH Publications (RWTH Aachen) dissertation Computer Science Formal Methods in Verification Open access

Sebastian Junges

27

citations
Multi-objective Optimization of Long-run Average and Total Rewards
2021 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Tim Quatmann, Joost-Pieter Katoen

13

citations
Multi-objective Optimization of Long-run Average and Total Rewards
2021 other Computer Science Formal Methods in Verification Open access

Tim Quatmann, Joost-Pieter Katoen

1

citations
Multi-objective Optimization of Long-run Average and Total Rewards
2020 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Tim Quatmann, Joost-Pieter Katoen

0

citations
Artifact for "Probabilistic Model Checking Taken by Storm"
2026 Radboud Repository (Radboud University) dataset Computer Science Formal Methods in Verification Open access

Matthias Volk, Linus Heck, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann

0

citations
Artifact for "Probabilistic Model Checking Taken by Storm"
2026 Zenodo (CERN European Organization for Nuclear Research) dataset Computer Science Formal Methods in Verification Open access

Matthias Volk, Linus Heck, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann

0

citations
Probabilistic Model Checking Taken by Storm
2026 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Matthias Volk, Linus Heck, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann

0

citations
Probabilistic Model Checking Taken by Storm
2026 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Matthias Volk, Linus Heck, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann

0

citations