From

Institution

Field

Type

Open access only Cited by patents (Lens) Include non-Aachen papers (citing/cited)

Reset

Papers matching “Markov decision process” 126

Sort: Relevance Cited Newest Oldest Fwci Patents ⇩ CSV

Not finding it? Sign in to also search OpenAlex live.

Improved PV cleaning schedule optimization using a Markov decision process approach
2025 elib (German Aerospace Center) conference-paper Energy Photovoltaic System Optimization Techniques Open access

0

citations
Counterfactual Strategies for Markov Decision Processes
2025 conference-paper Decision Sciences Simulation Techniques and Applications Open access

Paul Kobialka, Lina Gerlach, Francesco Leofante, Erika Ábrahám, Silvia Lizeth Tapia Tarifa, Einar Broch Johnsen

0

citations
Attribution-based Explanations for Markov Decision Processes
2026 conference-paper Computer Science Explainable Artificial Intelligence (XAI) Open access

Paul Kobialka, Andrea Pferscher, Francesco Leofante, Erika Ábrahám, Silvia Lizeth Tapia Tarifa, Einar Broch Johnsen

0

citations
Optimal rates of convergence for entropy regularization in discounted Markov decision processes
2026 Information and Inference A Journal of the IMA article Computer Science Stochastic Gradient Optimization Techniques Open access

Semih Çaycı

0

citations
Life is Random, Time is Not: Markov Decision Processes with Window Objectives
2020 Logical Methods in Computer Science article Computer Science Formal Methods in Verification Open access

Thomas Brihaye, Florent Delgrange, Youssouf Oualhadj, Mickaël Randour

4

citations
Markov Decision Processes with Sure Parity and Multiple Reachability Objectives
2024 arXiv (Cornell University) preprint Computer Science AI-based Problem Solving and Planning Open access

Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler

0

citations
Model checking hyperproperties for Markov decision processes
2022 Information and Computation article Computer Science Formal Methods in Verification Open access

Oyendrila Dobe, Erika Ábrahám, Ezio Bartocci, Borzoo Bonakdarpour

5

citations
Markov Decision Processes with Sure Parity and Multiple Reachability Objectives
2024 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification

Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler

0

citations
Automated Verification of Proofs in the Universal Composability Framework with Markov Decision Processes
2025 Lecture notes in computer science conference-paper Computer Science Advanced Authentication Protocols Security

Maxim Jourenko, Marcus Völker

0

citations
The Complexity of Reachability in Parametric Markov Decision Processes
2020 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Sebastian Junges, Joost-Pieter Katoen, Guillermo A. Pérez, Tobias Winkler

10

citations
Parameter synthesis for Markov models: covering the parameter space
2024 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access

Sebastian Junges, Erika Ábrahám, Christian Hensel, Nils Jansen, Joost-Pieter Katoen, Tim Quatmann, +1 more

20

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 Lecture notes in computer science conference-paper Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 arXiv (Cornell University) preprint Computer Science Bayesian Modeling and Causal Inference Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

1

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 arXiv (Cornell University) preprint Computer Science Bayesian Modeling and Causal Inference Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Artefact for: "Non-Deterministic GSPNs: A Robust Approach to Stochastic Business Process Analysis"
2026 Zenodo (CERN European Organization for Nuclear Research) software Open access

Jan-Gustav Michnia

0

citations
Artefact for: "Non-Deterministic GSPNs: A Robust Approach to Stochastic Business Process Analysis"
2026 Zenodo (CERN European Organization for Nuclear Research) software Open access

Jan-Gustav Michnia

0

citations
Verification of Multi-Objective Markov Models: Replication Package
2023 Zenodo (CERN European Organization for Nuclear Research) dataset Decision Sciences Simulation Techniques and Applications Open access

Tim Quatmann

0

citations
Verification of Multi-Objective Markov Models: Replication Package
2023 Zenodo (CERN European Organization for Nuclear Research) dataset Decision Sciences Simulation Techniques and Applications Open access

Tim Quatmann

0

citations
Artifact of "Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families"
2026 Zenodo (CERN European Organization for Nuclear Research) software Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

1

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 RWTH Publications (RWTH Aachen) article Computer Science Bayesian Modeling and Causal Inference Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Artifact of "Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families"
2026 Zenodo (CERN European Organization for Nuclear Research) software Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Artifact of "Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families"
2026 Zenodo (CERN European Organization for Nuclear Research) software Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Artifact of "Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families"
2026 Zenodo (CERN European Organization for Nuclear Research) software Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Parameter synthesis in Markov models
2020 RWTH Publications (RWTH Aachen) dissertation Computer Science Formal Methods in Verification Open access

Sebastian Junges

27

citations
Multi-objective Optimization of Long-run Average and Total Rewards
2021 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Tim Quatmann, Joost-Pieter Katoen

13

citations