From

Institution

Field

Type

Open access only Cited by patents (Lens) Include non-Aachen papers (citing/cited)

Reset

Papers matching “Markov processes” 193

Sort: Relevance Cited Newest Oldest Fwci Patents ⇩ CSV

Not finding it? Sign in to also search OpenAlex live.

Optimal rates of convergence for entropy regularization in discounted Markov decision processes
2026 Information and Inference A Journal of the IMA article Computer Science Stochastic Gradient Optimization Techniques Open access

Semih Çaycı

0

citations
Life is Random, Time is Not: Markov Decision Processes with Window Objectives
2020 Logical Methods in Computer Science article Computer Science Formal Methods in Verification Open access

Thomas Brihaye, Florent Delgrange, Youssouf Oualhadj, Mickaël Randour

4

citations
Counterfactual Strategies for Markov Decision Processes
2025 conference-paper Decision Sciences Simulation Techniques and Applications Open access

Paul Kobialka, Lina Gerlach, Francesco Leofante, Erika Ábrahám, Silvia Lizeth Tapia Tarifa, Einar Broch Johnsen

0

citations
Attribution-based Explanations for Markov Decision Processes
2026 conference-paper Computer Science Explainable Artificial Intelligence (XAI) Open access

Paul Kobialka, Andrea Pferscher, Francesco Leofante, Erika Ábrahám, Silvia Lizeth Tapia Tarifa, Einar Broch Johnsen

0

citations
Markov Decision Processes with Sure Parity and Multiple Reachability Objectives
2024 arXiv (Cornell University) preprint Computer Science AI-based Problem Solving and Planning Open access

Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler

0

citations
Model checking hyperproperties for Markov decision processes
2022 Information and Computation article Computer Science Formal Methods in Verification Open access

Oyendrila Dobe, Erika Ábrahám, Ezio Bartocci, Borzoo Bonakdarpour

5

citations
Markov Decision Processes with Sure Parity and Multiple Reachability Objectives
2024 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification

Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler

0

citations
Automated Verification of Proofs in the Universal Composability Framework with Markov Decision Processes
2025 Lecture notes in computer science conference-paper Computer Science Advanced Authentication Protocols Security

Maxim Jourenko, Marcus Völker

0

citations
Comparison of estimators for multi-state models in potentially non-Markov processes
2027 Computational Statistics & Data Analysis article Decision Sciences Advanced Statistical Process Monitoring Open access

Carolin Drenda, Merle Munko, Dennis Dobler, Andrew Titman

0

citations
A Compositional Semantics of Boolean-Logic Driven Markov Processes
2023 IEEE Transactions on Dependable and Secure Computing article Engineering Safety Systems Engineering in Autonomy

Shahid Ali Khan, Joost-Pieter Katoen, Marc Bouissou

3

citations
Improved PV cleaning schedule optimization using a Markov decision process approach
2025 elib (German Aerospace Center) conference-paper Energy Photovoltaic System Optimization Techniques Open access

0

citations
The Complexity of Reachability in Parametric Markov Decision Processes
2020 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Sebastian Junges, Joost-Pieter Katoen, Guillermo A. Pérez, Tobias Winkler

10

citations
Explaining Boolean-Logic Driven Markov Processes using GSPNs
2020 European Dependable Computing Conference conference-paper Computer Science Petri Nets in System Modeling

Shahid Ali Khan, Joost-Pieter Katoen, Marc Bouissou

5

citations
Modeling Stem Cell Fates using Non-Markov Processes
2021 Cell stem cell article Biochemistry, Genetics and Molecular Biology Single-cell and spatial transcriptomics Open access

Patrick S. Stumpf, Fumio Arai, Ben D. MacArthur

0

citations
The complexity of reachability in parametric Markov decision processes
2021 Journal of Computer and System Sciences article Computer Science Formal Methods in Verification Open access

Sebastian Junges, Joost-Pieter Katoen, Guillermo A. Pérez, Tobias Winkler

23

citations
Statistical testing for sufficient control chart performances during monitoring of grouped processes
2021 Quality and Reliability Engineering International article Decision Sciences Advanced Statistical Process Monitoring Open access

Kevin Nikolai Kostyszyn, Tobias Claus Brandstätter, Thomas R. Vollmer, Robert Heinrich Schmitt

2

citations
Parameter synthesis in Markov models
2020 RWTH Publications (RWTH Aachen) dissertation Computer Science Formal Methods in Verification Open access

Sebastian Junges

27

citations
Low-rank tensor methods for Markov chains with applications to tumor progression models
2020 arXiv (Cornell University) preprint Mathematics Tensor decomposition and applications Open access

Lars Grasedyck, Maren Klever, Rudolf Schill, Rainer Spang, Tilo Wettig

0

citations
Parameter synthesis for Markov models: covering the parameter space
2024 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access

Sebastian Junges, Erika Ábrahám, Christian Hensel, Nils Jansen, Joost-Pieter Katoen, Tim Quatmann, +1 more

20

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 Lecture notes in computer science conference-paper Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Markov automata with multiple objectives
2021 Formal Methods in System Design article Computer Science Formal Methods in Verification

Tim Quatmann, Sebastian Junges, Joost-Pieter Katoen

5

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 arXiv (Cornell University) preprint Computer Science Bayesian Modeling and Causal Inference Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

1

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 arXiv (Cornell University) preprint Computer Science Bayesian Modeling and Causal Inference Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Filter Functions for Quantum Processes under Correlated Noise
2021 Physical Review Letters article Computer Science Quantum Computing Algorithms and Architecture Open access

Pascal Cerfontaine, Tobias Hangleiter, Hendrik Bluhm

17

citations
Artefact for: "Non-Deterministic GSPNs: A Robust Approach to Stochastic Business Process Analysis"
2026 Zenodo (CERN European Organization for Nuclear Research) software Open access

Jan-Gustav Michnia

0

citations