From

Institution

Field

Type

Open access only Cited by patents (Lens) Include non-Aachen papers (citing/cited)

Reset

Papers matching “Markov processes” 102

Sort: Relevance Cited Newest Oldest Fwci Patents ⇩ CSV

Not finding it? Sign in to also search OpenAlex live.

Optimal rates of convergence for entropy regularization in discounted Markov decision processes
2026 Information and Inference A Journal of the IMA article Computer Science Stochastic Gradient Optimization Techniques Open access

Semih Çaycı

0

citations
Life is Random, Time is Not: Markov Decision Processes with Window Objectives
2020 Logical Methods in Computer Science article Computer Science Formal Methods in Verification Open access

Thomas Brihaye, Florent Delgrange, Youssouf Oualhadj, Mickaël Randour

4

citations
Attribution-based Explanations for Markov Decision Processes
2026 conference-paper Computer Science Explainable Artificial Intelligence (XAI) Open access

Paul Kobialka, Andrea Pferscher, Francesco Leofante, Erika Ábrahám, Silvia Lizeth Tapia Tarifa, Einar Broch Johnsen

0

citations
Markov Decision Processes with Sure Parity and Multiple Reachability Objectives
2024 arXiv (Cornell University) preprint Computer Science AI-based Problem Solving and Planning Open access

Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler

0

citations
Model checking hyperproperties for Markov decision processes
2022 Information and Computation article Computer Science Formal Methods in Verification Open access

Oyendrila Dobe, Erika Ábrahám, Ezio Bartocci, Borzoo Bonakdarpour

5

citations
Markov Decision Processes with Sure Parity and Multiple Reachability Objectives
2024 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification

Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler

0

citations
Automated Verification of Proofs in the Universal Composability Framework with Markov Decision Processes
2025 Lecture notes in computer science conference-paper Computer Science Advanced Authentication Protocols Security

Maxim Jourenko, Marcus Völker

0

citations
The Complexity of Reachability in Parametric Markov Decision Processes
2020 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Sebastian Junges, Joost-Pieter Katoen, Guillermo A. Pérez, Tobias Winkler

10

citations
Explaining Boolean-Logic Driven Markov Processes using GSPNs
2020 European Dependable Computing Conference conference-paper Computer Science Petri Nets in System Modeling

Shahid Ali Khan, Joost-Pieter Katoen, Marc Bouissou

5

citations
The complexity of reachability in parametric Markov decision processes
2021 Journal of Computer and System Sciences article Computer Science Formal Methods in Verification Open access

Sebastian Junges, Joost-Pieter Katoen, Guillermo A. Pérez, Tobias Winkler

23

citations
Parameter synthesis in Markov models
2020 RWTH Publications (RWTH Aachen) dissertation Computer Science Formal Methods in Verification Open access

Sebastian Junges

27

citations
Parameter synthesis for Markov models: covering the parameter space
2024 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access

Sebastian Junges, Erika Ábrahám, Christian Hensel, Nils Jansen, Joost-Pieter Katoen, Tim Quatmann, +1 more

20

citations
Markov automata with multiple objectives
2021 Formal Methods in System Design article Computer Science Formal Methods in Verification

Tim Quatmann, Sebastian Junges, Joost-Pieter Katoen

5

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 arXiv (Cornell University) preprint Computer Science Bayesian Modeling and Causal Inference Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

1

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 arXiv (Cornell University) preprint Computer Science Bayesian Modeling and Causal Inference Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Filter Functions for Quantum Processes under Correlated Noise
2021 Physical Review Letters article Computer Science Quantum Computing Algorithms and Architecture Open access

Pascal Cerfontaine, Tobias Hangleiter, Hendrik Bluhm

17

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 RWTH Publications (RWTH Aachen) article Computer Science Bayesian Modeling and Causal Inference Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Multi-objective Optimization of Long-run Average and Total Rewards
2021 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Tim Quatmann, Joost-Pieter Katoen

13

citations
Multi-objective Optimization of Long-run Average and Total Rewards
2021 other Computer Science Formal Methods in Verification Open access

Tim Quatmann, Joost-Pieter Katoen

1

citations
Multi-objective Optimization of Long-run Average and Total Rewards
2020 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Tim Quatmann, Joost-Pieter Katoen

0

citations
Probabilistic Model Checking Taken by Storm
2026 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Matthias Volk, Linus Heck, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann

0

citations
Probabilistic Model Checking Taken by Storm
2026 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Matthias Volk, Linus Heck, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann

0

citations
Probabilistic Model Checking Taken by Storm
2026 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Matthias Volk, Linus Heck, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann

0

citations
Transformer-Based Direct Hidden Markov Model for Machine Translation
2021 conference-paper Computer Science Natural Language Processing Techniques Open access

Weiyue Wang, Zijian Győző Yang, Yingbo Gao, Hermann Ney

3

citations
Inductive Synthesis for Probabilistic Programs Reaches New Horizons
2021 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Roman Andriushchenko, Milan Češka, Sebastian Junges, Joost-Pieter Katoen

13

citations