From

Institution

Field

Type

Open access only Cited by patents (Lens) Include non-Aachen papers (citing/cited)

Reset

Papers matching “Markov processes” 39

Sort: Relevance Cited Newest Oldest Fwci Patents ⇩ CSV

Not finding it? Sign in to also search OpenAlex live.

Optimal rates of convergence for entropy regularization in discounted Markov decision processes
2026 Information and Inference A Journal of the IMA article Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı

0

citations
On the convergence of projective-simulation–based reinforcement learning in Markov decision processes
2020 Quantum Machine Intelligence article Computer Science Quantum Computing Algorithms and Architecture Open access

Hans J. Briegel

16

citations
Life is Random, Time is Not: Markov Decision Processes with Window Objectives
2020 Logical Methods in Computer Science article Computer Science Formal Methods in Verification Open access

Thomas Brihaye, Florent Delgrange, Youssouf Oualhadj, Mickaël Randour

4

citations
Model checking hyperproperties for Markov decision processes
2022 Information and Computation article Computer Science Formal Methods in Verification Open access

Oyendrila Dobe, Erika Ábrahám, Ezio Bartocci, Borzoo Bonakdarpour

5

citations
A Compositional Semantics of Boolean-Logic Driven Markov Processes
2023 IEEE Transactions on Dependable and Secure Computing article Computer Science Formal Methods in Verification

Shahid Ali Khan, Joost-Pieter Katoen, Marc Bouissou

3

citations
The complexity of reachability in parametric Markov decision processes
2021 Journal of Computer and System Sciences article Computer Science Formal Methods in Verification Open access

Sebastian Junges, Joost-Pieter Katoen, Guillermo A. Pérez, Tobias Winkler

23

citations
Parameter synthesis for Markov models: covering the parameter space
2024 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access

Sebastian Junges, Erika Ábrahám, Christian Hensel, Nils Jansen, Joost-Pieter Katoen, Tim Quatmann, +1 more

20

citations
Markov automata with multiple objectives
2021 Formal Methods in System Design article Computer Science Formal Methods in Verification

Tim Quatmann, Sebastian Junges, Joost-Pieter Katoen

5

citations
Filter Functions for Quantum Processes under Correlated Noise
2021 Physical Review Letters article Computer Science Quantum Computing Algorithms and Architecture Open access

Pascal Cerfontaine, Tobias Hangleiter, Hendrik Bluhm

17

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 RWTH Publications (RWTH Aachen) article Computer Science Formal Methods in Verification Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Gaussian Process Panel Modeling—Machine Learning Inspired Analysis of Longitudinal Panel Data
2020 Frontiers in Psychology article Computer Science Gaussian Processes and Bayesian Inference Open access

Julian David Karch, Andreas M. Brandmaier, Manuel C. Voelkle

19

citations
The probabilistic model checker Storm
2021 International Journal on Software Tools for Technology Transfer article Computer Science Formal Methods in Verification Open access

Christian Hensel, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann, Matthias Volk

246

citations
Strategy Synthesis for POMDPs in Robot Planning via Game-Based Abstractions
2020 IEEE Transactions on Automatic Control article Computer Science Formal Methods in Verification Open access

Leonore Winterer, Sebastian Junges, Ralf Wimmer, Nils Jansen, Ufuk Topcu, Joost-Pieter Katoen, +1 more

13

citations
Generative Datalog with Continuous Distributions
2022 Journal of the ACM article Computer Science Advanced Database Systems and Queries Open access

Martin Grohe, Benjamin Lucien Kaminski, Joost-Pieter Katoen, Peter Lindner

5

citations
An Oracle-Guided Approach to Constrained Policy Synthesis Under Uncertainty
2025 Journal of Artificial Intelligence Research article Computer Science Formal Methods in Verification Open access

Roman Andriushchenko, Milan Češka, Filip Macák, Sebastian Junges, Joost-Pieter Katoen

4

citations
Finite-Time Analysis of Natural Actor-Critic for POMDPs
2024 SIAM Journal on Mathematics of Data Science article Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı, Niao He, R. Srikant

2

citations
Automated planning instance generation with neuro-symbolic AI
2025 Artificial Intelligence article Computer Science AI-based Problem Solving and Planning Open access

Carlos Núñez-Molina, Pablo Mesejo, Juan Fernández-Olivares

0

citations
Learning Adaptive Differential Evolution Algorithm From Optimization Experiences by Policy Gradient
2021 IEEE Transactions on Evolutionary Computation article Computer Science Metaheuristic Optimization Algorithms Research Open access

Jianyong Sun, Xin Liu, Thomas Bäck, Zongben Xu

145

citations
Model-based Reinforcement Learning: A Survey
2023 Foundations and Trends® in Machine Learning article Computer Science Reinforcement Learning in Robotics Open access

Thomas M. Moerland, Joost Broekens, Aske Plaat, Catholijn M. Jonker

530

citations
A Calculus for Amortized Expected Runtimes
2023 Proceedings of the ACM on Programming Languages article Computer Science Logic, programming, and type systems Open access

Kevin Batz, Benjamin Lucien Kaminski, Joost-Pieter Katoen, Christoph Matheja, Lena Verscht

22

citations
Multi-cost Bounded Tradeoff Analysis in MDP
2020 Journal of Automated Reasoning article Computer Science Formal Methods in Verification Open access

Arnd Hartmanns, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann

22

citations
Convex Optimization for Parameter Synthesis in MDPs
2021 IEEE Transactions on Automatic Control article Computer Science Formal Methods in Verification Open access

Murat Cubuktepe, Nils Jansen, Sebastian Junges, Joost-Pieter Katoen, Ufuk Topcu

21

citations
A Unifying Framework for Reinforcement Learning and Planning
2022 Frontiers in Artificial Intelligence article Computer Science Reinforcement Learning in Robotics Open access

Thomas M. Moerland, Joost Broekens, Aske Plaat, Catholijn M. Jonker

16

citations
Programmatic Strategy Synthesis: Resolving Nondeterminism in Probabilistic Programs
2024 Proceedings of the ACM on Programming Languages article Computer Science Logic, programming, and type systems Open access

Kevin Batz, Tom Jannik Biskup, Joost-Pieter Katoen, Tobias Winkler

11

citations
Stochastic games with lexicographic objectives
2023 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access

Krishnendu Chatterjee, Joost-Pieter Katoen, Stefanie Mohr, Maximilian Weininger, Tobias Winkler

5

citations