From

Institution

Field

Type

Open access only Cited by patents (Lens) Include non-Aachen papers (citing/cited)

Reset

Papers matching “Markov approximation” 22

Sort: Relevance Cited Newest Oldest Fwci Patents ⇩ CSV

Not finding it? Sign in to also search OpenAlex live.

Convergence of Entropy-Regularized Natural Policy Gradient with Linear Function Approximation
2024 SIAM Journal on Optimization article Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı, Niao He, R. Srikant

10

citations
Parameter synthesis for Markov models: covering the parameter space
2024 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access

Sebastian Junges, Erika Ábrahám, Christian Hensel, Nils Jansen, Joost-Pieter Katoen, Tim Quatmann, +1 more

20

citations
Parameter synthesis in Markov models
2020 RWTH Publications (RWTH Aachen) dissertation Computer Science Formal Methods in Verification Open access

Sebastian Junges

27

citations
Approximate Probabilistic Bisimulation for Continuous-Time Markov Chains
2025 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Timm Spork, Christel Baier, Joost-Pieter Katoen, Sascha Klüppelholz, Jakob Piribauer

1

citations
Approximate Probabilistic Bisimulation for Continuous-Time Markov Chains
2025 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Timm Spork, Christel Baier, Joost-Pieter Katoen, Sascha Klüppelholz, Jakob Piribauer

0

citations
Generalized Parameter Lifting: Finer Abstractions for Parametric Markov Chains
2025 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Linus Heck, Tim Quatmann, Jip Spel, Joost-Pieter Katoen, Sebastian Junges

0

citations
Independent Learning in Performative Markov Potential Games
2025 RWTH Publications (RWTH Aachen) conference-paper Computer Science Reinforcement Learning in Robotics Open access

Rilind Sahitaj, Paulius Sasnauskas, Yiğit Yalın, Debmalya Mandal, Goran Radanović

0

citations
Parameter Synthesis in Markov Models: A Gentle Survey
2022 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Nils Jansen, Sebastian Junges, Joost-Pieter Katoen

0

citations
Finite-Time Analysis of Natural Actor-Critic for POMDPs
2024 SIAM Journal on Mathematics of Data Science article Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı, Niao He, R. Srikant

2

citations
Finite-Time Analysis of Natural Actor-Critic for POMDPs
2022 arXiv (Cornell University) preprint Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı, Niao He, R. Srikant

0

citations
Under-Approximating Expected Total Rewards in POMDPs
2022 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Alexander Bork, Joost-Pieter Katoen, Tim Quatmann

10

citations
Under-Approximating Expected Total Rewards in POMDPs
2022 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Alexander Bork, Joost-Pieter Katoen, Tim Quatmann

1

citations
Recurrent Natural Policy Gradient for POMDPs
2024 arXiv (Cornell University) preprint Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı, Atilla Eryılmaz

0

citations
Strategy Synthesis for POMDPs in Robot Planning via Game-Based Abstractions
2020 IEEE Transactions on Automatic Control article Computer Science Formal Methods in Verification Open access

Leonore Winterer, Sebastian Junges, Ralf Wimmer, Nils Jansen, Ufuk Topcu, Joost-Pieter Katoen, +1 more

13

citations
What is the best algorithm for MDP model checking?
2025 International Journal on Software Tools for Technology Transfer article Computer Science Formal Methods in Verification Open access

Tim Quatmann

2

citations
Reasoning about Parameterized Recursive Quantum Programs with Ancilla Data and Probabilistic Control
2026 ACM Transactions on Computational Logic article Computer Science Logic, programming, and type systems Open access

Dominique Unruh, Benoît Valiron, Mingsheng Ying

0

citations
Robust Shielding for Safe Reinforcement Learning
2026 arXiv (Cornell University) preprint Computer Science Reinforcement Learning in Robotics Open access

Edwin Hamel-De le Court, Thom Badings, Alessandro Abate, Francesco Belardinelli, Francesco Fabiano

0

citations
A Spectrum of Approximate Probabilistic Bisimulations
2024 RWTH Publications (RWTH Aachen) conference-paper Computer Science Formal Methods in Verification Open access

Timm Spork, Christel Baier, Joost-Pieter Katoen, Jakob Piribauer, Tim Quatmann

2

citations
Gaussian Process Panel Modeling—Machine Learning Inspired Analysis of Longitudinal Panel Data
2020 Frontiers in Psychology article Computer Science Gaussian Processes and Bayesian Inference Open access

Julian David Karch, Andreas M. Brandmaier, Manuel C. Voelkle

19

citations
Filter Functions for Quantum Processes under Correlated Noise
2021 Physical Review Letters article Computer Science Quantum Computing Algorithms and Architecture Open access

Pascal Cerfontaine, Tobias Hangleiter, Hendrik Bluhm

17

citations
BayesMultiMode : Bayesian Mode Inference in R
2026 Journal of Statistical Software article Computer Science Bayesian Methods and Mixture Models Open access

Nalan Baştürk, Jamie L. Cross, Peter de Knijff, Lennart F. Hoogerheide, Paul Labonne, Herman K. van Dijk

0

citations
One More Time: Revisiting Neural Quantum States from a Reinforcement Learning Perspective
2026 arXiv (Cornell University) preprint Computer Science Quantum Computing Algorithms and Architecture Open access

Juan Agustin Duque, Sergio García Heredia, Vinicius Hernandes, Eliška Greplová, Thomas Spriggs, Aaron Courville, +1 more

0

citations

22 results