From

Institution

Field

Type

Open access only Cited by patents (Lens) Include non-Aachen papers (citing/cited)

Reset

Papers matching “Markov approximation” 78

Sort: Relevance Cited Newest Oldest Fwci Patents ⇩ CSV

Not finding it? Sign in to also search OpenAlex live.

Approximation von Bediensystemen zur Leistungsfähigkeitsbestimmung von Eisenbahninfrastruktur in Bahnhöfen
2026 RWTH Publications (RWTH Aachen) article Engineering Railway Systems and Energy Efficiency Open access

Tamme Emunds, Nils Nießen

0

citations
Convergence of Entropy-Regularized Natural Policy Gradient with Linear Function Approximation
2024 SIAM Journal on Optimization article Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı, Niao He, R. Srikant

10

citations
Parameter synthesis for Markov models: covering the parameter space
2024 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access

Sebastian Junges, Erika Ábrahám, Christian Hensel, Nils Jansen, Joost-Pieter Katoen, Tim Quatmann, +1 more

20

citations
Low-rank tensor methods for Markov chains with applications to tumor progression models
2020 arXiv (Cornell University) preprint Mathematics Tensor decomposition and applications Open access

Lars Grasedyck, Maren Klever, Rudolf Schill, Rainer Spang, Tilo Wettig

0

citations
General tests of the Markov property in multi-state models
2020 Biostatistics article Mathematics Probability and Statistical Research Open access

Andrew Titman, Hein Putter

44

citations
Parameter synthesis in Markov models
2020 RWTH Publications (RWTH Aachen) dissertation Computer Science Formal Methods in Verification Open access

Sebastian Junges

27

citations
Markov chain Monte Carlo for Bayesian inference of the non-conducting region in intra-atrial reentrant tachycardia
2026 arXiv (Cornell University) preprint Mathematics Markov Chains and Monte Carlo Methods Open access

Maarten Volkaerts, Marie Cloet, Hans Dierckx, Piet Claus, Giovanni Samaey

0

citations
Low-rank tensor methods for Markov chains with applications to tumor progression models
2022 Journal of Mathematical Biology article Mathematics Tensor decomposition and applications Open access

Peter Georg, Lars Grasedyck, Maren Klever, Rudolf Schill, Rainer Spang, Tilo Wettig

10

citations
Approximate Probabilistic Bisimulation for Continuous-Time Markov Chains
2025 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Timm Spork, Christel Baier, Joost-Pieter Katoen, Sascha Klüppelholz, Jakob Piribauer

1

citations
Approximate Probabilistic Bisimulation for Continuous-Time Markov Chains
2025 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Timm Spork, Christel Baier, Joost-Pieter Katoen, Sascha Klüppelholz, Jakob Piribauer

0

citations
Analysis of a Class of Multilevel Markov Chain Monte Carlo Algorithms Based on Independent Metropolis–Hastings
2023 SIAM/ASA Journal on Uncertainty Quantification article Mathematics Markov Chains and Monte Carlo Methods Open access

Juan P. Madrigal-Cianci, Fabio Nobile, Raul F. Tempone

11

citations
Generalized Parameter Lifting: Finer Abstractions for Parametric Markov Chains
2025 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Linus Heck, Tim Quatmann, Jip Spel, Joost-Pieter Katoen, Sebastian Junges

0

citations
Parameter Synthesis in Markov Models: A Gentle Survey
2022 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Nils Jansen, Sebastian Junges, Joost-Pieter Katoen

0

citations
Independent Learning in Performative Markov Potential Games
2025 RWTH Publications (RWTH Aachen) conference-paper Computer Science Reinforcement Learning in Robotics Open access

Rilind Sahitaj, Paulius Sasnauskas, Yiğit Yalın, Debmalya Mandal, Goran Radanović

0

citations
How Quantum Evolution with Memory is Generated in a Time-Local Way
2021 RWTH Publications (RWTH Aachen) article Physics and Astronomy Quantum Mechanics and Applications Open access

24

citations
How Quantum Evolution with Memory is Generated in a Time-Local Way
2021 Physical Review X article Physics and Astronomy Advanced Thermodynamics and Statistical Mechanics Open access

21

citations
Finite-Time Analysis of Natural Actor-Critic for POMDPs
2024 SIAM Journal on Mathematics of Data Science article Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı, Niao He, R. Srikant

2

citations
Finite-Time Analysis of Natural Actor-Critic for POMDPs
2022 arXiv (Cornell University) preprint Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı, Niao He, R. Srikant

0

citations
Under-Approximating Expected Total Rewards in POMDPs
2022 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Alexander Bork, Joost-Pieter Katoen, Tim Quatmann

10

citations
Under-Approximating Expected Total Rewards in POMDPs
2022 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

Alexander Bork, Joost-Pieter Katoen, Tim Quatmann

1

citations
EpiLPS: a fast and flexible Bayesian tool for near real-time estimation of the time-varying reproduction number
2021 medRxiv preprint Mathematics COVID-19 epidemiological studies Open access

Oswaldo Gressani, Jacco Wallinga, Christian Lorenz Althaus, Niel Hens, Christel Faes

4

citations
Fermionic duality: General symmetry of open systems with strong dissipation and memory
2021 SciPost Physics article Physics and Astronomy Quantum many-body systems Open access

Valentin Bruch, Konstantin Nestmann, Jens Schulenborg, M. R. Wegewijs

2

citations
Recurrent Natural Policy Gradient for POMDPs
2024 arXiv (Cornell University) preprint Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı, Atilla Eryılmaz

0

citations
Uncertainty quantification in geological modelling by Hessian-informed MCMC
2020 conference-abstract Earth and Planetary Sciences Geological Modeling and Analysis Open access

Zhouji Liang, Florian Wellmann

0

citations
Single- and Multilevel Quadrature with Error Control for Fourier Pricing under the Rough Heston Model
2026 arXiv (Cornell University) preprint Mathematics Mathematical functions and polynomials Open access

Chiheb Ben Hammouda, Abderrahmene Ben Romdhane, Michael Samet, Raul F. Tempone

0

citations