From

Institution

Field

Type

Open access only Cited by patents (Lens) Include non-Aachen papers (citing/cited)

Reset

Papers matching “Markov decision process” 42

Sort: Relevance Cited Newest Oldest Fwci Patents ⇩ CSV

Not finding it? Sign in to also search OpenAlex live.

A hierarchical partially observable Markov decision process framework for tunnel boring machine trajectory navigation
2025 Engineering Applications of Artificial Intelligence article Engineering Tunneling and Rock Mechanics

Xiaohan Wei, Qing Zhang, Thomas Bäck, Hao Wang

0

citations
Optimal investment strategy on data analytics capabilities of startups via Markov decision analysis
2024 Decision Analytics Journal article Business, Management and Accounting Big Data and Business Intelligence Open access

Maarten Voorneveld, Maurits de Groot

5

citations
Optimal rates of convergence for entropy regularization in discounted Markov decision processes
2026 Information and Inference A Journal of the IMA article Computer Science Reinforcement Learning in Robotics Open access

Semih Çaycı

0

citations
On the convergence of projective-simulation–based reinforcement learning in Markov decision processes
2020 Quantum Machine Intelligence article Computer Science Quantum Computing Algorithms and Architecture Open access

Hans J. Briegel

16

citations
Life is Random, Time is Not: Markov Decision Processes with Window Objectives
2020 Logical Methods in Computer Science article Computer Science Formal Methods in Verification Open access

Thomas Brihaye, Florent Delgrange, Youssouf Oualhadj, Mickaël Randour

4

citations
Model checking hyperproperties for Markov decision processes
2022 Information and Computation article Computer Science Formal Methods in Verification Open access

Oyendrila Dobe, Erika Ábrahám, Ezio Bartocci, Borzoo Bonakdarpour

5

citations
Parameter synthesis for Markov models: covering the parameter space
2024 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access

Sebastian Junges, Erika Ábrahám, Christian Hensel, Nils Jansen, Joost-Pieter Katoen, Tim Quatmann, +1 more

20

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 RWTH Publications (RWTH Aachen) article Computer Science Formal Methods in Verification Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
The probabilistic model checker Storm
2021 International Journal on Software Tools for Technology Transfer article Computer Science Formal Methods in Verification Open access

Christian Hensel, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann, Matthias Volk

246

citations
Model-based Reinforcement Learning: A Survey
2023 Foundations and Trends® in Machine Learning article Computer Science Reinforcement Learning in Robotics Open access cited by 2 patents

Thomas M. Moerland, Joost Broekens, Aske Plaat, Catholijn M. Jonker

530

citations
Multi-cost Bounded Tradeoff Analysis in MDP
2020 Journal of Automated Reasoning article Computer Science Formal Methods in Verification Open access

Arnd Hartmanns, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann

22

citations
A Unifying Framework for Reinforcement Learning and Planning
2022 Frontiers in Artificial Intelligence article Computer Science Reinforcement Learning in Robotics Open access cited by 1 patent

Thomas M. Moerland, Joost Broekens, Aske Plaat, Catholijn M. Jonker

16

citations
Modeling Cognitive-Affective Processes With Appraisal and Reinforcement Learning
2024 IEEE Transactions on Affective Computing article Neuroscience Neural and Behavioral Psychology Studies Open access

Joost Broekens, Jussi Jokinen

15

citations
UAV-Assisted MEC System With Mobile Ground Terminals: DRL-Based Joint Terminal Scheduling and UAV 3D Trajectory Design
2024 IEEE Transactions on Vehicular Technology article Engineering UAV Applications and Optimization

Yunfei Gao, Xiaopeng Yuan, Dingcheng Yang, Yulin Hu, Yue Cao, Anke Schmeink

86

citations
Automated planning instance generation with neuro-symbolic AI
2025 Artificial Intelligence article Computer Science AI-based Problem Solving and Planning Open access

Carlos Núñez-Molina, Pablo Mesejo, Juan Fernández-Olivares

0

citations
Stochastic games with lexicographic objectives
2023 Formal Methods in System Design article Computer Science Formal Methods in Verification Open access

Krishnendu Chatterjee, Joost-Pieter Katoen, Stefanie Mohr, Maximilian Weininger, Tobias Winkler

5

citations
BSAC-CoEx: Coexistence of URLLC and Distributed Learning Services via Device Selection
2025 IEEE Transactions on Network and Service Management article Computer Science IoT and Edge/Fog Computing

Milad Ganjalizadeh, Hossein Shokri‐Ghadikolaei, Denız Gündüz, Marina Petrova

1

citations
Learning Adaptive Differential Evolution Algorithm From Optimization Experiences by Policy Gradient
2021 IEEE Transactions on Evolutionary Computation article Computer Science Metaheuristic Optimization Algorithms Research Open access

Jianyong Sun, Xin Liu, Thomas Bäck, Zongben Xu

145

citations
An offline multi‐scale unsaturated poromechanics model enabled by self‐designed/self‐improved neural networks
2021 International Journal for Numerical and Analytical Methods in Geomechanics article Engineering Soil and Unsaturated Flow

Yousef Heider, Hyoung Suk Suh, WaiChing Sun

36

citations
Development and validation of a reinforcement learning algorithm to dynamically optimize mechanical ventilation in critical care
2021 npj Digital Medicine article Medicine Respiratory Support and Mechanisms Open access

Arne Peine, Ahmed Hallawa, Johannes Bickenbach, Guido Dartmann, Lejla Begic Fazlic, Anke Schmeink, +7 more

150

citations
A Calculus for Amortized Expected Runtimes
2023 Proceedings of the ACM on Programming Languages article Computer Science Logic, programming, and type systems Open access

Kevin Batz, Benjamin Lucien Kaminski, Joost-Pieter Katoen, Christoph Matheja, Lena Verscht

22

citations
Convex Optimization for Parameter Synthesis in MDPs
2021 IEEE Transactions on Automatic Control article Computer Science Formal Methods in Verification Open access

Murat Cubuktepe, Nils Jansen, Sebastian Junges, Joost-Pieter Katoen, Ufuk Topcu

21

citations
Programmatic Strategy Synthesis: Resolving Nondeterminism in Probabilistic Programs
2024 Proceedings of the ACM on Programming Languages article Computer Science Logic, programming, and type systems Open access

Kevin Batz, Tom Jannik Biskup, Joost-Pieter Katoen, Tobias Winkler

11

citations
Human-in-the-loop control strategy for IoT-based smart thermostats with Deep Reinforcement Learning
2025 Energy and AI article Engineering Building Energy and Comfort Optimization Open access

Payam Fatehi Karjou, Fabian Stupperich, Phillip Stoffel, Dirk Müller

7

citations
What is the best algorithm for MDP model checking?
2025 International Journal on Software Tools for Technology Transfer article Computer Science Formal Methods in Verification Open access

Tim Quatmann

2

citations