From

Institution

Field

Type

Open access only Cited by patents (Lens) Include non-Aachen papers (citing/cited)

Reset

Papers matching “Markov processes” 46

Sort: Relevance Cited Newest Oldest Fwci Patents ⇩ CSV

Not finding it? Sign in to also search OpenAlex live.

On the continuous dependence of the stationary distribution of a piecewise deterministic Markov process on its jump intensity
2020 AIP conference proceedings conference-paper Mathematics Stochastic processes and statistical mechanics

Dawid Czapla, Sander C. Hille, Katarzyna Horbacz, Hanna Wojewódka–Ściążko

0

citations
Attribution-based Explanations for Markov Decision Processes
2026 International Joint Conference on Artificial Intelligence conference-paper Computer Science Explainable Artificial Intelligence (XAI) Open access

Paul Kobialka, Andrea Pferscher, Francesco Leofante, Erika Ábrahám, Silvia Lizeth Tapia Tarifa, Einar Broch Johnsen

0

citations
Counterfactual Strategies for Markov Decision Processes
2025 International Joint Conference on Artificial Intelligence conference-paper Computer Science Formal Methods in Verification Open access

Paul Kobialka, Lina Gerlach, Francesco Leofante, Erika Ábrahám, Silvia Lizeth Tapia Tarifa, Einar Broch Johnsen

0

citations
Markov Decision Processes with Sure Parity and Multiple Reachability Objectives
2024 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification

Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler

0

citations
Automated Verification of Proofs in the Universal Composability Framework with Markov Decision Processes
2025 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification

Maxim Jourenko, Marcus Völker

0

citations
Improved PV cleaning schedule optimization using a Markov decision process approach
2025 elib (German Aerospace Center) conference-paper Energy Photovoltaic System Optimization Techniques Open access

0

citations
Explaining Boolean-Logic Driven Markov Processes using GSPNs
2020 European Dependable Computing Conference conference-paper Computer Science Petri Nets in System Modeling

Shahid Ali Khan, Joost-Pieter Katoen, Marc Bouissou

5

citations
Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families
2026 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Milan Češka, Sebastian Junges, Luko van der Maas, Filip Macák, Tim Quatmann

0

citations
Multi-Process Stochastic Multipath Model for Terrestrial Radionavigation Systems in Aviation
2025 IEEE/ION Position Location and Navigation Symposium conference-paper Engineering GNSS positioning and interference

Gianluca Zampieri, Gary A. McGraw, Omar García Crespillo, Michael Meurer

0

citations
Multi-objective Optimization of Long-run Average and Total Rewards
2021 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Tim Quatmann, Joost-Pieter Katoen

13

citations
Probabilistic Model Checking Taken by Storm
2026 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Matthias Volk, Linus Heck, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann

0

citations
Transformer-Based Direct Hidden Markov Model for Machine Translation
2021 conference-paper Computer Science Natural Language Processing Techniques Open access

Weiyue Wang, Zijian Győző Yang, Yingbo Gao, Hermann Ney

3

citations
Inductive Synthesis for Probabilistic Programs Reaches New Horizons
2021 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Roman Andriushchenko, Milan Češka, Sebastian Junges, Joost-Pieter Katoen

13

citations
Learning Generalized Stochastic Petri Nets From Event Data
2024 Lecture notes in computer science conference-paper Business, Management and Accounting Business Process Modeling and Analysis

Wil M. P. van der Aalst, Sander J. J. Leemans

4

citations
Learning Explainable and Better Performing Representations of POMDP Strategies
2024 Lecture notes in computer science conference-paper Computer Science Reinforcement Learning in Robotics Open access

Alexander Bork, Debraj Chakraborty, Kush Grover, Jan Křetínský, Stefanie Mohr

5

citations
Under-Approximating Expected Total Rewards in POMDPs
2022 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Alexander Bork, Joost-Pieter Katoen, Tim Quatmann

10

citations
Generative Datalog with Continuous Distributions
2020 ACM SIGMOD-SIGACT-SIGAI Symposium on Principles of Database Systems (PODS) conference-paper Computer Science Advanced Database Systems and Queries

Martin Grohe, Benjamin Lucien Kaminski, Joost-Pieter Katoen, Peter Lindner

7

citations
A Unified Approach to Autonomous Driving in a High-Fidelity Simulator Using Vision-Based Reinforcement Learning
2024 IEEE/SICE International Symposium on System Integration (SII) conference-paper Engineering Autonomous Vehicle Technology and Safety

Shawan Taha Mohammed, Alp Argun, Gerd Ascheid

3

citations
Reasoning on Labelled Petri Nets and Their Dynamics in a Stochastic Setting
2022 Lecture notes in computer science conference-paper Computer Science Petri Nets in System Modeling Open access

Sander J. J. Leemans, Fabrizio Maria Maggi, Marco Montali

13

citations
Tools at the Frontiers of Quantitative Verification
2024 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Roman Andriushchenko, Alexander Bork, Carlos E. Budde, Milan Češka, Kush Grover, Ernst Moritz Hahn, +16 more

9

citations
HyperProb: A Model Checker for Probabilistic Hyperproperties
2021 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification

Oyendrila Dobe, Erika Ábrahám, Ezio Bartocci, Borzoo Bonakdarpour

9

citations
A Practitioner’s Guide to MDP Model Checking Algorithms
2023 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Arnd Hartmanns, Sebastian Junges, Tim Quatmann, Maximilian Weininger

35

citations
Simple Strategies in Multi-Objective MDPs
2020 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Florent Delgrange, Joost-Pieter Katoen, Tim Quatmann, Mickaël Randour

29

citations
Scenario-Based Verification of Uncertain MDPs
2020 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Murat Cubuktepe, Nils Jansen, Sebastian Junges, Joost-Pieter Katoen, Ufuk Topcu

20

citations
Fixed Point Certificates for Reachability and Expected Rewards in MDPs
2025 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

Krishnendu Chatterjee, Tim Quatmann, Maximilian Schäffeler, Maximilian Weininger, Tobias Winkler, Daniel Zilken

6

citations