Markov Decision Processes: Discrete Stochastic Dynamic Programming.

• Search and Explore: Symbiotic Policy Synthesis in POMDPs

  2024 Research Square preprint Computer Science Formal Methods in Verification Open access

  1

  citations
• Automatically Finding the Right Probabilities in Bayesian Networks

  2023 Journal of Artificial Intelligence Research article Computer Science Bayesian Modeling and Causal Inference Open access

  8

  citations
• Model-based Reinforcement Learning: A Survey

  2023 Foundations and Trends® in Machine Learning article Computer Science Reinforcement Learning in Robotics Open access cited by 2 patents

  530

  citations
• Experiments for 'Scenario-Based Verification of Uncertain Parametric MDPs'

  2022 Data Archiving and Networked Services (DANS) dataset Computer Science Formal Methods in Verification Open access

  16

  citations
• Convex Optimization for Parameter Synthesis in MDPs

  2021 IEEE Transactions on Automatic Control article Computer Science Formal Methods in Verification Open access

  21

  citations
• Synthesizing optimal bias in randomized self-stabilization

  2021 Distributed Computing article Computer Science Distributed systems and fault tolerance Open access

  3

  citations
• Inductive Synthesis for Probabilistic Programs Reaches New Horizons

  2021 other Computer Science Formal Methods in Verification

  2

  citations
• Inferring Expected Runtimes of Probabilistic Integer Programs Using Expected Sizes

  2021 other Computer Science Logic, programming, and type systems

  2

  citations
• The complexity of reachability in parametric Markov decision processes

  2021 Journal of Computer and System Sciences article Computer Science Formal Methods in Verification Open access

  23

  citations
• Inductive Synthesis for Probabilistic Programs Reaches New Horizons

  2021 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

  13

  citations
• Latticed k-Induction with an Application to Probabilistic Programs

  2021 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

  21

  citations
• Inferring Expected Runtimes of Probabilistic Integer Programs Using Expected Sizes

  2021 Lecture notes in computer science conference-paper Computer Science Logic, programming, and type systems Open access

  20

  citations
• Tweaking the Odds in Probabilistic Timed Automata

  2021 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

  4

  citations
• The Complexity of Reachability in Parametric Markov Decision Processes

  2020 arXiv (Cornell University) preprint Computer Science Formal Methods in Verification Open access

  10

  citations
• Parameter synthesis in Markov models

  2020 RWTH Publications (RWTH Aachen) dissertation Computer Science Formal Methods in Verification Open access

  27

  citations
• PrIC3: Property Directed Reachability for MDPs

  2020 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

  15

  citations
• Scenario-Based Verification of Uncertain MDPs

  2020 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

  20

  citations
• Approximating Values of Generalized-Reachability Stochastic Games

  2020 RWTH Publications (RWTH Aachen) conference-paper Computer Science Formal Methods in Verification Open access

  14

  citations
• Stochastic Games with Lexicographic Reachability-Safety Objectives

  2020 Lecture notes in computer science conference-paper Computer Science Formal Methods in Verification Open access

  20

  citations

19 results