MATLAB implementation of all the Operations Research algorithms and problems solved by me.

⛓️ Python package which provides you a simple way to generate phrases using Markov chains.

🦜 DISCOTRESS 🦜 is a software package to simulate and analyse the dynamics on arbitrary Markov chains

ChainoPy: A Python Library for Discrete Time Markov Chain based stochastic analysis

A package for temporal point process modeling, simulation and inference

🔁 Stationary distributions for arbitrary finite state Markov processes, including specializations for the Moran, Wright-Fisher, and other processes, exact (when possible) and approximate computations

Learn to get started using DISCOTRESS with these tutorials! Then apply to your own Markov chains in ecology 🦜🌴 economics 💸📈 biophysics 🧬🦠 and more!

Gevo (Graph EVOlution) - Python implentation of Markov process simulations on model graphs.

Kalman Filter algorithm simulation with Markov process for state estimation.

Random word generation using Random Markov Processes

String generator based on Markov process

Fast R implementation of Gillespie's Stochastic Simulation Algorithm

Python code for posterior sampling of a semi-Markov Jump Process

An Open Source Tool for Analyzing Discrete Markov Chains.

a spark version of probability suffix tree based on markov process

This is a toolbox to analyze and interpret whole brain imaging data. It attempts to implement the NC-MCM framework in an easy access Python package. It was created in the process of a MasterThesis.

Implementation of a Denoising Diffusion Probabilistic Model with some mathematical background.

A book about Markov processes

⛓️ Teaching material on Markov processes

Academic random processes couse