NPTEL : NOC:Stochastic Processes - 1 (Mathematics)

Co-ordinators : Dr. S. Dharmaraja


Lecture 1 - Introduction and motivation for studying stochastic processes

Lecture 2 - Probability space and conditional probability

Lecture 3 - Random variable and cumulative distributive function

Lecture 4 - Discrete Uniform Distribution, Binomial Distribution, Geometric Distribution, Continuous Uniform Distribution, Exponential Distribution, Normal Distribution and Poisson Distribution

Lecture 5 - Joint Distribution of Random Variables

Lecture 6 - Independent Random Variables, Covariance and Correlation Coefficient and Conditional Distribution

Lecture 7 - Conditional Expectation and Covariance Matrix

Lecture 8 - Generating Functions, Law of Large Numbers and Central Limit Theorem

Lecture 9 - Problems in Random variables and Distributions

Lecture 10 - Problems in Random variables and Distributions (Continued...)

Lecture 11 - Problems in Random variables and Distributions (Continued...)

Lecture 12 - Problems in Random variables and Distributions (Continued...)

Lecture 13 - Problems in Sequences of Random Variables

Lecture 14 - Problems in Sequences of Random Variables (Continued...)

Lecture 15 - Problems in Sequences of Random Variables (Continued...)

Lecture 16 - Problems in Sequences of Random Variables (Continued...)

Lecture 17 - Definition of Stochastic Processes, Parameter and State Spaces

Lecture 18 - Classification of Stochastic Processes

Lecture 19 - Examples of Classification of Stochastic Processes

Lecture 20 - Examples of Classification of Stochastic Processes (Continued...)

Lecture 21 - Bernoulli Process

Lecture 22 - Poisson Process

Lecture 23 - Poisson Process (Continued...)

Lecture 24 - Simple Random Walk and Population Processes

Lecture 25 - Introduction to Discrete time Markov Chain

Lecture 26 - Introduction to Discrete time Markov Chain (Continued...)

Lecture 27 - Examples of Discrete time Markov Chain

Lecture 28 - Examples of Discrete time Markov Chain (Continued...)

Lecture 29 - Introduction to Chapman-Kolmogorov equations

Lecture 30 - State Transition Diagram and Examples

Lecture 31 - Examples

Lecture 32 - Introduction to Classification of States and Periodicity

Lecture 33 - Closed set of States and Irreducible Markov Chain

Lecture 34 - First Passage time and Mean Recurrence Time

Lecture 35 - Recurrent State and Transient State

Lecture 36 - Introduction and example of Classification of states

Lecture 37 - Example of Classification of states (Continued...)

Lecture 38 - Example of Classification of states (Continued...)

Lecture 39 - Example of Classification of states (Continued...)

Lecture 40 - Introduction and Limiting Distribution

Lecture 41 - Example of Limiting Distribution and Ergodicity

Lecture 42 - Stationary Distribution and Examples

Lecture 43 - Examples of Stationary Distributions

Lecture 44 - Time Reversible Markov Chain and Examples

Lecture 45 - Definition of Reducible Markov Chains and Types of Reducible Markov Chains

Lecture 46 - Stationary Distributions and Types of Reducible Markov chains

Lecture 47 - Type of Reducible Markov Chains (Continued...)

Lecture 48 - Gambler's Ruin Problem

Lecture 49 - Introduction to Continuous time Markov Chain

Lecture 50 - Waiting time Distribution

Lecture 51 - Chapman-Kolmogorov Equation

Lecture 52 - Infinitesimal Generator Matrix

Lecture 53 - Introduction and Example Of Continuous time Markov Chain

Lecture 54 - Limiting and Stationary Distributions

Lecture 55 - Time reversible CTMC and Birth Death Process

Lecture 56 - Steady State Distributions, Pure Birth Process and Pure Death Process

Lecture 57 - Introduction to Poisson Process

Lecture 58 - Definition of Poisson Process

Lecture 59 - Superposition and Deposition of Poisson Process

Lecture 60 - Compound Poisson Process and Examples

Lecture 61 - Introduction to Queueing Systems and Kendall Notations

Lecture 62 - M/M/1 Queueing Model

Lecture 63 - Little's Law, Distribution of Waiting Time and Response Time

Lecture 64 - Burke's Theorem and Simulation of M/M/1 queueing Model

Lecture 65 - M/M/c Queueing Model

Lecture 66 - M/M/1/N Queueing Model

Lecture 67 - M/M/c/K Model, M/M/c/c Loss System, M/M/? Self Service System

Lecture 68 - Transient Solution of Finite Birth Death Process and Finite Source Markovian Queueing Model

Lecture 69 - Queueing Networks Characteristics and Types of Queueing Networks

Lecture 70 - Tandem Queueing Networks

Lecture 71 - Stationary Distribution and Open Queueing Network

Lecture 72 - Jackson's Theorem, Closed Queueing Networks, Gordon and Newell Results

Lecture 73 - Wireless Handoff Performance Model and System Description

Lecture 74 - Description of 3G Cellular Networks and Queueing Model

Lecture 75 - Simulation of Queueing Systems

Lecture 76 - Definition and Basic Components of Petri Net and Reachability Analysis

Lecture 77 - Arc Extensions in Petri Net, Stochastic Petri Nets and examples