### Create a StudySoup account

#### Be part of our community, it's free to join!

Already have a StudySoup account? Login here

# 356 Class Note for STAT 416 at PSU

### View Full Document

## 24

## 0

## Popular in Course

## Popular in Department

This 3 page Class Notes was uploaded by an elite notetaker on Friday February 6, 2015. The Class Notes belongs to a course at Pennsylvania State University taught by a professor in Fall. Since its upload, it has received 24 views.

## Similar to Course at Penn State

## Popular in Subject

## Reviews for 356 Class Note for STAT 416 at PSU

### What is Karma?

#### Karma is the currency of StudySoup.

#### You can buy or earn more Karma at anytime and redeem it for class notes, study guides, flashcards, and more!

Date Created: 02/06/15

Exercises for Chapter 4 Markov Chain 1 A particle moves on a circle through points which have been marked 0 l 2 3 4 in a clockwise or der At each step it has a probability p of moving to the right and l p to the left Let X denote its location on the circle after the nth step The process Xm n 2 0 is a Markov chain a Find the transition probability matrix b Is this MC irreducible Find all the recurrent states and transient states 2 Each of 2 switches is either on or off during a day On day n each switch will independently be on wit probability 1 on sw1tchis in day n 1 What frac tion of days are both switches on both off 3 Three out of every 4 trucks on the road are followed by a car while only 1 out of every 5 cars is followed by a truck What fraction of vehicles on the road are trucks 4 Each morning an individual leaves his house and goes for a run He is equally likely to leave either from his front or back door Upon leaving the house he 1 chooses a pair of running shoes or goes running bare foot if there are no shoes at the door from which he departed On his return he is equally likely to en ter and leave his running shoes either by the front or back door If he owns a total of 19 pairs of running shoes what proportion of the time does he run bare footed Suppose Max and Patty decide to ip pennies The one coming closest to the wall wins Patty being the better player has a probability of 06 of winnig on each ip If Patty starts with 5 pennies and Max with 10 then what is the probability that Patty will wipe Max out A total of m white and m black balls are distributed among two urns with each urn containing m balls At each stage a ball is randomly selected from each urn and the two selected balls are interchanged Let X n denote the number of black balls in urn 1 after the nth interchange a Give the transition probabilities of the Markov chain X n 2 0 b Without any computations what do you think are the limiting probabilities of this chain c Find the limiting probabilities and show that the stationary chain is time reversible 2 7 At all times an urn contains N balls some white balls and some black balls At each stage a coin hav ing probability p 0 lt p lt l of landing heads is ipped If heads appears then a ball is chosen at ran dom from the urn and is replaced by a white ball if tails appears then a ball is chosen from the urn and is replaced by a black ball Let X denote the number of white balls in the urn after the nth stage a Is an 2 0 a Markov chain If so explain why b What are its classes What are their periods Are they transient or recurrent c Compute the transition probabilities Pm d Let N 2 Find the proportion of time in each state e Based on your answer in part d and your intu ition guess the answer for the limiting probability in the general case i Prove your guess in part e g If p 1 what is the expected time until there are only white balls in the urn if initially there are i 1 white and N z39 4 l 3 black What is the expected time for a general N and 2

### BOOM! Enjoy Your Free Notes!

We've added these Notes to your profile, click here to view them now.

### You're already Subscribed!

Looks like you've already subscribed to StudySoup, you won't need to purchase another subscription to get this material. To access this material simply click 'View Full Document'

## Why people love StudySoup

#### "I was shooting for a perfect 4.0 GPA this semester. Having StudySoup as a study aid was critical to helping me achieve my goal...and I nailed it!"

#### "Selling my MCAT study guides and notes has been a great source of side revenue while I'm in school. Some months I'm making over $500! Plus, it makes me happy knowing that I'm helping future med students with their MCAT."

#### "There's no way I would have passed my Organic Chemistry class this semester without the notes and study guides I got from StudySoup."

#### "It's a great way for students to improve their educational experience and it seemed like a product that everybody wants, so all the people participating are winning."

### Refund Policy

#### STUDYSOUP CANCELLATION POLICY

All subscriptions to StudySoup are paid in full at the time of subscribing. To change your credit card information or to cancel your subscription, go to "Edit Settings". All credit card information will be available there. If you should decide to cancel your subscription, it will continue to be valid until the next payment period, as all payments for the current period were made in advance. For special circumstances, please email support@studysoup.com

#### STUDYSOUP REFUND POLICY

StudySoup has more than 1 million course-specific study resources to help students study smarter. If you’re having trouble finding what you’re looking for, our customer support team can help you find what you need! Feel free to contact them here: support@studysoup.com

Recurring Subscriptions: If you have canceled your recurring subscription on the day of renewal and have not downloaded any documents, you may request a refund by submitting an email to support@studysoup.com

Satisfaction Guarantee: If you’re not satisfied with your subscription, you can contact us for further help. Contact must be made within 3 business days of your subscription purchase and your refund request will be subject for review.

Please Note: Refunds can never be provided more than 30 days after the initial purchase date regardless of your activity on the site.