You are not logged in.

- Topics: Active | Unanswered

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

Hi;

That is not the shortest way to get the expected value of an absorbing chain. Anyway for your matrix the correct answer is 2.

There is a much simpler general way to get it from all absorbing chains.

**In mathematics, you don't understand things. You just get used to them.**

**I agree with you regarding the satisfaction and importance of actually computing some numbers. I can't tell you how often I see time and money wasted because someone didn't bother to run the numbers.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

What is that way?

Here lies the reader who will never open this book. He is forever dead.

Taking a new step, uttering a new word, is what people fear most. ― Fyodor Dostoyevsky, Crime and Punishment

Offline

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

Without the labels:

This is in the correct form which will be explained as we do larger problems. Anyway, you now throw away all rows that have a 1 and any rows below that. Then you throw away any columns with a 1 and all columns to the right of that one. You get:

As problems get bigger this method will look better and better.

**In mathematics, you don't understand things. You just get used to them.**

**I agree with you regarding the satisfaction and importance of actually computing some numbers. I can't tell you how often I see time and money wasted because someone didn't bother to run the numbers.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

Well, let's try it on another problem. Got any?

Here lies the reader who will never open this book. He is forever dead.

Taking a new step, uttering a new word, is what people fear most. ― Fyodor Dostoyevsky, Crime and Punishment

Offline

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

Hi;

Same type but just a bit more difficult:

**How can you compute the expectation of the number of throws for a fair coin until you get a certain pattern, say two heads in a row?**

**In mathematics, you don't understand things. You just get used to them.**

**I agree with you regarding the satisfaction and importance of actually computing some numbers. I can't tell you how often I see time and money wasted because someone didn't bother to run the numbers.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

Tt Th Ht Hh

Tt (1/2 , 1/2 , 0 , 0)

Th ( 0 , 0 , 1/2,1/2)

Ht (1/2, 1/2 , 0 , 0)

Hh (0 , 0 , 0 , 1)

Here lies the reader who will never open this book. He is forever dead.

Taking a new step, uttering a new word, is what people fear most. ― Fyodor Dostoyevsky, Crime and Punishment

Offline

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

Hi;

That looks about right, very good. Now you must solve.

**In mathematics, you don't understand things. You just get used to them.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

Is the answer 16?

Here lies the reader who will never open this book. He is forever dead.

Offline

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

Hi;

**In mathematics, you don't understand things. You just get used to them.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

Maybe 4?

Here lies the reader who will never open this book. He is forever dead.

Offline

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

Hi;

After the rows and columns are eliminated.

The answer is 6.

**In mathematics, you don't understand things. You just get used to them.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

I got all that but wasn't sure what to do with the resulting column vector...

Here lies the reader who will never open this book. He is forever dead.

Offline

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

Hmmm, I have trouble with reading the answer too. Know what helps?

**In mathematics, you don't understand things. You just get used to them.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

What?

Here lies the reader who will never open this book. He is forever dead.

Offline

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

Crom is strong! If I die, I have to go before him, and he will ask me, 'What is the riddle of steel?' If I don't know it, he will cast me out of Valhalla and laugh at me." -Conan the Barbarian

Experimental math! Back engineering! I almost always have the answer first, or the bounds the answer lies in. That is the secret of the riddle of steel. You are trying to solve them forward to back.

There are numerous other ways to demonstrate the answer of 6 ( notice the use of the word demonstrate ).

I will be busy today and away from the forum. We will continue with more problems when I get back if you want.

**In mathematics, you don't understand things. You just get used to them.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

Hi bobbym

How'd you get that equation?

What have you been busy with? The elections?

Here lies the reader who will never open this book. He is forever dead.

Offline

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

Hi anonimnystefy;

In will explain fully how that can be done when I get back from the elections. See you a little later.

**In mathematics, you don't understand things. You just get used to them.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

You are actually gonna vote?

Here lies the reader who will never open this book. He is forever dead.

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

Btw, I found a better Markov chain for the problem:

(1/2 , 1/2 , 0)

(1/2 , 0 , 1/2)

( 0 , 0 , 1 )

With states: empty string, 'H' and 'HH'. These string keep record of what we had till now. If we didn't throw the coin or the last throw was a tail then we have the state string to be an empty string. If the last throw was a head and the state string before the throw was empty, then the new string is 'H'. And finally, if last state string is 'H' and we get another head, then the new state string is 'HH' and this is the absorbing state. When we apply the method you have there, we will get the column vector (6,4) which means that we can get to HH in 6 steps from an empty string and 4 steps from one H. So the answer is 6.

Here lies the reader who will never open this book. He is forever dead.

Offline

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

Hi;

Yes, I vote. Does that surprise you?

Sometimes you find a shorter chain. I know about that one but when someone is trying to learn I do not take any shortcuts. Also, I am not Paul Keres.

Where were we? You wanted to know the derivation of the formula?

**In mathematics, you don't understand things. You just get used to them.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

No I didn't. Btw, the formula seems kinda intuitive when compared to 1/(1-x) for summing the geometric series...

A new problem would be nice...

Yes, I'm surprised that you vote. Do you just cancel the ballot?

Here lies the reader who will never open this book. He is forever dead.

Offline

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

I am talking about the formula in post #40.

No, I vote for a candidate. Why are you surprised?

**In mathematics, you don't understand things. You just get used to them.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

Oh, that one! Yes, I am curious as to how you got it.

I am surprised because I have no idea who you would vote for...

Here lies the reader who will never open this book. He is forever dead.

Offline

**bobbym****Administrator**- From: Bumpkinland
- Registered: 2009-04-12
- Posts: 88,594

Hmmm, most of the time we for against something, not for something. Of course it does not matter but, have you read "The Sea Wolf," by Jack London?

This is what I have in my notes:

Let E denote the expected number of tosses before you get two heads in a row. If your first toss is a tails, then the expected number of total tosses before two heads is E + 1. If your first toss is a head and your second toss is a tail, then the expected number is E + 2. If you toss two heads, then the number of tosses is 2. These events occur with probability 1/2, 1/4, and 1/4, respectively.

**In mathematics, you don't understand things. You just get used to them.**

Offline

**anonimnystefy****Real Member**- From: The Foundation
- Registered: 2011-05-23
- Posts: 15,600

Ahhhh... I get it. Thank you for the formula.

No, I haven't read it.

Here lies the reader who will never open this book. He is forever dead.

Offline