I want to know the answer of the following question, I will be so thankful if somebody gives me some clues:
"We start a random process with Nb blue balls and Nr red balls such that N=Nr+Nb. In each step we divide all these N balls into groups of size 4 at random and in each group if the number of blue balls is 3 or 4, then all balls in that group change their color to blue, unless they all change to red. If we denote the number of blue balls in step t by Nb(t), then what is the expectation of Nb(t)?"
Thank you so much in advance.

Deriving the exact distribution maybe difficult and tedious, but you can find out the recursive relationships between the expectations.

Now we are given that

For any randomly choose group of size in step , the number of blue ball follows a hypergeometric distribution. The change of number of blue ball in this group is listed as the following:

Now you can try to compute the expected changes of number of blue balls in a particular group in step . Since expectation is linear, the expected number of change of total blue balls is equal to the sum of all these groups (although they are dependent).