This is known as Pólya's Random Walk Theorem or Pólya's Recurrence Theorem, named after George Pólya who proved it in 1921.
Interestingly, Pólya came up with this theorem while walking through a park in Zurich, where he kept running into a couple multiple times. This led him to wonder about the probability of returning to the same spot in a random walk, ultimately leading to this profound mathematical discovery.
For each of the d unit vectors ej:
P(Xi=ej)=P(Xi=−ej)=2d1
Theorem (Pólya's Recurrence Theorem)
Simple random walk is recurrent in d≤2 and transient in d≥3.
Motivation
To steal a joke from Kakutani (U.C.L.A. colloquium talk): “A drunk man will eventually
find his way home but a drunk bird may get lost forever.”
Drunk man or two dimensional random walk
Random Walk in R2
Drunk bird three dimensional random walk
Random Walk in R3
Preliminary result
The foolowing theorem is Theorem 5.4.3 at [Durrett2019]
To analyze this case, we begin with a result that is valid for any random walk. Let τ0=0 and τn=inf{m>τn−1:Sm=0} be the time of the nth return to 0. From the strong Markov property, it follows that:
P(τn<∞)=P(τ1<∞)n
Theorem
For any random walk, the following are equivalent:
P(τ1<∞)=1
P(Sm=0 i.o.)=1
∑m=0∞P(Sm=0)=∞
Proof. If P(τ1<∞)=1, then P(τn<∞)=1 for all n and P(Sm=0 i.o.)=1. Let
V=m=0∑∞1(Sm=0)=n=0∑∞1(τn<∞)
be the number of visits to 0, counting the visit at time 0. Taking expected value and using Fubini's theorem to put the expected value inside the sum:
This fact and previous theorem give the result in one dimension.
Simple random walk is recurrent in two dimensions
Our next step is to show that the \emph{simple random walk is recurrent in two dimensions}. Note that in order for S2n=0, we must for some 0≤m≤n have m up steps, m down steps, n−m to the left, and n−m to the right, so
To see the next to last equality, consider choosing n students from a class with n boys and n girls and observe that for some 0≤m≤n you must choose m boys and n−m girls. Using the asymptotic formula ρ1(2n)∼(πn)−1/2, we get
ρ2(2n)∼(πn)−1
Since ∑n−1=∞, the result follows from previous theorem.
Simple random walk is transient in three dimensions
Intuitively, this holds since the probability of being back at 0 after 2n steps is ∼cn−3/2 and this is summable. We will not compute the probability exactly but will get an upper bound of the right order of magnitude. Again, since the number of steps in the directions ±ei must be equal for i=1,2,3:
where in the last inequality we have used the fact that if aj,k are ≥0 and sum to 1, then ∑j,kaj,k2≤maxj,kaj,k. Our last step is to show
j,kmax3−nj!k!(n−j−k)!n!≤Cn−1
To do this, we note that:
If any of the numbers j, k, or n−j−k is <[n/3] increasing the smallest number and decreasing the largest number decreases the denominator (since x(1−x) is maximized at 1/2), so the maximum occurs when all three numbers are as close as possible to n/3
Taking j and k within 1 of n/3, the first term on the right is ≤C3n, and the desired result follows.
Simple random walk is transient in dimensions greater than 3
Let Tn=(Sn1,Sn2,Sn3), N(0)=0 and N(n)=infm>N(n−1):Tm=TN(n−1). It is easy to see that TN(n) is a three-dimensional simple random walk. Since TN(n) returns infinitely often to 0 with probability 0 and the first three coordinates are constant in between times N(n−1) and N(n), Sn is transient. □