(Tonelli/Fubini for sums, challenging) Suppose let {xk,ℓ}k=1,ℓ=1∞ denote a doubly indexed sequence and let σ:N→N2 be a bijection. Consider the series
i) i=1∑∞xσ(i),ii) k=1∑∞(ℓ=1∑∞xk,ℓ),iii) ℓ=1∑∞(k=1∑∞xk,ℓ).
The expressions ii) and iii) are series of series and so we say they converge if the inner series always converges and the outer series then also converges.
a) (Tonelli) Suppose xk,ℓ≥0 for all k,ℓ. Show that the three series i), ii), iii) either all diverge (to ∞) or they all converge to the same number. In the case of divergence, some of the ``inner'' series might be infinity in which case we consider the entire sum to diverge.
b) (Fubini) Suppose i) converges absolutely. Show that ii) and iii) converge and they both converge to the same number as i).