About a decade ago, Ben Green and I showed that the primes contained arbitrarily long arithmetic progressions: given any , one could find a progression with consisting entirely of primes. In fact we showed the same statement was true if the primes were replaced by any subset of the primes of positive relative density.
A little while later, Tamar Ziegler and I obtained the following generalisation: given any and any polynomials with , one could find a “polynomial progression” with consisting entirely of primes. Furthermore, we could make this progression somewhat “narrow” by taking (where denotes a quantity that goes to zero as goes to infinity). Again, the same statement also applies if the primes were replaced by a subset of positive relative density. My previous result with Ben corresponds to the linear case .
In this paper we were able to make the progressions a bit narrower still: given any and any polynomials with , one could find a “polynomial progression” with consisting entirely of primes, and such that , where depends only on and (in fact it depends only on and the degrees of ). The result is still true if the primes are replaced by a subset of positive density , but unfortunately in our arguments we must then let depend on . However, in the linear case , we were able to make independent of (although it is still somewhat large, of the order of ).
The polylogarithmic factor is somewhat necessary: using an upper bound sieve, one can easily construct a subset of the primes of density, say, , whose arithmetic progressions of length all obey the lower bound . On the other hand, the prime tuples conjecture predicts that if one works with the actual primes rather than dense subsets of the primes, then one should have infinitely many length arithmetic progressions of bounded width for any fixed . The case of this is precisely the celebrated theorem of Yitang Zhang that was the focus of the recently concluded Polymath8 project here. The higher case is conjecturally true, but appears to be out of reach of known methods. (Using the multidimensional Selberg sieve of Maynard, one can get primes inside an interval of length , but this is such a sparse set of primes that one would not expect to find even a progression of length three within such an interval.)
The argument in the previous paper was unable to obtain a polylogarithmic bound on the width of the progressions, due to the reliance on a certain technical “correlation condition” on a certain Selberg sieve weight . This correlation condition required one to control arbitrarily long correlations of , which was not compatible with a bounded value of (particularly if one wanted to keep independent of ).
However, thanks to recent advances in this area by Conlon, Fox, and Zhao (who introduced a very nice “densification” technique), it is now possible (in principle, at least) to delete this correlation condition from the arguments. Conlon-Fox-Zhao did this for my original theorem with Ben; and in the current paper we apply the densification method to our previous argument to similarly remove the correlation condition. This method does not fully eliminate the need to control arbitrarily long correlations, but allows most of the factors in such a long correlation to be bounded, rather than merely controlled by an unbounded weight such as . This turns out to be significantly easier to control, although in the non-linear case we still unfortunately had to make large compared to due to a certain “clearing denominators” step arising from the complicated nature of the Gowers-type uniformity norms that we were using to control polynomial averages. We believe though that this an artefact of our method, and one should be able to prove our theorem with an that is uniform in .
Here is a simple instance of the densification trick in action. Suppose that one wishes to establish an estimate of the form
for some real-valued functions which are bounded in magnitude by a weight function , but which are not expected to be bounded; this average will naturally arise when trying to locate the pattern in a set such as the primes. Here I will be vague as to exactly what range the parameters are being averaged over. Suppose that the factor (say) has enough uniformity that one can already show a smallness bound
whenever are bounded functions. (One should think of as being like the indicator functions of “dense” sets, in contrast to which are like the normalised indicator functions of “sparse” sets). The bound (2) cannot be directly applied to control (1) because of the unbounded (or “sparse”) nature of and . However one can “densify” and as follows. Since is bounded in magnitude by , we can bound the left-hand side of (1) as
The weight function will be normalised so that , so by the Cauchy-Schwarz inequality it suffices to show that
The left-hand side expands as
Now, it turns out that after an enormous (but finite) number of applications of the Cauchy-Schwarz inequality to steadily eliminate the factors, as well as a certain “polynomial forms condition” hypothesis on , one can show that
(Because of the polynomial shifts, this requires a method known as “PET induction”, but let me skip over this point here.) In view of this estimate, we now just need to show that
Now we can reverse the previous steps. First, we collapse back to
One can bound by , which can be shown to be “bounded on average” in a suitable sense (e.g. bounded norm) via the aforementioned polynomial forms condition. Because of this and the Hölder inequality, the above estimate is equivalent to
By setting to be the signum of , this is equivalent to
This is halfway between (1) and (2); the sparsely supported function has been replaced by its “densification” , but we have not yet densified to . However, one can shift by and repeat the above arguments to achieve a similar densificiation of , at which point one has reduced (1) to (2).
Finding lower bounds on is more or less equivalent to locating long strings of consecutive composite numbers that are not too large compared to the length of the string. A classic (and quite well known) construction here starts with the observation that for any natural number , the consecutive numbers are all composite, because each , is divisible by some prime , while being strictly larger than that prime . From this and Stirling’s formula, it is not difficult to obtain the bound
A more efficient bound comes from the prime number theorem: there are only primes up to , so just from the pigeonhole principle one can locate a string of consecutive composite numbers up to of length at least , thus
where we use or as shorthand for or .
What about upper bounds? The Cramér random model predicts that the primes up to are distributed like a random subset of density . Using this model, Cramér arrived at the conjecture
In fact, if one makes the extremely optimistic assumption that the random model perfectly describes the behaviour of the primes, one would arrive at the even more precise prediction
However, it is no longer widely believed that this optimistic version of the conjecture is true, due to some additional irregularities in the primes coming from the basic fact that large primes cannot be divisible by very small primes. Using the Maier matrix method to capture some of this irregularity, Granville was led to the conjecture that
(note that is slightly larger than ). For comparison, the known upper bounds on are quite weak; unconditionally one has by the work of Baker, Harman, and Pintz, and even on the Riemann hypothesis one only gets down to , as shown by Cramér (a slight improvement is also possible if one additionally assumes the pair correlation conjecture; see this article of Heath-Brown and the references therein).
This conjecture remains out of reach of current methods. In 1931, Westzynthius managed to improve the bound (2) slightly to
which Erdös in 1935 improved to
and Rankin in 1938 improved slightly further to
with . Remarkably, this rather strange bound then proved extremely difficult to advance further on; until recently, the only improvements were to the constant , which was raised to in 1963 by Schönhage, to in 1963 by Rankin, to by Maier and Pomerance, and finally to in 1997 by Pintz.
Erdös listed the problem of making arbitrarily large one of his favourite open problems, even offering (“somewhat rashly”, in his words) a cash prize for the solution. Our main result answers this question in the affirmative:
Theorem 1 The bound (3) holds for arbitrarily large .
In principle, we thus have a bound of the form
for some that grows to infinity. Unfortunately, due to various sources of ineffectivity in our methods, we cannot provide any explicit rate of growth on at all.
We decided to announce this result the old-fashioned way, as part of a research lecture; more precisely, Ben Green announced the result in his ICM lecture this Tuesday. (The ICM staff have very efficiently put up video of his talks (and most of the other plenary and prize talks) online; Ben’s talk is here, with the announcement beginning at about 0:48. Note a slight typo in his slides, in that the exponent of in the denominator is instead of .) Ben’s lecture slides may be found here.
By coincidence, an independent proof of this theorem has also been obtained very recently by James Maynard.
I discuss our proof method below the fold.
— 1. Sketch of proof —
Our method is a modification of Rankin’s method, combined with some work of myself and Ben Green (and of Tamar Ziegler) on counting various linear patterns in the primes. To explain this, let us first go back to Rankin’s argument, presented in a fashion that allows for comparison with our own methods. Let’s first go back to the easy bound (1) that came from using the consecutive string of composite numbers. This bound was inferior to the prime number theorem bound (2), however this can be easily remedied by replacing with the somewhat smaller primorial , defined as the product of the primes up to and including . It is still easy to see that are all composite, with each divisible by some prime while being larger than that prime. On the other hand, the prime number theorem tells us that . From this, one can recover an alternate proof of (2) (perhaps not so surprising, since the prime number theorem is a key ingredient in both proofs).
This gives hope that further modification of this construction can be used to go beyond (2). If one looks carefully at the above proof, we see that the key fact used here is that the discrete interval of integers is completely sieved out by the residue classes for primes , in the sense that each element in this interval is contained in at least one of these residue classes. More generally (and shifting the interval by for a more convenient normalisation), suppose we can find an interval which is completely sieved out by one residue class for each , for some and . Then the string of consecutive numbers will be composite, whenever is an integer larger than or equal to with for each prime , since each of the will be divisible by some prime while being larger than that prime. From the Chinese remainder theorem, one can find such an that is of size at most . From this and the prime number theorem, one can obtain lower bounds on if one can get lower bounds on in terms of . In particular, if for any large one can completely sieve out with a residue class for each , and
then one can establish the bound (3). (The largest one can take for a given is known as the Jacobsthal function of the primorial .) So the task is basically to find a smarter set of congruence classes than just the zero congruence classes that can sieve out a larger interval than . (Unfortunately, this approach by itself is unlikely to reach the Cramér conjecture; it was shown by Iwaniec using the large sieve that is necessarily of size (which somewhat coincidentally matches the Cramér bound), but Maier and Pomerance conjecture that in fact one must have , which would mean that the limit of this method would be to establish a bound of the form .)
So, how can one do better than just using the “Eratosthenes” sieve ? We will divide the sieving into different stages, depending on the size of . It turns out that a reasonably optimal division of primes up to will be into the following four classes:
We will take an interval , where is given by (4), and sieve out first by Stage 1 primes, then Stage 2 primes, then Stage 3 primes, then Stage 4 primes, until none of the elements of are left.
Let’s first discuss the final sieving step, which is rather trivial. Suppose that our sieving by the first three sieving stages is so efficient that the number of surviving elements of is less than or equal to the number of Stage 4 primes (by the prime number theorem, this will for instance be the case for sufficiently large if there are fewer than survivors). Then one can finish off the remaining survivors simply by using each of the Stage 4 primes to remove one of the surviving integers in by an appropriate choice of residue class . So we can recast our problem as an approximate sieving problem rather than a perfect sieving problem; we now only need to eliminate most of the elements of rather than all of them, at the cost of only using primes from the Stages 1-3, rather than 1-4. Note though that for given by (4), the Stage 1-3 sieving has to be reasonably efficient, in that the proportion of survivors cannot be too much larger than (ignoring factors of etc.).
Next, we discuss the Stage 1 sieving process. Here, we will simply copy the classic construction and use the Eratosthenes sieve for these primes. The elements of that survive this process are those elements that are not divisible by any Stage 1 primes, that is to say they are only divisible by small (Stage 2) primes, or else contain at least one prime factor larger than , and no prime factors less than . In the latter case, the survivor has no choice but to be a prime in (since from (4) we have for large enough). In the former case, the survivor is a -smooth number – a number with no prime factors less than or equal to . How many such survivors are there? Here we can use a somewhat crude upper bound of Rankin:
Lemma 2 Let be large quantities, and write . Suppose that
Then the number of -smooth numbers in is at most .
Proof: We use a Dirichlet series method commonly known as “Rankin’s trick”. Let be a quantity to be optimised in later, and abbreviate “-smooth” as “smooth”. Observe that if is a smooth number less than , then
Thus, the number of smooth numbers in is at most
where we have simply discarded the constraint . The point of doing this is that the above expression factors into a tractable Euler product
so that and . Then the above expression simplifies to
To compute the sum here, we first observe from Mertens’ theorem (discussed in this previous blog post) that
so we may bound the previous expression by
which we rewrite using (6) as
Next, we use the convexity inequality
for and , applied with and , to conclude that
Finally, from the prime number theorem we have . The bound follows.
Remark 1 One can basically eliminate the factor here (at the cost of worsening the error slightly to ) by a more refined version of the Rankin trick, based on replacing the crude bound (5) by the more sophisticated inequality
where denotes the assertion that divides exactly times. (Thanks to Kevin Ford for pointing out this observation to me.) In fact, the number of -smooth numbers in is known to be asymptotically in the range , a result of de Bruijn.
In view of the error term permitted by the Stage 4 process, we would like to take as large as possible while still leaving only smooth numbers in . A somewhat efficient choice of here is
so that and , and then one can check that the above lemma does indeed show that there are smooth numbers in . (If we use the sharper bound in the remark, we can reduce the here to a , although this makes little difference to the final bound.) If we let denote all the primes in , the remaining task is then to sieve out all but of the primes in by using one congruence class from each of the Stage 2 and Stage 3 primes.
Note that is still quite large compared to the error that the Stage 4 primes can handle – it is of size about , whereas we need to get down to a bit less than . Still, this is some progress (the remaining sparsification needed is of the order of rather than ).
For the Stage 2 sieve, we will just use a random construction, choosing uniformly at random for each Stage 2 prime. This sieve is expected to sparsify the set of survivors by a factor
which by Mertens’ theorem is of size
In particular, if is given by (4), then all the strange logarithmic factors cancel out and
In particular, we expect to be cut down to a random set (which we have called in our paper) of size about . This would already finish the job for very small (e.g. ), and indeed Rankin’s original argument proceeds more or less along these lines. But now we want to take to be large.
Fortunately, we still have the Stage 3 primes to play with. But the number of Stage 3 primes is about , which is a bit smaller than the number of surviving primes , which is about . So to make this work, most of the Stage 3 congruence classes need to sieve out many primes from , rather than just one or two. (Rankin’s original argument is based on sieving out one prime per congruence class; the subsequent work of Maier-Pomerance and Pintz is basically based on sieving out two primes per congruence class.)
Here, one has to take some care because the set is already quite sparse inside (its density is about ). So a randomly chosen would in fact most likely catch none of the primes in at all. So we need to restrict attention to congruence classes which already catch a large number of primes in , so that even after the Stage 2 sieving one can hope to be left with many congruence classes that also catch a large number of primes in .
Here’s where my work with Ben came in. Suppose one has an arithmetic progression of length consisting entirely of primes in , and with a multiple of , then the congruence class is guaranteed to pick up at least primes in . My first theorem with Ben shows that no matter how large is, the set does indeed contain some arithmetic progressions of length . This result is not quite suitable for our applications here, because (a) we need the spacing to also be divisible by a Stage 3 prime (in our paper, we take for concreteness, although other choices are certainly possible), and (b) for technical reasons, it is insufficient to simply have a large number of arithmetic progressions of primes strewn around ; they have to be “evenly distributed” in some sense in order to be able to still cover most of after throwing out any progression that is partly or completely sieved out by the Stage 2 primes. Fortunately, though, these distributional results for linear equations in primes were established by a subsequent paper of Ben and myself, contingent on two conjectures (the Mobius-Nilsequences conjecture and the inverse conjecture for the Gowers norms) which we also proved (the latter with Tamar Ziegler) in some further papers. (Actually, strictly speaking our work does not quite cover the case needed here, because the progressions are a little “narrow”; we need progressions of primes in whose spacing is comparable to instead of , whereas our paper only considered the situation in which the spacing was comparable to the elements of the progression. It turns out though that the arguments can be modified (somewhat tediously) to extend to this case though.)
Mathematicians (and likely other academics!) with small children face some unique challenges when traveling to conferences and workshops. The goal of this post is to reflect on these, and to start a constructive discussion what institutions and event organizers could do to improve the experiences of such participants.
The first necessary step is to recognize that different families have different needs. While it is hard to completely address everybody’s needs, there are some general measures that have a good chance to help most of the people traveling with young children. In this post, I will mostly focus on nursing mothers with infants ( months old) because that is my personal experience. Many of the suggestions will apply to other cases such as non-nursing babies, children of single parents, children of couples of mathematicians who are interested in attending the same conference, etc..
The mother of a nursing infant that wishes to attend a conference has three options:
It is important to keep in mind that each option has its own set of challenges (even when expenses and facilities are all covered) and that different families may be restricted in their choice of options for a variety of reasons. It is therefore important that all these three options be facilitated.
As for the effect these choices have on the conference experience for the mother, Option 1 means that she has to balance her time between the conference and spending time with her relative/friend. This pressure disappears when we consider Option 2, so this option may lead to more participation in the conferences activities. In Option 3, the mother is in principle free to participate in all the conference activities, but the frequent breaks may limit the type of activity. A mother may choose different options depending on the nature of the conference.
I want to stress, for the three options, that having to make choices about what to miss in the conference is very hard. While talks are important, so are the opportunities to meet people and discuss mathematics that happen during breaks and social events. It is very difficult to balance all of this. This is particularly difficult for the pumping mother in Option 3: because she travels without her baby, she is not perceived to be a in special situation or in need of accommodation. However, this mother is probably choosing between going to the last lecture in the morning or having lunch alone, because if she goes to pump right after the last lecture, by the time she is back, everybody has left for lunch.
Here is the Hall of Fame for those organizations that are already supporting nursing mothers’ travels in mathematics:
[UPDATED] Added a few more things to the Hall of Fame
In closing, here is a (possibly incomplete) list of resources that institutes, funding agencies, and conferences could consider providing for nursing mother mathematicians:
I also find it important that these resources be listed publicly in the institute/conference website. This serves a double purpose: first, it helps those in need of the resources to access them easily, and second, it contributes to make these accommodations normal, setting a good model for future events, and inspiring organizers of future events.
Finally, I am pretty sure that the options and solutions I described do not cover all cases. I would like to finish this note by inviting readers to make suggestions, share experiences, and/or pose questions about this topic.
Subhash Khot is best known for his Unique Games Conjecture, a problem in complexity theory that is perhaps second in importance only to the problem for the purposes of demarcating the mysterious line between “easy” and “hard” problems (if one follows standard practice and uses “polynomial time” as the definition of “easy”). The problem can be viewed as an assertion that it is difficult to find exact solutions to certain standard theoretical computer science problems (such as -SAT); thanks to the NP-completeness phenomenon, it turns out that the precise problem posed here is not of critical importance, and -SAT may be substituted with one of the many other problems known to be NP-complete. The unique games conjecture is similarly an assertion about the difficulty of finding even approximate solutions to certain standard problems, in particular “unique games” problems in which one needs to colour the vertices of a graph in such a way that the colour of one vertex of an edge is determined uniquely (via a specified matching) by the colour of the other vertex. This is an easy problem to solve if one insists on exact solutions (in which 100% of the edges have a colouring compatible with the specified matching), but becomes extremely difficult if one permits approximate solutions, with no exact solution available. In analogy with the NP-completeness phenomenon, the threshold for approximate satisfiability of many other problems (such as the MAX-CUT problem) is closely connected with the truth of the unique games conjecture; remarkably, the truth of the unique games conjecture would imply asymptotically sharp thresholds for many of these problems. This has implications for many theoretical computer science constructions which rely on hardness of approximation, such as probabilistically checkable proofs. For a more detailed survey of the unique games conjecture and its implications, see this Bulletin article of Trevisan.
My colleague Stan Osher has worked in many areas of applied mathematics, ranging from image processing to modeling fluids for major animation studies such as Pixar or Dreamworks, but today I would like to talk about one of his contributions that is close to an area of my own expertise, namely compressed sensing. One of the basic reconstruction problem in compressed sensing is the basis pursuit problem of finding the vector in an affine space (where and are given, and is typically somewhat smaller than ) which minimises the -norm of the vector . This is a convex optimisation problem, and thus solvable in principle (it is a polynomial time problem, and thus “easy” in the above theoretical computer science sense). However, once and get moderately large (e.g. of the order of ), standard linear optimisation routines begin to become computationally expensive; also, it is difficult for off-the-shelf methods to exploit any additional structure (e.g. sparsity) in the measurement matrix . Much of the problem comes from the fact that the functional is only barely convex. One way to speed up the optimisation problem is to relax it by replacing the constraint with a convex penalty term , thus one is now trying to minimise the unconstrained functional
This functional is more convex, and is over a computationally simpler domain than the affine space , so is easier (though still not entirely trivial) to optimise over. However, the minimiser to this problem need not match the minimiser to the original problem, particularly if the (sub-)gradient of the original functional is large at , and if is not set to be small. (And setting too small will cause other difficulties with numerically solving the optimisation problem, due to the need to divide by very small denominators.) However, if one modifies the objective function by an additional linear term
then some simple convexity considerations reveal that the minimiser to this new problem will match the minimiser to the original problem, provided that is (or more precisely, lies in) the (sub-)gradient of at – even if is not small. But, one does not know in advance what the correct value of should be, because one does not know what the minimiser is.
With Yin, Goldfarb and Darbon, Osher introduced a Bregman iteration method in which one solves for and simultaneously; given an initial guess for both and , one first updates to the minimiser of the convex functional
and then updates to the natural value of the subgradient at , namely
(note upon taking the first variation of (1) that is indeed in the subgradient). This procedure converges remarkably quickly (both in theory and in practice) to the true minimiser even for non-small values of , and also has some ability to be parallelised, and has led to actual performance improvements of an order of magnitude or more in certain compressed sensing problems (such as reconstructing an MRI image).
Phillip Griffiths has made many contributions to complex, algebraic and differential geometry, and I am not qualified to describe most of these; my primary exposure to his work is through his text on algebraic geometry with Harris, but as excellent though that text is, it is not really representative of his research. But I thought I would mention one cute result of his related to the famous Nash embedding theorem. Suppose that one has a smooth -dimensional Riemannian manifold that one wants to embed locally into a Euclidean space . The Nash embedding theorem guarantees that one can do this if is large enough depending on , but what is the minimal value of one can get away with? Many years ago, my colleague Robert Greene showed that sufficed (a simplified proof was subsequently given by Gunther). However, this is not believed to be sharp; if one replaces “smooth” with “real analytic” then a standard Cauchy-Kovalevski argument shows that is possible, and no better. So this suggests that is the threshold for the smooth problem also, but this remains open in general. The cases is trivial, and the case is not too difficult (if the curvature is non-zero) as the codimension is one in this case, and the problem reduces to that of solving a Monge-Ampere equation. With Bryant and Yang, Griffiths settled the case, under a non-degeneracy condition on the Einstein tensor. This is quite a serious paper – over 100 pages combining differential geometry, PDE methods (e.g. Nash-Moser iteration), and even some harmonic analysis (e.g. they rely at one key juncture on an extension theorem of my advisor, Elias Stein). The main difficulty is that that the relevant PDE degenerates along a certain characteristic submanifold of the cotangent bundle, which then requires an extremely delicate analysis to handle.
Artur Avila works in dynamical systems and in the study of Schrödinger operators. The work of Avila that I am most familiar with is his solution with Svetlana Jitormiskaya of the ten martini problem of Kac, the solution to which (according to Barry Simon) he offered ten martinis for, hence the name. The problem involves perhaps the simplest example of a Schrödinger operator with non-trivial spectral properties, namely the almost Mathieu operator defined for parameters and by a discrete one-dimensional Schrödinger operator with cosine potential:
This is a bounded self-adjoint operator and thus has a spectrum that is a compact subset of the real line; it arises in a number of physical contexts, most notably in the theory of the integer quantum Hall effect, though I will not discuss these applications here. Remarkably, the structure of this spectrum depends crucially on the Diophantine properties of the frequency . For instance, if is a rational number, then the operator is periodic with period , and then basic (discrete) Floquet theory tells us that the spectrum is simply the union of (possibly touching) intervals. But for irrational (in which case the spectrum is independent of the phase ), the situation is much more fractal in nature, for instance in the critical case the spectrum (as a function of ) gives rise to the Hofstadter butterfly. The “ten martini problem” asserts that for every irrational and every choice of coupling constant , the spectrum is homeomorphic to a Cantor set. Prior to the work of Avila and Jitormiskaya, there were a number of partial results on this problem, notably the result of Puig establishing Cantor spectrum for a full measure set of parameters , as well as results requiring a perturbative hypothesis, such as being very small or very large. The result was also already known for being either very close to rational (i.e. a Liouville number) or very far from rational (a Diophantine number), although the analyses for these two cases failed to meet in the middle, leaving some cases untreated. The argument uses a wide variety of existing techniques, both perturbative and non-perturbative, to attack this problem, as well as an amusing argument by contradiction: they assume (in certain regimes) that the spectrum fails to be a Cantor set, and use this hypothesis to obtain additional Lipschitz control on the spectrum (as a function of the frequency ), which they can then use (after much effort) to improve existing arguments and conclude that the spectrum was in fact Cantor after all!
Manjul Bhargava produces amazingly beautiful mathematics, though most of it is outside of my own area of expertise. One part of his work that touches on an area of my own interest (namely, random matrix theory) is his ongoing work with many co-authors on modeling (both conjecturally and rigorously) the statistics of various key number-theoretic features of elliptic curves (such as their rank, their Selmer group, or their Tate-Shafarevich groups). For instance, with Kane, Lenstra, Poonen, and Rains, Manjul has proposed a very general random matrix model that predicts all of these statistics (for instance, predicting that the -component of the Tate-Shafarevich group is distributed like the cokernel of a certain random -adic matrix, very much in the spirit of the Cohen-Lenstra heuristics discussed in this previous post). But what is even more impressive is that Manjul and his coauthors have been able to verify several non-trivial fragments of this model (e.g. showing that certain moments have the predicted asymptotics), giving for the first time non-trivial upper and lower bounds for various statistics, for instance obtaining lower bounds on how often an elliptic curve has rank or rank , leading most recently (in combination with existing work of Gross-Zagier and of Kolyvagin, among others) to his amazing result with Skinner and Zhang that at least of all elliptic curves over (ordered by height) obey the Birch and Swinnerton-Dyer conjecture. Previously it was not even known that a positive proportion of curves obeyed the conjecture. This is still a fair ways from resolving the conjecture fully (in particular, the situation with the presumably small number of curves of rank and higher is still very poorly understood, and the theory of Gross-Zagier and Kolyvagin that this work relies on, which was initially only available for , has only been extended to totally real number fields thus far, by the work of Zhang), but it certainly does provide hope that the conjecture could be within reach in a statistical sense at least.
Martin Hairer works in at the interface between probability and partial differential equations, and in particular in the theory of stochastic differential equations (SDEs). The result of his that is closest to my own interests is his remarkable demonstration with Jonathan Mattingly of unique invariant measure for the two-dimensional stochastically forced Navier-Stokes equation
on the two-torus , where is a Gaussian field that forces a fixed set of frequencies. It is expected that for any reasonable choice of initial data, the solution to this equation should asymptotically be distributed according to Kolmogorov’s power law, as discussed in this previous post. This is still far from established rigorously (although there are some results in this direction for dyadic models, see e.g. this paper of Cheskidov, Shvydkoy, and Friedlander). However, Hairer and Mattingly were able to show that there was a unique probability distribution to almost every initial data would converge to asymptotically; by the ergodic theorem, this is equivalent to demonstrating the existence and uniqueness of an invariant measure for the flow. Existence can be established using standard methods, but uniqueness is much more difficult. One of the standard routes to uniqueness is to establish a “strong Feller property” that enforces some continuity on the transition operators; among other things, this would mean that two ergodic probability measures with intersecting supports would in fact have a non-trivial common component, contradicting the ergodic theorem (which forces different ergodic measures to be mutually singular). Since all ergodic measures for Navier-Stokes can be seen to contain the origin in their support, this would give uniqueness. Unfortunately, the strong Feller property is unlikely to hold in the infinite-dimensional phase space for Navier-Stokes; but Hairer and Mattingly develop a clean abstract substitute for this property, which they call the asymptotic strong Feller property, which is again a regularity property on the transition operator; this in turn is then demonstrated by a careful application of Malliavin calculus.
Maryam Mirzakhani has mostly focused on the geometry and dynamics of Teichmuller-type moduli spaces, such as the moduli space of Riemann surfaces with a fixed genus and a fixed number of cusps (or with a fixed number of boundaries that are geodesics of a prescribed length). These spaces have an incredibly rich structure, ranging from geometric structure (such as the Kahler geometry given by the Weil-Petersson metric), to dynamical structure (through the action of the mapping class group on this and related spaces), to algebraic structure (viewing these spaces as algebraic varieties), and are thus connected to many other objects of interest in geometry and dynamics. For instance, by developing a new recursive formula for the Weil-Petersson volume of this space, Mirzakhani was able to asymptotically count the number of simple prime geodesics of length up to some threshold in a hyperbolic surface (or more precisely, she obtained asymptotics for the number of such geodesics in a given orbit of the mapping class group); the answer turns out to be polynomial in , in contrast to the much larger class of non-simple prime geodesics, whose asymptotics are exponential in (the “prime number theorem for geodesics”, developed in a classic series of works by Delsart, Huber, Selberg, and Margulis); she also used this formula to establish a new proof of a conjecture of Witten on intersection numbers that was first proven by Kontsevich. More recently, in two lengthy papers with Eskin and with Eskin-Mohammadi, Mirzakhani established rigidity theorems for the action of on such moduli spaces that are close analogues of Ratner’s celebrated rigidity theorems for unipotently generated groups (discussed in this previous blog post). Ratner’s theorems are already notoriously difficult to prove, and rely very much on the polynomial stability properties of unipotent flows; in this even more complicated setting, the unipotent flows are no longer tractable, and Mirzakhani instead uses a recent “exponential drift” method of Benoist and Quint with as a substitute. Ratner’s theorems are incredibly useful for all sorts of problems connected to homogeneous dynamics, and the analogous theorems established by Mirzakhani, Eskin, and Mohammadi have a similarly broad range of applications, for instance in counting periodic billiard trajectories in rational polygons.
where denotes the prime, as well as the more general quantities
In the breakthrough paper of Goldston, Pintz, and Yildirim, the bound was obtained under the strong hypothesis of the Elliott-Halberstam conjecture. An unconditional bound on , however, remained elusive until the celebrated work of Zhang last year, who showed that
The Polymath8a paper then improved this to . After that, Maynard introduced a new multidimensional Selberg sieve argument that gave the substantial improvement
unconditionally, and on the Elliott-Halberstam conjecture; furthermore, bounds on for higher were obtained for the first time, and specifically that for all , with the improvements and on the Elliott-Halberstam conjecture. (I had independently discovered the multidimensional sieve idea, although I did not obtain Maynard’s specific numerical results, and my asymptotic bounds were a bit weaker.)
In Polymath8b, we obtain some further improvements. Unconditionally, we have and , together with some explicit bounds on ; on the Elliott-Halberstam conjecture we have and some numerical improvements to the bounds; and assuming the generalised Elliott-Halberstam conjecture we have the bound , which is best possible from sieve-theoretic methods thanks to the parity problem obstruction.
There were a variety of methods used to establish these results. Maynard’s paper obtained a criterion for bounding which reduced to finding a good solution to a certain multidimensional variational problem. When the dimension parameter was relatively small (e.g. ), we were able to obtain good numerical solutions both by continuing the method of Maynard (using a basis of symmetric polynomials), or by using a Krylov iteration scheme. For large , we refined the asymptotics and obtained near-optimal solutions of the variational problem. For the bounds, we extended the reach of the multidimensional Selberg sieve (particularly under the assumption of the generalised Elliott-Halberstam conjecture) by allowing the function in the multidimensional variational problem to extend to a larger region of space than was previously admissible, albeit with some tricky new constraints on (and penalties in the variational problem). This required some unusual sieve-theoretic manipulations, notably an “epsilon trick”, ultimately relying on the elementary inequality , that allowed one to get non-trivial lower bounds for sums such as even if the sum had no non-trivial estimates available; and a way to estimate divisor sums such as even if was permitted to be comparable to or even exceed , by using the fundamental theorem of arithmetic to factorise (after restricting to the case when is almost prime). I hope that these sieve-theoretic tricks will be useful in future work in the subject.
With this paper, the Polymath8 project is almost complete; there is still a little bit of scope to push our methods further and get some modest improvement for instance to the bound, but this would require a substantial amount of effort, and it is probably best to instead wait for some new breakthrough in the subject to come along. One final task we are performing is to write up a retrospective article on both the 8a and 8b experiences, an incomplete writeup of which can be found here. If anyone wishes to contribute some commentary on these projects (whether you were an active contributor, an occasional contributor, or a silent “lurker” in the online discussion), please feel free to do so in the comments to this post.
Actually, for our purposes we will adopt the philosophy of identifying stochastic objects that agree almost surely, so if one was to be completely precise, we should define a stochastic real number to be an equivalence class of measurable functions , up to almost sure equivalence. However, we shall often abuse notation and write simply as .
More generally, given any measurable space , we can talk either about deterministic elements , or about stochastic elements of , that is to say equivalence classes of measurable maps up to almost sure equivalence. We will use to denote the set of all stochastic elements of . (For readers familiar with sheaves, it may helpful for the purposes of this post to think of as the space of measurable global sections of the trivial -bundle over .) Of course every deterministic element of can also be viewed as a stochastic element given by (the equivalence class of) the constant function , thus giving an embedding of into . We do not attempt here to give an interpretation of for sets that are not equipped with a -algebra .
Remark 1 In my previous post on the foundations of probability theory, I emphasised the freedom to extend the sample space to a larger sample space whenever one wished to inject additional sources of randomness. This is of course an important freedom to possess (and in the current formalism, is the analogue of the important operation of base change in algebraic geometry), but in this post we will focus on a single fixed sample space , and not consider extensions of this space, so that one only has to consider two types of mathematical objects (deterministic and stochastic), as opposed to having many more such types, one for each potential choice of sample space (with the deterministic objects corresponding to the case when the sample space collapses to a point).
Any (measurable) -ary operation on deterministic mathematical objects then extends to their stochastic counterparts by applying the operation pointwise. For instance, the addition operation on deterministic real numbers extends to an addition operation , by defining the class for to be the equivalence class of the function ; this operation is easily seen to be well-defined. More generally, any measurable -ary deterministic operation between measurable spaces extends to an stochastic operation in the obvious manner.
There is a similar story for -ary relations , although here one has to make a distinction between a deterministic reading of the relation and a stochastic one. Namely, if we are given stochastic objects for , the relation does not necessarily take values in the deterministic Boolean algebra , but only in the stochastic Boolean algebra – thus may be true with some positive probability and also false with some positive probability (with the event that being stochastically true being determined up to null events). Of course, the deterministic Boolean algebra embeds in the stochastic one, so we can talk about a relation being determinstically true or deterministically false, which (due to our identification of stochastic objects that agree almost surely) means that is almost surely true or almost surely false respectively. For instance given two stochastic objects , one can view their equality relation as having a stochastic truth value. This is distinct from the way the equality symbol is used in mathematical logic, which we will now call “equality in the deterministic sense” to reduce confusion. Thus, in the deterministic sense if and only if the stochastic truth value of is equal to , that is to say that for almost all .
Any universal identity for deterministic operations (or universal implication between identities) extends to their stochastic counterparts: for instance, addition is commutative, associative, and cancellative on the space of deterministic reals , and is therefore commutative, associative, and cancellative on stochastic reals as well. However, one has to be more careful when working with mathematical laws that are not expressible as universal identities, or implications between identities. For instance, is an integral domain: if are deterministic reals such that , then one must have or . However, if are stochastic reals such that (in the deterministic sense), then it is no longer necessarily the case that (in the deterministic sense) or that (in the deterministic sense); however, it is still true that “ or ” is true in the deterministic sense if one interprets the boolean operator “or” stochastically, thus “ or ” is true for almost all . Another way to properly obtain a stochastic interpretation of the integral domain property of is to rewrite it as
and then make all sets stochastic to obtain the true statement
thus we have to allow the index for which vanishing occurs to also be stochastic, rather than deterministic. (A technical note: when one proves this statement, one has to select in a measurable fashion; for instance, one can choose to equal when , and otherwise (so that in the “tie-breaking” case when and both vanish, one always selects to equal ).)
Similarly, the law of the excluded middle fails when interpreted deterministically, but remains true when interpreted stochastically: if is a stochastic statement, then it is not necessarily the case that is either deterministically true or deterministically false; however the sentence “ or not-” is still deterministically true if the boolean operator “or” is interpreted stochastically rather than deterministically.
To avoid having to keep pointing out which operations are interpreted stochastically and which ones are interpreted deterministically, we will use the following convention: if we assert that a mathematical sentence involving stochastic objects is true, then (unless otherwise specified) we mean that is deterministically true, assuming that all relations used inside are interpreted stochastically. For instance, if are stochastic reals, when we assert that “Exactly one of , , or is true”, then by default it is understood that the relations , , and the boolean operator “exactly one of” are interpreted stochastically, and the assertion is that the sentence is deterministically true.
In the above discussion, the stochastic objects being considered were elements of a deterministic space , such as the reals . However, it can often be convenient to generalise this situation by allowing the ambient space to also be stochastic. For instance, one might wish to consider a stochastic vector inside a stochastic vector space , or a stochastic edge of a stochastic graph . In order to formally describe this situation within the classical framework of measure theory, one needs to place all the ambient spaces inside a measurable space. This can certainly be done in many contexts (e.g. when considering random graphs on a deterministic set of vertices, or if one is willing to work up to equivalence and place the ambient spaces inside a suitable moduli space), but is not completely natural in other contexts. For instance, if one wishes to consider stochastic vector spaces of potentially unbounded dimension (in particular, potentially larger than any given cardinal that one might specify in advance), then the class of all possible vector spaces is so large that it becomes a proper class rather than a set (even if one works up to equivalence), making it problematic to give this class the structure of a measurable space; furthermore, even once one does so, one needs to take additional care to pin down what it would mean for a random vector lying in a random vector space to depend “measurably” on .
Of course, in any reasonable application one can avoid the set theoretic issues at least by various ad hoc means, for instance by restricting the dimension of all spaces involved to some fixed cardinal such as . However, the measure-theoretic issues can require some additional effort to resolve properly.
In this post I would like to describe a different way to formalise stochastic spaces, and stochastic elements of these spaces, by viewing the spaces as measure-theoretic analogue of a sheaf, but being over the probability space rather than over a topological space; stochastic objects are then sections of such sheaves. Actually, for minor technical reasons it is convenient to work in the slightly more general setting in which the base space is a finite measure space rather than a probability space, thus can take any value in rather than being normalised to equal . This will allow us to easily localise to subevents of without the need for normalisation, even when is a null event (though we caution that the map from deterministic objects ceases to be injective in this latter case). We will however still continue to use probabilistic terminology. despite the lack of normalisation; thus for instance, sets in will be referred to as events, the measure of such a set will be referred to as the probability (which is now permitted to exceed in some cases), and an event whose complement is a null event shall be said to hold almost surely. It is in fact likely that almost all of the theory below extends to base spaces which are -finite rather than finite (for instance, by damping the measure to become finite, without introducing any further null events), although we will not pursue this further generalisation here.
The approach taken in this post is “topos-theoretic” in nature (although we will not use the language of topoi explicitly here), and is well suited to a “pointless” or “point-free” approach to probability theory, in which the role of the stochastic state is suppressed as much as possible; instead, one strives to always adopt a “relative point of view”, with all objects under consideration being viewed as stochastic objects relative to the underlying base space . In this perspective, the stochastic version of a set is as follows.
Definition 1 (Stochastic set) Unless otherwise specified, we assume that we are given a fixed finite measure space (which we refer to as the base space). A stochastic set (relative to ) is a tuple consisting of the following objects:
- A set assigned to each event ; and
- A restriction map from to to each pair of nested events . (Strictly speaking, one should indicate the dependence on in the notation for the restriction map, e.g. using instead of , but we will abuse notation by omitting the dependence.)
We refer to elements of as local stochastic elements of the stochastic set , localised to the event , and elements of as global stochastic elements (or simply elements) of the stochastic set. (In the language of sheaves, one would use “sections” instead of “elements” here, but I prefer to use the latter terminology here, for compatibility with conventional probabilistic notation, where for instance measurable maps from to are referred to as real random variables, rather than sections of the reals.)
Furthermore, we impose the following axioms:
- (Category) The map from to is the identity map, and if are events in , then for all .
- (Null events trivial) If is a null event, then the set is a singleton set. (In particular, is always a singleton set; this is analogous to the convention that for any number .)
- (Countable gluing) Suppose that for each natural number , one has an event and an element such that for all . Then there exists a unique such that for all .
If is an event in , we define the localisation of the stochastic set to to be the stochastic set
relative to . (Note that there is no need to renormalise the measure on , as we are not demanding that our base space have total measure .)
The following fact is useful for actually verifying that a given object indeed has the structure of a stochastic set:
Exercise 1 Show that to verify the countable gluing axiom of a stochastic set, it suffices to do so under the additional hypothesis that the events are disjoint. (Note that this is quite different from the situation with sheaves over a topological space, in which the analogous gluing axiom is often trivial in the disjoint case but has non-trivial content in the overlapping case. This is ultimately because a -algebra is closed under all Boolean operations, whereas a topology is only closed under union and intersection.)
Let us illustrate the concept of a stochastic set with some examples.
Example 1 (Discrete case) A simple case arises when is a discrete space which is at most countable. If we assign a set to each , with a singleton if . One then sets , with the obvious restriction maps, giving rise to a stochastic set . (Thus, a local element of can be viewed as a map on that takes values in for each .) Conversely, it is not difficult to see that any stochastic set over an at most countable discrete probability space is of this form up to isomorphism. In this case, one can think of as a bundle of sets over each point (of positive probability) in the base space . One can extend this bundle interpretation of stochastic sets to reasonably nice sample spaces (such as standard Borel spaces) and similarly reasonable ; however, I would like to avoid this interpretation in the formalism below in order to be able to easily work in settings in which and are very “large” (e.g. not separable in any reasonable sense). Note that we permit some of the to be empty, thus it can be possible for to be empty whilst for some strict subevents of to be non-empty. (This is analogous to how it is possible for a sheaf to have local sections but no global sections.) As such, the space of global elements does not completely determine the stochastic set ; one sometimes needs to localise to an event in order to see the full structure of such a set. Thus it is important to distinguish between a stochastic set and its space of global elements. (As such, it is a slight abuse of the axiom of extensionality to refer to global elements of simply as “elements”, but hopefully this should not cause too much confusion.)
Example 2 (Measurable spaces as stochastic sets) Returning now to a general base space , any (deterministic) measurable space gives rise to a stochastic set , with being defined as in previous discussion as the measurable functions from to modulo almost everywhere equivalence (in particular, a singleton set when is null), with the usual restriction maps. The constraint of measurability on the maps , together with the quotienting by almost sure equivalence, means that is now more complicated than a plain Cartesian product of fibres, but this still serves as a useful first approximation to what is for the purposes of developing intuition. Indeed, the measurability constraint is so weak (as compared for instance to topological or smooth constraints in other contexts, such as sheaves of continuous or smooth sections of bundles) that the intuition of essentially independent fibres is quite an accurate one, at least if one avoids consideration of an uncountable number of objects simultaneously.
Example 3 (Extended Hilbert modules) This example is the one that motivated this post for me. Suppose that one has an extension of the base space , thus we have a measurable factor map such that the pushforward of the measure by is equal to . Then we have a conditional expectation operator , defined as the adjoint of the pullback map . As is well known, the conditional expectation operator also extends to a contraction ; by monotone convergence we may also extend to a map from measurable functions from to the extended non-negative reals , to measurable functions from to . We then define the “extended Hilbert module” to be the space of functions with finite almost everywhere. This is an extended version of the Hilbert module , which is defined similarly except that is required to lie in ; this is a Hilbert module over which is of particular importance in the Furstenberg-Zimmer structure theory of measure-preserving systems. We can then define the stochastic set by setting
with the obvious restriction maps. In the case that are standard Borel spaces, one can disintegrate as an integral of probability measures (supported in the fibre ), in which case this stochastic set can be viewed as having fibres (though if is not discrete, there are still some measurability conditions in on the local and global elements that need to be imposed). However, I am interested in the case when are not standard Borel spaces (in fact, I will take them to be algebraic probability spaces, as defined in this previous post), in which case disintegrations are not available. However, it appears that the stochastic analysis developed in this blog post can serve as a substitute for the tool of disintegration in this context.
We make the remark that if is a stochastic set and are events that are equivalent up to null events, then one can identify with (through their common restriction to , with the restriction maps now being bijections). As such, the notion of a stochastic set does not require the full structure of a concrete probability space ; one could also have defined the notion using only the abstract -algebra consisting of modulo null events as the base space, or equivalently one could define stochastic sets over the algebraic probability spaces defined in this previous post. However, we will stick with the classical formalism of concrete probability spaces here so as to keep the notation reasonably familiar.
As a corollary of the above observation, we see that if the base space has total measure , then all stochastic sets are trivial (they are just points).
Exercise 2 If is a stochastic set, show that there exists an event with the property that for any event , is non-empty if and only if is contained in modulo null events. (In particular, is unique up to null events.) Hint: consider the numbers for ranging over all events with non-empty, and form a maximising sequence for these numbers. Then use all three axioms of a stochastic set.
One can now start take many of the fundamental objects, operations, and results in set theory (and, hence, in most other categories of mathematics) and establish analogues relative to a finite measure space. Implicitly, what we will be doing in the next few paragraphs is endowing the category of stochastic sets with the structure of an elementary topos. However, to keep things reasonably concrete, we will not explicitly emphasise the topos-theoretic formalism here, although it is certainly lurking in the background.
Firstly, we define a stochastic function between two stochastic sets to be a collection of maps for each which form a natural transformation in the sense that for all and nested events . In the case when is discrete and at most countable (and after deleting all null points), a stochastic function is nothing more than a collection of functions for each , with the function then being a direct sum of the factor functions :
Thus (in the discrete, at most countable setting, at least) stochastic functions do not mix together information from different states in a sample space; the value of at depends only on the value of at . The situation is a bit more subtle for continuous probability spaces, due to the identification of stochastic objects that agree almost surely, nevertheness it is still good intuition to think of stochastic functions as essentially being “pointwise” or “local” in nature.
One can now form the stochastic set of functions from to , by setting for any event to be the set of local stochastic functions of the localisations of to ; this is a stochastic set if we use the obvious restriction maps. In the case when is discrete and at most countable, the fibre at a point of positive measure is simply the set of functions from to .
In a similar spirit, we say that one stochastic set is a (stochastic) subset of another , and write , if we have a stochastic inclusion map, thus for all events , with the restriction maps being compatible. We can then define the power set of a stochastic set by setting for any event to be the set of all stochastic subsets of relative to ; it is easy to see that is a stochastic set with the obvious restriction maps (one can also identify with in the obvious fashion). Again, when is discrete and at most countable, the fibre of at a point of positive measure is simply the deterministic power set .
Note that if is a stochastic function and is a stochastic subset of , then the inverse image , defined by setting for any event to be the set of those with , is a stochastic subset of . In particular, given a -ary relation , the inverse image is a stochastic subset of , which by abuse of notation we denote as
In a similar spirit, if is a stochastic subset of and is a stochastic function, we can define the image by setting to be the set of those with ; one easily verifies that this is a stochastic subset of .
Remark 2 One should caution that in the definition of the subset relation , it is important that for all events , not just the global event ; in particular, just because a stochastic set has no global sections, does not mean that it is contained in the stochastic empty set .
Now we discuss Boolean operations on stochastic subsets of a given stochastic set . Given two stochastic subsets of , the stochastic intersection is defined by setting to be the set of that lie in both and :
This is easily verified to again be a stochastic subset of . More generally one may define stochastic countable intersections for any sequence of stochastic subsets of . One could extend this definition to uncountable families if one wished, but I would advise against it, because some of the usual laws of Boolean algebra (e.g. the de Morgan laws) may break down in this setting.
Stochastic unions are a bit more subtle. The set should not be defined to simply be the union of and , as this would not respect the gluing axiom. Instead, we define to be the set of all such that one can cover by measurable subevents such that for ; then may be verified to be a stochastic subset of . Thus for instance is the stochastic union of and . Similarly for countable unions of stochastic subsets of , although for uncountable unions are extremely problematic (they are disliked by both the measure theory and the countable gluing axiom) and will not be defined here. Finally, the stochastic difference set is defined as the set of all in such that for any subevent of of positive probability. One may verify that in the case when is discrete and at most countable, these Boolean operations correspond to the classical Boolean operations applied separately to each fibre of the relevant sets . We also leave as an exercise to the reader to verify the usual laws of Boolean arithmetic, e.g. the de Morgan laws, provided that one works with at most countable unions and intersections.
One can also consider a stochastic finite union in which the number of sets in the union is itself stochastic. More precisely, let be a stochastic set, let be a stochastic natural number, and let be a stochastic function from the stochastic set (defined by setting )) to the stochastic power set . Here we are considering to be a natural number, to allow for unions that are possibly empty, with used for the positive natural numbers. We also write for the stochastic function . Then we can define the stochastic union by setting for an event to be the set of local elements with the property that there exists a covering of by measurable subevents for , such that one has and . One can verify that is a stochastic set (with the obvious restriction maps). Again, in the model case when is discrete and at most countable, the fibre is what one would expect it to be, namely .
The Cartesian product of two stochastic sets may be defined by setting for all events , with the obvious restriction maps; this is easily seen to be another stochastic set. This lets one define the concept of a -ary operation from stochastic sets to another stochastic set , or a -ary relation . In particular, given for , the relation may be deterministically true, deterministically false, or have some other stochastic truth value.
Remark 3 In the degenerate case when is null, stochastic logic becomes a bit weird: all stochastic statements are deterministically true, as are their stochastic negations, since every event in (even the empty set) now holds with full probability. Among other pathologies, the empty set now has a global element over (this is analogous to the notorious convention ), and any two deterministic objects become equal over : .
The following simple observation is crucial to subsequent discussion. If is a sequence taking values in the global elements of a stochastic space , then we may also define global elements for stochastic indices as well, by appealing to the countable gluing axiom to glue together restricted to the set for each deterministic natural number to form . With this definition, the map is a stochastic function from to ; indeed, this creates a one-to-one correspondence between external sequences (maps from to ) and stochastic sequences (stochastic functions from to ). Similarly with replaced by any other at most countable set. This observation will be important in allowing many deterministic arguments involving sequences will be able to be carried over to the stochastic setting.
We now specialise from the extremely broad discipline of set theory to the more focused discipline of real analysis. There are two fundamental axioms that underlie real analysis (and in particular distinguishes it from real algebra). The first is the Archimedean property, which we phrase in the “no infinitesimal” formulation as follows:
Proposition 2 (Archimedean property) Let be such that for all positive natural numbers . Then .
The other is the least upper bound axiom:
Proposition 3 (Least upper bound axiom) Let be a non-empty subset of which has an upper bound , thus for all . Then there exists a unique real number with the following properties:
- for all .
- For any real , there exists such that .
- .
Furthermore, does not depend on the choice of .
The Archimedean property extends easily to the stochastic setting:
Proposition 4 (Stochastic Archimedean property) Let be such that for all deterministic natural numbers . Then .
Remark 4 Here, incidentally, is one place in which this stochastic formalism deviates from the nonstandard analysis formalism, as the latter certainly permits the existence of infinitesimal elements. On the other hand, we caution that stochastic real numbers are permitted to be unbounded, so that formulation of Archimedean property is not valid in the stochastic setting.
The proof is easy and is left to the reader. The least upper bound axiom also extends nicely to the stochastic setting, but the proof requires more work (in particular, our argument uses the monotone convergence theorem):
Theorem 5 (Stochastic least upper bound axiom) Let be a stochastic subset of which has a global upper bound , thus for all , and is globally non-empty in the sense that there is at least one global element . Then there exists a unique stochastic real number with the following properties:
- for all .
- For any stochastic real , there exists such that .
- .
Furthermore, does not depend on the choice of .
For future reference, we note that the same result holds with replaced by throughout, since the latter may be embedded in the former, for instance by mapping to and to . In applications, the above theorem serves as a reasonable substitute for the countable axiom of choice, which does not appear to hold in unrestricted generality relative to a measure space; in particular, it can be used to generate various extremising sequences for stochastic functionals on various stochastic function spaces.
Proof: Uniqueness is clear (using the Archimedean property), as well as the independence on , so we turn to existence. By using an order-preserving map from to (e.g. ) we may assume that is a subset of , and that .
We observe that is a lattice: if , then and also lie in . Indeed, may be formed by appealing to the countable gluing axiom to glue (restricted the set ) with (restricted to the set ), and similarly for . (Here we use the fact that relations such as are Borel measurable on .)
Let denote the deterministic quantity
then (by Proposition 3!) is well-defined; here we use the hypothesis that is finite. Thus we may find a sequence of elements of such that
Using the lattice property, we may assume that the are non-decreasing: whenever . If we then define (after choosing measurable representatives of each equivalence class ), then is a stochastic real with .
If , then , and so
From this and (1) we conclude that
From monotone convergence, we conclude that
and so , as required.
Now let be a stochastic real. After choosing measurable representatives of each relevant equivalence class, we see that for almost every , we can find a natural number with . If we choose to be the first such positive natural number when it exists, and (say) otherwise, then is a stochastic positive natural number and . The claim follows.
Remark 5 One can abstract away the role of the measure here, leaving only the ideal of null sets. The property that the measure is finite is then replaced by the more general property that given any non-empty family of measurable sets, there is an at most countable union of sets in that family that is an upper bound modulo null sets for all elements in that faily.
Using Proposition 4 and Theorem 5, one can then revisit many of the other foundational results of deterministic real analysis, and develop stochastic analogues; we give some examples of this below the fold (focusing on the Heine-Borel theorem and a case of the spectral theorem). As an application of this formalism, we revisit some of the Furstenberg-Zimmer structural theory of measure-preserving systems, particularly that of relatively compact and relatively weakly mixing systems, and interpret them in this framework, basically as stochastic versions of compact and weakly mixing systems (though with the caveat that the shift map is allowed to act non-trivially on the underlying probability space). As this formalism is “point-free”, in that it avoids explicit use of fibres and disintegrations, it will be well suited for generalising this structure theory to settings in which the underlying probability spaces are not standard Borel, and the underlying groups are uncountable; I hope to discuss such generalisations in future blog posts.
Remark 6 Roughly speaking, stochastic real analysis can be viewed as a restricted subset of classical real analysis in which all operations have to be “measurable” with respect to the base space. In particular, indiscriminate application of the axiom of choice is not permitted, and one should largely restrict oneself to performing countable unions and intersections rather than arbitrary unions or intersections. Presumably one can formalise this intuition with a suitable “countable transfer principle”, but I was not able to formulate a clean and general principle of this sort, instead verifying various assertions about stochastic objects by hand rather than by direct transfer from the deterministic setting. However, it would be desirable to have such a principle, since otherwise one is faced with the tedious task of redoing all the foundations of real analysis (or whatever other base theory of mathematics one is going to be working in) in the stochastic setting by carefully repeating all the arguments.
More generally, topos theory is a good formalism for capturing precisely the informal idea of performing mathematics with certain operations, such as the axiom of choice, the law of the excluded middle, or arbitrary unions and intersections, being somehow “prohibited” or otherwise “restricted”.
— 1. Metric spaces relative to a finite measure space —
The definition of a metric space carries over in the obvious fashion to the stochastic setting:
Definition 6 (Stochastic metric spaces) A stochastic metric space is defined to be a stochastic set , together with a stochastic function that obeys the following axioms for each event :
- (Non-degeneracy) If , then if and only if .
- (Symmetry) If , then .
- (Triangle inequality) If , then .
Remark 7 One could potentially interpret the non-degeneracy axiom in two ways; either deterministically ( is deterministically true if and only if is deterministically true) or stochastically (“ if and only if ” is deterministically true). However, it is easy to see by a gluing argument that the two interpretations are logically equivalent. Also, if is globally non-empty, then one only needs to verify the metric space axioms for , as one can then obtain the cases by gluing with a global section on . However, when has no global elements, it becomes necessary to work locally.
Note that if is a deterministic measurable metric space (thus is a measurable space equipped with a measurable metric ), then its stochastic counterpart is a stochastic metric space. (As usual, we do not attempt to interpret when there is no measurable structure present for .) In the case of a discrete at most countable (and after deleting any points of measure zero), a stochastic metric space is essentially just a bundle of metric spaces, with no relations constraining these metric spaces with each other (for instance, the cardinality of may vary arbitrarily with ).
We extend the notion of convergence in stochastic metric spaces:
Definition 7 (Stochastic convergence) Let be a stochastic metric space, and let be a sequence in (which, as discussed earlier, may be viewed as a stochastic function from to ). Let be an element of .
- We say that stochastically converges to if, for every stochastic real , there exists a stochastic positive natural number such that for all stochastic positive natural numbers with .
- We say that is stochastically Cauchy if, for every stochastic real , there exists a stochastic natural number such that for all stochastic natural numbers with .
- We say that is stochastically complete if every stochastically Cauchy sequence is stochastically convergent, and furthermore for any event in , any stochastically Cauchy sequence relative to is stochastically convergent relative to .
As usual, the additional localisation in the definition of stochastic completeness to an event is needed to avoid a stochastic set being stochastically complete for the trivial reason that one of its fibres happens to be empty, so that there are no global elements of the stochastic set, only local elements. (This localisation is not needed for the notions of stochastic convergence or the stochastic Cauchy property, as these automatically are preserved by localisation.)
Exercise 3 Show that to verify stochastic convergence, it suffices to restrict attention to errors of the form for deterministic positive natural numbers . Similarly for the stochastically Cauchy property.
Exercise 4 Let be a measurable metric space. Show that is stochastically complete if and only if is complete. Thus for instance is stochastically complete.
In the case when is discrete and at most countable, or when is the stochastic version of a deterministic measurable space , stochastic convergence is just the familiar notion of almost sure convergence: converges stochastically to if and only if, for almost every , converges to in . There is no uniformity of convergence in the parameter; such a uniformity could be imposed by requiring the quantity in the above definition to be a deterministic natural number rather than a stochastic one, but we will not need this notion here. Similarly for the stochastic Cauchy property. Stochastic completeness in this context is then equivalent to completeness of for each that occurs with positive probability. (As noted previously, it is important here that we define stochastic completeness with localisation, in case some of the fibres are empty.)
In a stochastic metric space , we can form the balls for any and stochastic real , by setting to be the set of all such that locally on ; these are stochastic subsets of (indeed, is the inverse image of under the pinned distance map ).
By chasing the definitions, we see that if is a sequence of elements of a stochastic metric space , and is an element of , then stochastically converges to if and only if, for every stochastic , there exists a stochastic natural positive number such that for all stochastic positive natural numbers .
Given a sequence of elements of a stochastic metric space , we define a stochastic subsequence to be a sequence of the form , where is a sequence of stochastic natural numbers , which stochastically go to infinity in the following sense: for every stochastic positive natural number , there exists a stochastic positive natural number such that for all stochastic positive natural numbers . Note that when is discrete and at most countable, this operation corresponds to selecting a subsequence of for each occurring with positive probability, with the indices of the subsequence permitted to vary in .
Exercise 5 Let be a sequence of elements of a stochastic metric space , and let .
- (i) Show that can converge stochastically to at most one element of .
- (ii) Show that if converges stochastically to , then every stochastic subsequence also converges stochastically to .
- (iii) Show that if is stochastically Cauchy, and some stochastic subsequence of converges stochastically to , then the entire sequence converges stochastically to .
- (iv) Show that there exists an event , unique up to null events, with the property that converges stochastically to , and that there exists a stochastic over the complement of , with the property that for any stochastic natural number on , there exists such that . (Informally, is the set of states for which converges to ; the key point is that this set is automatically measurable.)
- (v) (Urysohn subsequence principle) Show that converges stochastically to if and only if every stochastic subsequence of has a further stochastic subsequence that converges stochastically to .
(Hint: All of these exercises can be established through consideration of the events for , defined up to null events as the event that holds stochastically.)
Next, we define the stochastic counterpart of total boundedness.
Definition 8 (Total boundedness) A stochastic metric space is said to be stochastically totally bounded if, for every stochastic real , there exists a stochastic natural number and a stochastic function from the stochastic set to , such that
(Note that we allow to be zero locally or globally; thus for instance the empty set is considered to be totally bounded.) We will denote this stochastic function as .
Exercise 6 If is discrete and at most countable, show that is stochastically totally bounded if and only if for each of positive probability, the fibre is totally bounded in the deterministic sense.
Exercise 7 Show that to verify the stochastic total boundedness of a stochastic metric space, it suffices to do so for parameters of the form for some deterministic positive natural number .
We have a stochastic version of (a fragment of) the Heine-Borel theorem:
Theorem 9 (Stochastic Heine-Borel theorem) Let be a stochastic metric space. Then the following are equivalent:
- (i) is stochastically complete and stochastically totally bounded.
- (ii) Every sequence in has a stochastic subsequence that is stochastically convergent. Furthermore, for any event , every sequence in has a stochastic subsequence that is stochastically convergent relative to .
As with the definition of stochastic completeness, the second part of (ii) is necessary: if for instance is discrete and countable, and one of the fibres happens to be empty, then there are no global elements of and the first part of (ii) becomes trivially true, even if other fibres of fail to be complete or totally bounded.
Inspired by the above theorem, we will call a stochastic metric space stochastically compact if (i) or (ii) holds. Note that this only recovers a fragment of the deterministic Heine-Borel theorem, as the characterisation of compactness in terms of open covers is missing. I was not able to set up a characterisation of this form, since one was only allowed to use countable unions; but perhaps some version of this characterisation can be salvaged.
Proof: The basic idea here is to mimic the classical proof of this fragment of the Heine-Borel theorem, taking care to avoid any internal appeal to the countable axiom of choice in order to keep everything measurable. (However, we can and will use the axiom of countable choice externally in the ambient set theory.)
Suppose first that fails to be stochastically complete. Then we can find an event and a stochastically Cauchy sequence for that fails to be stochastically convergent in . By Exercise 5, no stochastic subsequence of can be stochastically convergent in either, and so (ii) fails.
Now suppose that fails to be stochastically bounded. Then one can find a stochastic real number , such that it is not possible to find any stochastic natural number and a stochastic sequence (that is, a stochastic function from to ), such that
(By Exercise 7 one could take for a deterministic positive natural , but we will not need to do so here.)
Let be the set of those for which one can find a stochastic sequence which is -separated in the sense that for all distinct with , and more generally for any event , that relative to for all distinct with . (We need to relativise to here to properly manage the case that sometimes vanishes.) It is easy to see that can be given the structure of a stochastic subset of , and contains . By Theorem 5, there is thus a well-defined supremum . We claim that is stochastically infinite with positive probability. Suppose for contradiction that this were not the case, then . By definition of supremum (taking in Theorem 5), we conclude that , thus there exists a stochastic sequence which is -separated. We now claim that
which contradicts the hypothesis that is not stochastically totally bounded. Indeed, if (2) failed, then there must exist some local element of which does not lie in . In particular, there must exist an event of positive probability such that on for all with . If we then define on by , then we see that on is -separated on , and on gluing with the original on the complement of , we see that lies in , contradicting the maximal nature of . Thus is stochastically infinite with positive probability.
We may now pass to an event of positive probability on which . By definition of the supremum, we conclude that for every deterministic natural number , we may find a sequence which are -separated. Observe that if is a deterministic natural number and we have elements , then we can find a stochastic on such that for all , since each can stochastically lie within of at most one . (To see this rigorously, one can consider the Boolean geometry of the events on which stochastically hold for various .) By iterating this construction (and applying the axiom of countable choice externally), we may find an infinite sequence in which is -separated, but then this sequence cannot have a convergent subsequence, and so (ii) fails.
Now suppose that is stochastically complete and stochastically totally bounded, and let be a sequence of local elements of for some event , which we may assume without loss of generality to have positive probability. By stochastic completeness, it suffices to find a stochastic subsequence which is stochastically Cauchy on .
By stochastic total boundedness, one can find a stochastic natural number and a stochastic map from to , such that
For each deterministic positive natural numbers , we define to be the event in that the assertions and both hold stochastically; this event is determined up to null events. From (3), we see that
holds up to null events for all . In particular, we have
almost surely on for all , and so on summing in
almost surely on . By selecting stochastically to be the least for which is infinite, we have and
almost surely on . We can then stochastically choose a sequence in such that holds almost surely on for each , or equivalently that the stochastic subsequence lies in . Writing , we have thus localised this stochastic subsequence to a stochastic unit ball .
By repeating this argument, we may find a further stochastic subsequence of that lies in for some , a yet further subsequence that lies in for some , and so forth. It is then easy to see that the diagonal sequence is stochastically Cauchy, and the claim follows.
For future reference, we remark that the above arguments also show that if is a stochastically totally bounded subset of a stochastically complete metric space , then every sequence in has a stochastic susbequence which converges in .
— 2. Hilbert-Schmidt operators relative to a finite measure space —
One could continue developing stochastic versions of other fundamental results in real analysis (for instance, working out the basic theory of stochastic continuous functions between metric spaces); roughly speaking, it appears that most of these results will go through as long as one does not require the concept of an uncountable union or intersection or the axiom of choice (in particular, I do not see how to develop a stochastic theory of arbitrary topological spaces, although the first countable case may be doable; also, any result reliant on the Hahn-Banach theorem or the non-sequential version of Tychonoff’s theorem will likely not have a good stochastic analogue). I will however focus on the results leading up to the stochastic version of the spectral theorem for Hilbert-Schmidt operators, as this is the application that motivated my post.
Let us first define the concept of a stochastic (real) Hilbert space, in more or less complete analogy with the deterministic counterpart:
Definition 10 (Stochastic Hilbert spaces) A stochastic vector space is a stochastic set equipped with an element , an addition map , and a scalar multiplication map which obeys the usual vector space axioms. In other words, when localising to any event , the addition map is commutative and associative with identity , and the scalar multiplication map is bilinear over . In other words, is a module over the commutative ring . As is usual, we define the subtraction map by the formula .
A stochastic inner product space is a stochastic vector space equipped with an inner product map which obeys the following axioms for any event :
- (Symmetry) The map is symmetric.
- (Bilinearity) The map is bilinear over .
- (Positive semi-definiteness) For any , we have , with equality if and only if .
By repeating the usual deterministic arguments, it is easy to see that any stochastic inner product space becomes a stochastic metric space with , where .
A stochastic Hilbert space is a stochastic inner product space which is also stochastically complete. We denote the inner product on such spaces by and the norm by .
As usual, in the model case when is discrete and at most countable, a stochastic Hilbert space is just a bundle of deterministic Hilbert spaces for each occurring with positive probability, with no relationships between the different fibres (in particular, their dimensions may vary arbitrarily in ). In the continuous case, the notion of a stochastic Hilbert space is very closely related to that of (an extended version of) a Hilbert module over the commutative Banach algebra ; indeed, it is easy to see that the space of global elements of a stochastic Hilbert space which are bounded in the sense that for some deterministic real forms a Hilbert module over . (Without the boundedness restriction, one obtains instead a module over .)
Note that we do not impose any separability hypothesis on our Hilbert spaces. Despite this, much of the theory of Hilbert spaces turns out to still be of “countable complexity” in some sense, so that it can be extended to the stochastic setting without too much difficulty.
We now extend the familiar notion of an orthonormal system in a Hilbert space to the stochastic setting. A key point is that we allow the number of elements in this system to also be stochastic.
Definition 11 (Orthonormal system) Let be a stochastic Hilbert space. A stochastic orthonormal system in consists of a stochastic extended natural number , together with a stochastic map from to , such that one has on for any event and any with . (Note that we allow to vanish with positive probability, so that the orthonormal system can be stochastically empty.)
Now we can define the notion of a stochastic Hilbert-Schmidt operator.
Definition 12 (Stochastic Hilbert-Schmidt operator) Let and be stochastic Hilbert spaces. A stochastic linear operator is a stochastic function such that for each event , the localised maps are linear over . Such an operator is said to be stochastically bounded if there exists a non-negative stochastic real such that one has
for all events and local elements . By (the negation of) Theorem 5, there is a least such , which we denote as .
Similarly, we say that a stochastic linear operator is stochastically Hilbert-Schmidt if there exists a non-negative stochastic real such that one has
for all events and all stochastic orthonormal systems on and respectively. Again, there is a least such , which we denote as .
A stochastic linear operator is said to be compact if the image of the unit ball is stochastically totally bounded in .
Exercise 8 Show that any stochastic Hilbert-Schmidt operator obeys the bound
for all events and all stochastic orthonormal systems on . Conclude in particular that is stochastically bounded with .
We have the following basic fact:
Proposition 13 Any stochastic Hilbert-Schmidt operator is stochastically compact.
Proof: Suppose for contradiction that we could find a stochastic Hilbert-Schmidt operator which is not stochastically compact, thus is not stochastically totally bounded. By repeating the arguments used in the proof of Theorem 9, this means that there exists an event of positive probability, a stochastic real on , and an infinite sequence for such that the are -separated on .
We will need a stronger separation property. Let us say that a sequence is linearly -separated if one has
on for any deterministic and any stochastic reals . We claim that contains an infinite sequence that is linearly -separated. Indeed, suppose that we have already found a finite sequence in that is linearly -separated for some , and wish to add on a further element while preserving the linear -separation property, that is to say we wish to have (4) for all . By Exercise 8, such a would already lie in the closed ball . Now, by elementary geometry (applying a Gram-Schmidt process to the ) one can cover the stochastic set
by a finite union of balls
for some stochastic and some stochastic finite sequence of points in . Stochastically, each of these balls may contain at most one of the ; if we then define the stochastic positive natural number to be the least that stochastically lies outside all of the , then is well-defined, and if we set , we obtain the desired property (4).
As each lies in , we have for some with . From the Gram-Schmidt process, one may find an orthonormal system in for some such that each is a linear combination (over ) of those with . We may similarly find an orthonormal system in for some such that each is a linear combination of those with . From (4) we conclude that and that for each deterministic , the coefficient of has magnitude at least , thus
and thus by the Pythagoras theorem
on ; summing in , we contradict the Hilbert-Schmidt nature of .
Next, we establish the existence of adjoints:
Theorem 14 (Adjoint operator) Let be a stochastically bounded linear operator. Then there exists a unique stochastically bounded linear operator such that
on any event and any , . In particular we have .
Proof: Uniqueness is an easy exercise that we leave to the reader, so we focus on existence. The point here is that the Riesz representation theorem for Hilbert spaces is sufficiently “constructive” that it can be translated to the stochastic setting.
Let be an event and be a local element of . We let be the stochastic set on defined by setting for to be the set of all stochastic real numbers of the form , where with . By Theorem 5, we may then find a sequence for such that converges stochastically to on . For any two , we have from the parallelogram law that
and hence by homogeneity
on combining this with the stochastic convergence of , we conclude that is stochastically Cauchy on the event in that is non-zero. Setting to be the stochastic limit of the on this event (and set to on the complementary event), we see that and
On the event that is non-zero, is thus non-zero, and consideration of the vectors for stochastic real and stochastic vectors soon reveals that
whenever , which by elementary linear algebra gives a representation of the form
for some (a scalar multiple of ); when vanishes, we simply take . It is then a routine matter to verify that is a stochastically bounded linear operator, and the claim follows.
We use this to relativise the spectral theorem (or more precisely, the singular value decomposition) for compact operators:
Theorem 15 (Spectral theorem for stochastically compact operators) Let be a stochastically compact linear operator, with also stochastically compact. Then there exists , orthonormal systems and of and respectively, and a stochastic sequence in such that on an event whenever are stochastic natural numbers on , and such that the go to zero in the sense that for any stochastic real on an event , there exist a stochastic natural number on such that on whenever is a stochastic natural number on . Furthermore, for any event and , one has
on . (Note that a Bessel inequality argument shows that the series is convergent; indeed it is even unconditionally convergent.)
It is likely that the hypothesis that be stochastically compact is redundant, in that it is implied by the stochastically compact nature of , but I did not attempt to prove this rigorously as it was not needed for my application (which is focused on the Hilbert-Schmidt case).
To prove this theorem, we first establish a fragment of it for the top singular value :
Theorem 16 (Largest singular value) Let be a stochastically compact linear operator, and let be the event where (this event is well-defined up to a null event). Then there exist , with on , such that
and dually that
on .
Proof: Note that are necessarily non-trivial on . Let denote the set of all expressions of the form on , where , with on , then is a globally non-empty stochastic subset of which has as an upper bound. Indeed, from Theorem 5 and the definition of , it is not hard to see that . From this, we may construct a sequence in that converges stochastically to on , and hence we may find sequences , for with on with stochastically convergent to . By the Cauchy-Schwarz inequality, this implies that is stochastically convergent to ; from the parallelogram law applied to and , we conclude that converges stochastically to zero. On the other hand, as is compact, we can pass to a stochastic subsequence and ensure that is stochastically convergent, thus is also stochastically convergent to some limit . Similar considerations using the adjoint operator allow us to assume that is stochastically convergent to some limit . It is then routine to verify that , , and , giving the claim.
Now we prove Theorem 15.
Proof: (Proof of Theorem 15.) Define a partial singular value decomposition to consist of the following data:
such that, for any event , and any with ,
We let be the set of all that can arise from a partial singular value decomposition; then is a stochastic subset of that contains , and by Theorem 5 we can form the supremum .
Let us first localise to the event that is stochastically finite. As in the proof of the Heine-Borel theorem, we can use the discrete nature of the natural numbers to conclude that on . Thus there exists a partial singular value decomposition on with .
Define on by setting for to be the set of all that are orthogonal to all the with ; this can easily be seen to be a stochastic Hilbert space (a stochastically finite codimension subspace of ). Similarly define on by setting to be the set of all that are orthogonal to all the with . As and , we see that maps to , and maps to ; from the remaining axioms of a partial singular value decomposition we see that on . If vanishes, then vanishes on , and one easily obtains the required singular value decomposition in . Now suppose for contradiction that does not (deterministically) vanish, so there is a subevent of of positive probability on which is positive. By Theorem 16, we can then find unit vectors and such that
and
If we then set , we can obtain a partial singular value decomposition on with now set to ; gluing this with the original partial singular value of decomposition on the complement of , we contradict the maximality of . This concludes the proof of the spectral theorem on the event that .
Now we localise to the complementary event that is infinite. Now we need to run a compactness argument before we can ensure that actually lies in . Namely, for any deterministic natural number , we can find a partial singular value decomposition with data on such that . We now claim that the decay in uniformly in in the following sense: for any deterministic real , there exists a stochastic such that whenever and are such that . Indeed, from the total boundedness of , one can cover this space by a union of balls of radius for some . If is such that on some event of positive probability, then the vectors for are -separated on by Pythagoras’s theorem, leading to a contradiction since each ball can capture at most one of these vectors. This gives the claim.
By repeatedly passing to stochastic subsequences and diagonalising, we may assume that converges stochastically to a limit as for each which is non-increasing. By compactness of , we may also assume that the are stochastically convergent in for each fixed , which implies that the converge stochastically to a limit whenever . A similar argument using the compactness of allows us to assume that converges stochastically to a limit whenever . One then easily verifies that the and are orthonormal systems when restricted to those for which . Furthermore, a limiting argument shows that whenever is a deterministic real, is an event, and is a unit vector orthogonal to for those with , then . From this and a decomposition into orthonormal bases and a limiting argument we see that
on for any , and the claim follows.
Finally, we specialise to the example of Hilbert modules from Example 3.
Corollary 17 (Singular value decomposition on Hilbert modules) Let be extensions of a finite measure space , with factor maps and . Let be a bounded linear map (in the sense) which is also linear over (which embeds via pullback into and ); note that may be extended to a linear map from to . Assume the following Hilbert-Schmidt property: there exists a measurable such that
for all measurable and all that are orthonormal systems over in the sense that
whenever , and similarly
whenever . Then one can find a measurable , orthonormal systems , and defined for that are non-increasing and decay to zero as (in the case ), such that
for all .
In the case that and are standard Borel, one can obtain this result from the classical spectral theorem via a disintegration argument. However, without such a standard Borel assumption, the most natural way to proceed appears to be through the above topos-theoretic machinery. This result can be used to establish some of the basic facts of the Furstenberg-Zimmer structure theory of measure-preserving systems, and specifically that weakly mixing functions relative to a given factor form the orthogonal complement to compact extensions of that factor, and that such compact extensions are the inverse limit of finite rank extensions. With the above formalism, this can be done even for measure spaces that are not standard Borel, and actions of groups that are not countable; I hope to discuss this in a subsequent post.
In view of this similarity, it is not surprising that the partial progress on these two conjectures have tracked each other fairly closely; the twin prime conjecture is generally considered slightly easier than the binary Goldbach conjecture, but broadly speaking any progress made on one of the conjectures has also led to a comparable amount of progress on the other. (For instance, Chen’s theorem has a version for the twin prime conjecture, and a version for the binary Goldbach conjecture.) Also, the notorious parity obstruction is present in both problems, preventing a solution to either conjecture by almost all known methods (see this previous blog post for more discussion).
In this post, I would like to note a divergence from this general principle, with regards to bounded error versions of these two conjectures:
The first of these statements is now a well-known theorem of Zhang, and the Polymath8b project hosted on this blog has managed to lower to unconditionally, and to assuming the generalised Elliott-Halberstam conjecture. However, the second statement remains open; the best result that the Polymath8b project could manage in this direction is that (assuming GEH) at least one of the binary Goldbach conjecture with bounded error, or the twin prime conjecture with no error, had to be true.
All the known proofs of Zhang’s theorem proceed through sieve-theoretic means. Basically, they take as input equidistribution results that control the size of discrepancies such as
for various congruence classes and various arithmetic functions , e.g. (or more generaly for various ). After taking some carefully chosen linear combinations of these discrepancies, and using the trivial positivity lower bound
one eventually obtains (for suitable ) a non-trivial lower bound of the form
where is some weight function, and is the set of such that there are at least two primes in the interval . This implies at least one solution to the inequalities with , and Zhang’s theorem follows.
In a similar vein, one could hope to use bounds on discrepancies such as (1) (for comparable to ), together with the trivial lower bound (2), to obtain (for sufficiently large , and suitable ) a non-trivial lower bound of the form
for some weight function , where is the set of such that there is at least one prime in each of the intervals and . This would imply the binary Goldbach conjecture with bounded error.
However, the parity obstruction blocks such a strategy from working (for much the same reason that it blocks any bound of the form in Zhang’s theorem, as discussed in the Polymath8b paper.) The reason is as follows. The sieve-theoretic arguments are linear with respect to the summation, and as such, any such sieve-theoretic argument would automatically also work in a weighted setting in which the summation is weighted by some non-negative weight . More precisely, if one could control the weighted discrepancies
to essentially the same accuracy as the unweighted discrepancies (1), then thanks to the trivial weighted version
of (2), any sieve-theoretic argument that was capable of proving (3) would also be capable of proving the weighted estimate
However, (4) may be defeated by a suitable choice of weight , namely
where is the Liouville function, which counts the parity of the number of prime factors of a given number . Since , one can expand out as the sum of and a finite number of other terms, each of which consists of the product of two or more translates (or reflections) of . But from the Möbius randomness principle (or its analogue for the Liouville function), such products of are widely expected to be essentially orthogonal to any arithmetic function that is arising from a single multiplicative function such as , even on very short arithmetic progressions. As such, replacing by in (1) should have a negligible effect on the discrepancy. On the other hand, in order for to be non-zero, has to have the same sign as and hence the opposite sign to cannot simultaneously be prime for any , and so vanishes identically, contradicting (4). This indirectly rules out any modification of the Goldston-Pintz-Yildirim/Zhang method for establishing the binary Goldbach conjecture with bounded error.
The above argument is not watertight, and one could envisage some ways around this problem. One of them is that the Möbius randomness principle could simply be false, in which case the parity obstruction vanishes. A good example of this is the result of Heath-Brown that shows that if there are infinitely many Siegel zeroes (which is a strong violation of the Möbius randomness principle), then the twin prime conjecture holds. Another way around the obstruction is to start controlling the discrepancy (1) for functions that are combinations of more than one multiplicative function, e.g. . However, controlling such functions looks to be at least as difficult as the twin prime conjecture (which is morally equivalent to obtaining non-trivial lower-bounds for ). A third option is not to use a sieve-theoretic argument, but to try a different method (e.g. the circle method). However, most other known methods also exhibit linearity in the “” variable and I would suspect they would be vulnerable to a similar obstruction. (In any case, the circle method specifically has some other difficulties in tackling binary problems, as discussed in this previous post.)
Let be of degree , so that is irrational. A classical theorem of Liouville gives the quantitative bound
for the irrationality of fails to be approximated by rational numbers , where depends on but not on . Indeed, if one lets be the Galois conjugates of , then the quantity is a non-zero natural number divided by a constant, and so we have the trivial lower bound
from which the bound (1) easily follows. A well known corollary of the bound (1) is that Liouville numbers are automatically transcendental.
The famous theorem of Thue, Siegel and Roth improves the bound (1) to
for any and rationals , where depends on but not on . Apart from the in the exponent and the implied constant, this bound is optimal, as can be seen from Dirichlet’s theorem. This theorem is a good example of the ineffectivity phenomenon that affects a large portion of modern number theory: the implied constant in the notation is known to be finite, but there is no explicit bound for it in terms of the coefficients of the polynomial defining (in contrast to (1), for which an effective bound may be easily established). This is ultimately due to the reliance on the “dueling conspiracy” (or “repulsion phenomenon”) strategy. We do not as yet have a good way to rule out one counterexample to (2), in which is far closer to than ; however we can rule out two such counterexamples, by playing them off of each other.
A powerful strengthening of the Thue-Siegel-Roth theorem is given by the subspace theorem, first proven by Schmidt and then generalised further by several authors. To motivate the theorem, first observe that the Thue-Siegel-Roth theorem may be rephrased as a bound of the form
for any algebraic numbers with and linearly independent (over the algebraic numbers), and any and , with the exception when or are rationally dependent (i.e. one is a rational multiple of the other), in which case one has to remove some lines (i.e. subspaces in ) of rational slope from the space of pairs to which the bound (3) does not apply (namely, those lines for which the left-hand side vanishes). Here can depend on but not on . More generally, we have
Theorem 1 (Schmidt subspace theorem) Let be a natural number. Let be linearly independent linear forms. Then for any , one has the bound
for all , outside of a finite number of proper subspaces of , where
and depends on and the , but is independent of .
Being a generalisation of the Thue-Siegel-Roth theorem, it is unsurprising that the known proofs of the subspace theorem are also ineffective with regards to the constant . (However, the number of exceptional subspaces may be bounded effectively; cf. the situation with the Skolem-Mahler-Lech theorem, discussed in this previous blog post.) Once again, the lower bound here is basically sharp except for the factor and the implied constant: given any with , a simple volume packing argument (the same one used to prove the Dirichlet approximation theorem) shows that for any sufficiently large , one can find integers , not all zero, such that
for all . Thus one can get comparable to in many different ways.
There are important generalisations of the subspace theorem to other number fields than the rationals (and to other valuations than the Archimedean valuation ); we will develop one such generalisation below.
The subspace theorem is one of many finiteness theorems in Diophantine geometry; in this case, it is the number of exceptional subspaces which is finite. It turns out that finiteness theorems are very compatible with the language of nonstandard analysis. (See this previous blog post for a review of the basics of nonstandard analysis, and in particular for the nonstandard interpretation of asymptotic notation such as and .) The reason for this is that a standard set is finite if and only if it contains no strictly nonstandard elements (that is to say, elements of ). This makes for a clean formulation of finiteness theorems in the nonstandard setting. For instance, the standard form of Bezout’s theorem asserts that if are coprime polynomials over some field, then the curves and intersect in only finitely many points. The nonstandard version of this is then
Theorem 2 (Bezout’s theorem, nonstandard form) Let be standard coprime polynomials. Then there are no strictly nonstandard solutions to .
Now we reformulate Theorem 1 in nonstandard language. We need a definition:
Definition 3 (General position) Let be nested fields. A point in is said to be in -general position if it is not contained in any hyperplane of definable over , or equivalently if one has
for any .
Theorem 4 (Schmidt subspace theorem, nonstandard version) Let be a standard natural number. Let be linearly independent standard linear forms. Let be a tuple of nonstandard integers which is in -general position (in particular, this forces to be strictly nonstandard). Then one has
where we extend from to (and also similarly extend from to ) in the usual fashion.
Observe that (as is usual when translating to nonstandard analysis) some of the epsilons and quantifiers that are present in the standard version become hidden in the nonstandard framework, being moved inside concepts such as “strictly nonstandard” or “general position”. We remark that as is in -general position, it is also in -general position (as an easy Galois-theoretic argument shows), and the requirement that the are linearly independent is thus equivalent to being -linearly independent.
Exercise 1 Verify that Theorem 1 and Theorem 4 are equivalent. (Hint: there are only countably many proper subspaces of .)
We will not prove the subspace theorem here, but instead focus on a particular application of the subspace theorem, namely to counting integer points on curves. In this paper of Corvaja and Zannier, the subspace theorem was used to give a new proof of the following basic result of Siegel:
Theorem 5 (Siegel’s theorem on integer points) Let be an irreducible polynomial of two variables, such that the affine plane curve either has genus at least one, or has at least three points on the line at infinity, or both. Then has only finitely many integer points .
This is a finiteness theorem, and as such may be easily converted to a nonstandard form:
Theorem 6 (Siegel’s theorem, nonstandard form) Let be a standard irreducible polynomial of two variables, such that the affine plane curve either has genus at least one, or has at least three points on the line at infinity, or both. Then does not contain any strictly nonstandard integer points .
Note that Siegel’s theorem can fail for genus zero curves that only meet the line at infinity at just one or two points; the key examples here are the graphs for a polynomial , and the Pell equation curves . Siegel’s theorem can be compared with the more difficult theorem of Faltings, which establishes finiteness of rational points (not just integer points), but now needs the stricter requirement that the curve has genus at least two (to avoid the additional counterexample of elliptic curves of positive rank, which have infinitely many rational points).
The standard proofs of Siegel’s theorem rely on a combination of the Thue-Siegel-Roth theorem and a number of results on abelian varieties (notably the Mordell-Weil theorem). The Corvaja-Zannier argument rebalances the difficulty of the argument by replacing the Thue-Siegel-Roth theorem by the more powerful subspace theorem (in fact, they need one of the stronger versions of this theorem alluded to earlier), while greatly reducing the reliance on results on abelian varieties. Indeed, for curves with three or more points at infinity, no theory from abelian varieties is needed at all, while for the remaining cases, one mainly needs the existence of the Abel-Jacobi embedding, together with a relatively elementary theorem of Chevalley-Weil which is used in the proof of the Mordell-Weil theorem, but is significantly easier to prove.
The Corvaja-Zannier argument (together with several further applications of the subspace theorem) is presented nicely in this Bourbaki expose of Bilu. To establish the theorem in full generality requires a certain amount of algebraic number theory machinery, such as the theory of valuations on number fields, or of relative discriminants between such number fields. However, the basic ideas can be presented without much of this machinery by focusing on simple special cases of Siegel’s theorem. For instance, we can handle irreducible cubics that meet the line at infinity at exactly three points :
Theorem 7 (Siegel’s theorem with three points at infinity) Siegel’s theorem holds when the irreducible polynomial takes the form
for some quadratic polynomial and some distinct algebraic numbers .
Proof: We use the nonstandard formalism. Suppose for sake of contradiction that we can find a strictly nonstandard integer point on a curve of the indicated form. As this point is infinitesimally close to the line at infinity, must be infinitesimally close to one of ; without loss of generality we may assume that is infinitesimally close to .
We now use a version of the polynomial method, to find some polynomials of controlled degree that vanish to high order on the “arm” of the cubic curve that asymptotes to . More precisely, let be a large integer (actually will already suffice here), and consider the -vector space of polynomials of degree at most , and of degree at most in the variable; this space has dimension . Also, as one traverses the arm of , any polynomial in grows at a rate of at most , that is to say has a pole of order at most at the point at infinity . By performing Laurent expansions around this point (which is a non-singular point of , as the are assumed to be distinct), we may thus find a basis of , with the property that has a pole of order at most at for each .
From the control of the pole at , we have
for all . The exponents here become negative for , and on multiplying them all together we see that
This exponent is negative for large enough (or just take ). If we expand
for some algebraic numbers , then we thus have
for some standard . Note that the -dimensional vectors are linearly independent in , because the are linearly independent in . Applying the Schmidt subspace theorem in the contrapositive, we conclude that the -tuple is not in -general position. That is to say, one has a non-trivial constraint of the form
for some standard rational coefficients , not all zero. But, as is irreducible and cubic in , it has no common factor with the standard polynomial , so by Bezout’s theorem (Theorem 2) the constraint (4) only has standard solutions, contradicting the strictly nonstandard nature of .
Exercise 2 Rewrite the above argument so that it makes no reference to nonstandard analysis. (In this case, the rewriting is quite straightforward; however, there will be a subsequent argument in which the standard version is significantly messier than the nonstandard counterpart, which is the reason why I am working with the nonstandard formalism in this blog post.)
A similar argument works for higher degree curves that meet the line at infinity in three or more points, though if the curve has singularities at infinity then it becomes convenient to rely on the Riemann-Roch theorem to control the dimension of the analogue of the space . Note that when there are only two or fewer points at infinity, though, one cannot get the negative exponent of needed to usefully apply the subspace theorem. To deal with this case we require some additional tricks. For simplicity we focus on the case of Mordell curves, although it will be convenient to work with more general number fields than the rationals:
Theorem 8 (Siegel’s theorem for Mordell curves) Let be a non-zero integer. Then there are only finitely many integer solutions to . More generally, for any number field , and any nonzero , there are only finitely many algebraic integer solutions to , where is the ring of algebraic integers in .
Again, we will establish the nonstandard version. We need some additional notation:
Definition 9
We define an almost rational integer to be a nonstandard such that for some standard positive integer , and write for the -algebra of almost rational integers. If is a standard number field, we define an almost -integer to be a nonstandard such that for some standard positive integer , and write for the -algebra of almost -integers. We define an almost algebraic integer to be a nonstandard such that is a nonstandard algebraic integer for some standard positive integer , and write for the -algebra of almost algebraic integers.
Theorem 10 (Siegel for Mordell, nonstandard version) Let be a non-zero standard algebraic number. Then the curve does not contain any strictly nonstandard almost algebraic integer point.
Another way of phrasing this theorem is that if are strictly nonstandard almost algebraic integers, then is either strictly nonstandard or zero.
Exercise 3 Verify that Theorem 8 and Theorem 10 are equivalent.
Due to all the ineffectivity, our proof does not supply any bound on the solutions in terms of , even if one removes all references to nonstandard analysis. It is a conjecture of Hall (a special case of the notorious ABC conjecture) that one has the bound for all (or equivalently ), but even the weaker conjecture that are of polynomial size in is open. (The best known bounds are of exponential nature, and are proven using a version of Baker’s method: see for instance this text of Sprindzuk.)
A direct repetition of the arguments used to prove Theorem 7 will not work here, because the Mordell curve only hits the line at infinity at one point, . To get around this we will exploit the fact that the Mordell curve is an elliptic curve and thus has a group law on it. We will then divide all the integer points on this curve by two; as elliptic curves have four 2-torsion points, this will end up placing us in a situation like Theorem 7, with four points at infinity. However, there is an obstruction: it is not obvious that dividing an integer point on the Mordell curve by two will produce another integer point. However, this is essentially true (after enlarging the ring of integers slightly) thanks to a general principle of Chevalley and Weil, which can be worked out explicitly in the case of division by two on Mordell curves by relatively elementary means (relying mostly on unique factorisation of ideals of algebraic integers). We give the details below the fold.
— 1. Dividing by two on the Mordell curve —
This section will be elementary (in the sense that the arguments may be phrased in the first-order language of rings), and so it will make no difference whether we are working in the standard or nonstandard formalism. As such, we make no reference to nonstandard analysis here.
As is well known, any elliptic curve (after adjoining a point at infinity) has a group law , with whenever are distinct collinear points on , or if the tangent line at meets at another point . In the case of the Mordell curve , the double of a point is given by the formulae
as long as . (For , the double will be the point at infinity.) Geometrically, is the slope of the tangent line to at .
Over the complex numbers, the constraint removes three points from , where is the standard cube root of unity. This thrice punctured curve is no longer an affine plane curve, but one can make it affine again by incorporating as another coordinate, giving rise to the lifted curve
and the doubling map lifts to the polynomial map defined by
Over the complex numbers, it is well known that the elliptic curve is isomorphic as a group to the torus , which implies that the map is four-to-one. Now we consider the inversion problem explicitly: given a point , find a point such that
and
We would also like to avoid using division as much as possible, since in our application will be an integer point, and we would like to also be “close” to being integers too (in a sense to be made precise later). We can rearrange the above two equations as
and so we see that to find , it suffices to find , and furthermore if are “close” to integers, then are close to integers also (up to a single division by two). One can also check from a routine computation that if (6), (7), (5) hold, then we have , so that indeed lies in .
If one inserts (6), (7) into (5), one arrives at the quartic equation
One could solve this equation by the general quartic formula, but actually the formula simplifies substantially for this specific quartic equation, and can be obtained as follows. The Mordell equation can be rewritten as
We can take square roots and then write
where
As each is determined up to sign, and is fixed, there are exactly four choices for here (even when vanishes). For any such choice, if one sets
then on squaring and rearranging we have
and on squaring again
since
one soon sees that (8) holds. Thus we have found the four solutions to the equation by choosing the square roots of , and then defining by (9) and by (6), (7). In particular, if are (rational) integers, then are algebraic integers, and are algebraic integers divided by two.
— 2. The Chevalley-Weil principle —
The Chevalley-Weil principle asserts, roughly speaking, that if one has a “finite cover” of one affine variety by another , with the varieties and covering maps defined over the rationals, then every integer point in lifts to a “near”-integer point of . (There is also a version for projective varieties, which I will not discuss here; one can also generalise integers and rationals to other number fields.) To make the notion of “finite cover” precise, one needs the notion of an etale morphism; to make the notion of “near”-integer precise, we can use the notion of almost algebraic integer. We will not formalise the principle in full generality here; see for instance this text of Lang, this text of Hindry-Silverman, this text of Serre, or this text of Bombieri and Gubler, for a precise statement.
Here, we will focus on simple special cases of the Chevalley-Weil principle, in which one can work “by hand” using quite classical methods from algebraic number theory. We begin with a very elementary example, which in some sense goes all the way back to Diophantus himself:
Theorem 11 (Baby case of Chevalley-Weil) Let be a non-zero integer, and let be such that . Then are “nearly perfect squares” in the sense that one has , for some integers with dividing .
To interpret this result as a special case of the Chevalley-Weil principle, we take to be the affine plane curve , to be the affine curve , with covering map ; thus is a double cover of , and the theorem is asserting that integer points in are covered by near-integer points in (up to square roots of factors of ).
By transfer, the above theorem also applies in the setting where are non-standard integers and remains standard; in that case, now become nonstandard also, but remain standard. In particular, and become almost algebraic integers.
Proof: We can assume that , and hence and , are non-zero, since the case is easily verified. We use the fundamental theorem of arithmetic to factor into primes for some distinct primes and positive natural numbers , thus
On the other hand, the greatest common divisor of and is a divisor of . From this, we see that for each prime not dividing , will divide one of exactly times, and not divide the other, whereas for primes dividing , will either divide each of an even number of times, or an odd number of times. Collecting terms (including the units in the prime factorisations of ) to form , the claim follows.
Remark 1 One can reformulate the above argument by using the -adic valuations instead of the fundamental theorem of arithmetic. That formulation is more convenient when proving the Chevalley-Weil theorem in full generality.
Now we give a variant of the above theorem which is of relevance for our application. It will be convenient to phrase the variant in the nonstandard setting.
Theorem 12 (Toddler case of Chevalley-Weil) Let be a non-zero standard algebraic number, and let be a pair of almost algebraic integers such that . Then we can write , , , where are almost algebraic integers.
This is a case of the Chevalley-Weil principle with , , and covering map . The claim is then that any pre-image of an almost algebraic integer point is again an almost algebraic integer point.
Proof: We use essentially the same argument as the previous theorem, but in the language of ideals rather than numbers. The case is easy, so we assume that . By choosing a suitably large standard number field , we may assume that are nonstandard algebraic integers in for some standard . As is well known, the ring of algebraic integers is a Dedekind domain, so that one has unique factorisation of ideals. In particular, the nonstandard principal ideal , which is an ideal of , factorises as a nonstandard product
for some distinct nonstandard prime ideals (not necessarily principal), a nonstandard natural number , and positive nonstandard natural numbers . Since , we conclude in particular that
If (say) and are both divisible by a prime ideal , then is also; but the latter ideal is standard, and so such are standard, and furthermore the number of such is bounded. Similarly for other pairs from . Thus for all other , the divide exactly one of an even number of times, and do not divide the other two ideals. This implies a factorisation of the form
where are nonstandard ideals and are standard ideals. From class field theory, the class group of is finite, which implies that any nonstandard ideal can be expressed as the product of a nonstandard principal ideal and a standard fractional ideal. Thus we may write
where are now standard fractional ideals. However, the ratio of two principal ideals is a principal fractional ideal, and thus , , for some standard . In other words, we have
for some nonstandard units . But from
\begin
Let be a standard non-zero algebraic number, and let be the affine curve
Then does not contain any strictly nonstandard almost algebraic integer point .
Indeed, Theorem 12 and the calculations from the previous section reveal that if the curve contains a strictly nonstandard almost algebraic integer point, then the lifted curve does also.
The argument from Theorem 7 can be adapted without much difficulty to show that does not contain any strictly nonstandard point in . However to work with almost algebraic integers instead of nonstandard integers, we need to extend the subspace theorem to this setting, a topic to which we now turn.
— 3. The subspace theorem in number fields —
If is a nonstandard almost rational integer which is non-zero, then one clearly has ; this is (up to the exponent) the case of the subspace theorem, Theorem 4.
Now suppose that is a non-zero nonstandard almost algebraic integer for some standard number field . Then it is no longer necessarily the case that ; for instance, this would imply that
for any nonstandard integers , which contradicts the Dirichlet approximation theorem. However, if is a Galois extension of , and is the Galois group, then it is still true that
since is a non-zero element of .
In a similar spirit, we claim the following generalisation of the subspace theorem to number fields. If is an algebraic number of degree , we write
for the norm at , where are the Galois conjugates of , and for , we write
Clearly this norm is Galois-invariant.
Theorem 13 (Schmidt subspace theorem for number fields) Let be a standard natural number, and let be a standard Galois extension of , with Galois group . For each , let be linearly independent standard linear forms. Let be in -general position. Then one has
where acts on (and hence on ) in the obvious fashion.
Exercise 4 State a logically equivalent standard form of Theorem 13 (analogous to Theorem 1), and prove the logical equivalence.
Theorem 13 (in the logically equivalent standard form) was proven by Schlickewei (who also handled more general valuations than the complex absolute value , and also allowed the coefficients of to be -integers rather than algebraic integers). However, Theorem 13 can also be deduced from using Theorem 1 as a black box, as we shall shortly demonstrate.
Let us see how Theorem 13 implies Theorem 2.
Proof: (of Theorem 2 assuming Theorem 13). This is a modification of the argument of Theorem 7. Suppose for contradiction that we can find a non-zero algebraic number such that the curve
contains a strictly nonstandard almost algebraic integer point . We may place inside for some number field , which we may take to be Galois by enlarging as necessary. Let be the Galois group.
For each , the points are either bounded (i.e., ) or unbounded. If is bounded for all then the coefficients of are all bounded, so that is standard, a contradiction. Thus is unbounded for at least one .
Let be a large integer to be chosen later (actually will do here), and consider the vector space of polynomials spanned by the monomials
and
This space thus has dimension . We claim that none of the non-zero polynomials in vanish identically on . To see this, we divide into two cases. If contains at least one monomial with a non-trivial power of , then we can write for some , where is a non-zero polynomial in of degree at most and has degree less than in . By inspecting the limits , , of , we see that if vanished on , then the non-zero polynomial of degree at most would have to vanish at all three points , a contradiction. Finally, if has no terms involving , then it is a polynomial in of degree at most in , and thus not divisible by , and the claim now follows from Bezout’s theorem.
We claim that for every , we may find a basis for with the property that
for some standard if is unbounded (which, as previously observed, must hold at least once). If this claim held, then on multiplying these bounds together and applying Theorem 13, we conclude that the tuple
is not in -general position, which implies that for some non-zero . But does not vanish identically on the irreducible curve , so by Bezout’s theorem can only vanish at standard points of , a contradiction.
It remains to prove the claim. To simplify the notation we just handle the case when is the identity , as the other cases are treated similarly. If is bounded, then the claim is trivial (taking to be an arbitrary basis of , e.g. the monomial basis), so assume that is unbounded. From the geometry of , we see that this can only occur if either is unbounded and is infinitesimally close to zero, or else if is unbounded, is infinitesimally close to zero, and is infinitesimally close to one of , , or .
First suppose that is unbounded. Then as , one can perform a Puiseux series expansion of any polynomial in powers of , with the highest power being . As such, we may find a basis of for which
for , which gives (10) for large enough.
Now suppose that it is which is unbounded. Then as , , and converges to one of , one can perform a Laurent series expansion of any polynomial in in powers of , with the highest power being . Thus we may find a basis of for which
for , and again (10) follows for large enough. This concludes the proof of Theorem 7.
— 4. Amplifying the subspace theorem —
Now we show how Theorem 4 may be amplified to prove Theorem 13. Our arguments will use very little number theory, relying primarily on linear algebra and the nonstandard analysis framework. (As always, one can reformulate these arguments in the standard setting, but the linear algebra arguments become quite complicated, requiring the use of many rank reduction arguments, as per Section 2 of this previous blog post.
Let be as in Theorem 13. The space is a -dimensional vector space over , and so we may (non-canonically) identify with , and with . In particular, can be viewed as a -tuple of almost rational integers. It would be helpful if we knew that this tuple was in -general position, as one could then apply Theorem 4 directly to conclude. However, our hypothesis is only the weaker assertion that is in -general position. Nevertheless, we may place in a certain “row echelon form” in terms of -general position parameters, and we will then be able to deduce Theorem 13 from averaging together various applications of Theorem 4, with the precise applications to use being uncovered through linear algebra.
We turn to the details. Recall that if is an -dimensional vector space over a field , then a flag in is a nested sequence of spaces
such that each is a -linear subspace of dimension .
Theorem 14 (Standard row echelon form) Let be a -dimensional field extension of a field , let be a -dimensional -vector space, and let be an -linear subspace of (viewed as an -dimensional vector space over ). Suppose also that the -dimension of is at least for every non-zero -linear functional and some . Then one may find a flag
of -subspaces of , as well as natural numbers
such that has -dimension for .
Proof: The case is trivial, so assume inductively that and that the claim has already been proven for . Let be a non-zero -linear functional which minimises the -dimension of the space ; if we denote the dimension of this space by , then . We set , and let be the kernel of , then is a -hyperplane in . We claim that the -dimension of is at least for any non-zero , for if this were not the case, one could find an extension of to which annihilated a section of in , so that , contradicting the minimality of . We may thus apply the induction hypothesis to find a flag
and natural numbers
such that such that has -dimension for . The claim follows.
Corollary 15 Let be a degree extension of , and let be in -general position. Then one find a -subspace of such that is an element of the module , where is an arbitrary -basis of . Furthermore, is a -generic point of , in the sense that for any -basis of , one has with in -general position. (Equivalently, does not lie in for any proper -subspace of .)
Furthermore, one may find linearly independent -linear forms and natural numbers
This corollary is a sort of “regularity lemma” for points in ; this is perhaps the component of the argument which is the most difficult to convert into a standard setting.
Proof: Let denote the intersection of all the -subspaces of such that . Then is itself a -subspace of with ; one can think of as the -linear analogue of a “Zariski closure” of . If is a basis of , then we have for some ; if is not in -general position, then we have a non-trivial dependence for some , not all zero, and we may use this to place in for some proper -subspace of , a contradiction. Thus is a -generic point in .
Since is in -general position, is non-trivial for any -linear form . From Theorem 14 we may then find a flag
of -subspaces of , as well as natural numbers
such that has -dimension for . If, for each , we let be a -linear form that annihilates but does not annihilate , we obtain the claim.
Next, we need a classical lemma on intersection of flags.
Lemma 16 (Schubert cell decomposition) Let
and
be two flags on the same -dimensional vector space over a field . Then one can find a basis of and a permutation such that for all .
Proof: For any , the function is non-decreasing in , is equal to when , and when , thus there exists a unique such that this function equals for and for . By inspecting the quantities for a given , which similarly increase from to , we see that there is at most one with , thus is a permutation. If we then choose to be an element of that lies outside of , we obtain the claim.
Let be as in Theorem 13, and let and be as in Corollary 15, with being the degree of . By permuting the , we may assume that is non-decreasing in .
For each , we apply Lemma 16 to the flags
and
(with the span being over , and with the extened from -linear forms to -linear forms) we may find a -basis of the -linear forms on and a permutation such that for each , is a -linear combination of , and is also a -linear combination of . From the latter claim, the non-decreasing nature of , and the triangle inequality we have
It will now suffice to show that
We will prove the inequalities
for all ; since the standard quantities are finite and non-increasing in , the claim (12) follows from taking a telescoping product of powers of (13).
To prove (13), we need a classical lemma concerning the canonical embedding of into via the Galois group action.
Proof: We give a nonstandard analysis proof. If this were not the case, then we would have coefficients for , not all zero, such that
for all , and hence also for all . Now let be nonstandard real numbers for such that , and such that no two are comparable. From the Dirichlet approximation theorem argument given at the start of this post, we can find a non-zero such that . On the other hand, the norm is a non-zero rational integer and so . Combining the two estimates, we conclude that for all . But as the are incomparable, this forces the to be linearly independent over , a contradiction.
Corollary 18 If is a -subspace of of dimension , then there exist distinct elements of such that the -linear functions for are -linearly independent on .
Proof: Let be a -basis for , which we complete to a -basis for . By Lemma 17, the vectors for span as a -linear space, and are thus -linearly independent. In particular, the matrix has full rank, and so has a minor which is non-singular, giving the claim.
Now we can prove (13) for a given . For each , we apply Corollary 18 to the space defined in (11) to find distinct elements of such that the forms for are -linearly independent on ; applying an arbitrary element of , we also see that the forms for are -linearly independent on . We will show that
taking the geometric mean over all , we obtain (13).
It remains to prove (14). By construction of the , we know that the is a linear combination of the tuple
This tuple lies in , where is the image of under the map . By Corollary 15, is a -vector space of dimension , and is a -generic point of . By Theorem 4 (and the subsequent remarks), we will be able to conclude (14) as soon as we show that the expressions for and are -linearly independent. Suppose for contradiction that one has a non-trivial linear dependence
for some , not all zero. Let be the largest value of for which there is a non-zero value of . Each is a -linear combination of , with the coefficient of being non-zero (otherwise the could not be linearly independent in ). We conclude that there is a non-trivial -linear combination of the for , which is equal to a -linear combination of the for and . But as is a -generic point in , this can only happen if the corresponding linear combination of the forms and vanishes on (with the now interpreted as coordinate functions on ). This implies that the forms are -linearly dependent on , giving the required contradiction. This proves (14), and Theorem 13 follows.
— 5. The flag structure of the magnitude of linear forms —
Although we will not need this fact here, it is interesting to note that the subspace theorem (Theorem 4) gives rather precise control on the size of various linear combinations of algebraic numbers.
Theorem 19 (Schmidt subspace theorem, flag version) Let be a standard natural number, and let be in -general position. Then one has a standard flag
in the space of linear forms , as well as standard real numbers
For instance, if are linearly independent over , then Theorem 19 asserts that
for all outside of a one-dimensional subspace of , and we have
for all non-zero and some . One can use Theorem 13 obtain a similar description of the magnitude of -linear forms (and their Galois conjugates) of a point in -general position, but we will not do so here.
Proof: For each standard , the space
is a -linear subspace of , which is non-decreasing and right-continuous in , and equals all of when . As subspaces of must have an integer dimension between and , we may thus find a complete flag
and extended real numbers
such that whenever and . Selecting to be an element of for and applying Theorem 4, we obtain (15), which in particular implies that the are finite, at which point (16) follows from the definition of the . Finally, by taking the coordinate linear forms we see that for at least one , which forces .
Exercise 5 Try to state and prove a standard version of Theorem 19. (This is remarkably tricky – it takes the form of a “regularity lemma” in the spirit of Section 2 of this blog post – and may help to illustrate the power of the nonstandard formalism.)