You are currently browsing the category archive for the ‘Mathematics’ category.
In orthodox first-order logic, variables and expressions are only allowed to take one value at a time; a variable , for instance, is not allowed to equal and simultaneously. We will call such variables completely specified. If one really wants to deal with multiple values of objects simultaneously, one is encouraged to use the language of set theory and/or logical quantifiers to do so.
However, the ability to allow expressions to become only partially specified is undeniably convenient, and also rather intuitive. A classic example here is that of the quadratic formula:
Strictly speaking, the expression is not well-formed according to the grammar of first-order logic; one should instead use something like
or
or
in order to strictly adhere to this grammar. But none of these three reformulations are as compact or as conceptually clear as the original one. In a similar spirit, a mathematical English sentence such as
is also not a first-order sentence; one would instead have to write something like or instead. These reformulations are not all that hard to decipher, but they do have the aesthetically displeasing effect of cluttering an argument with temporary variables such as which are used once and then discarded.Another example of partially specified notation is the innocuous notation. For instance, the assertion
when written formally using first-order logic, would become something like which is not exactly an elegant reformulation. Similarly with statements such as orBelow the fold I’ll try to assign a formal meaning to partially specified expressions such as (1), for instance allowing one to condense (2), (3), (4) to just
When combined with another common (but often implicit) extension of first-order logic, namely the ability to reason using ambient parameters, we become able to formally introduce asymptotic notation such as the big-O notation or the little-o notation . We will explain how to do this at the end of this post.Kaisa Matomäki, Xuancheng Shao, Joni Teräväinen, and myself have just uploaded to the arXiv our preprint “Higher uniformity of arithmetic functions in short intervals I. All intervals“. This paper investigates the higher order (Gowers) uniformity of standard arithmetic functions in analytic number theory (and specifically, the Möbius function , the von Mangoldt function , and the generalised divisor functions ) in short intervals , where is large and lies in the range for a fixed constant (that one would like to be as small as possible). If we let denote one of the functions , then there is extensive literature on the estimation of short sums
and some literature also on the estimation of exponential sums such as for a real frequency , where . For applications in the additive combinatorics of such functions , it is also necessary to consider more general correlations, such as polynomial correlations where is a polynomial of some fixed degree, or more generally where is a nilmanifold of fixed degree and dimension (and with some control on structure constants), is a polynomial map, and is a Lipschitz function (with some bound on the Lipschitz constant). Indeed, thanks to the inverse theorem for the Gowers uniformity norm, such correlations let one control the Gowers uniformity norm of (possibly after subtracting off some renormalising factor) on such short intervals , which can in turn be used to control other multilinear correlations involving such functions.Traditionally, asymptotics for such sums are expressed in terms of a “main term” of some arithmetic nature, plus an error term that is estimated in magnitude. For instance, a sum such as would be approximated in terms of a main term that vanished (or is negligible) if is “minor arc”, but would be expressible in terms of something like a Ramanujan sum if was “major arc”, together with an error term. We found it convenient to cancel off such main terms by subtracting an approximant from each of the arithmetic functions and then getting upper bounds on remainder correlations such as
(actually for technical reasons we also allow the variable to be restricted further to a subprogression of , but let us ignore this minor extension for this discussion). There is some flexibility in how to choose these approximants, but we eventually found it convenient to use the following choices.
- For the Möbius function , we simply set , as per the Möbius pseudorandomness conjecture. (One could choose a more sophisticated approximant in the presence of a Siegel zero, as I did with Joni in this recent paper, but we do not do so here.)
- For the von Mangoldt function , we eventually went with the Cramér-Granville approximant , where and .
- For the divisor functions , we used a somewhat complicated-looking approximant for some explicit polynomials , chosen so that and have almost exactly the same sums along arithmetic progressions (see the paper for details).
The objective is then to obtain bounds on sums such as (1) that improve upon the “trivial bound” that one can get with the triangle inequality and standard number theory bounds such as the Brun-Titchmarsh inequality. For and , the Siegel-Walfisz theorem suggests that it is reasonable to expect error terms that have “strongly logarithmic savings” in the sense that they gain a factor of over the trivial bound for any ; for , the Dirichlet hyperbola method suggests instead that one has “power savings” in that one should gain a factor of over the trivial bound for some . In the case of the Möbius function , there is an additional trick (introduced by Matomäki and Teräväinen) that allows one to lower the exponent somewhat at the cost of only obtaining “weakly logarithmic savings” of shape for some small .
Our main estimates on sums of the form (1) work in the following ranges:
- For , one can obtain strongly logarithmic savings on (1) for , and power savings for .
- For , one can obtain weakly logarithmic savings for .
- For , one can obtain power savings for .
- For , one can obtain power savings for .
Conjecturally, one should be able to obtain power savings in all cases, and lower down to zero, but the ranges of exponents and savings given here seem to be the limit of current methods unless one assumes additional hypotheses, such as GRH. The result for correlation against Fourier phases was established previously by Zhan, and the result for such phases and was established previously by by Matomäki and Teräväinen.
By combining these results with tools from additive combinatorics, one can obtain a number of applications:
- Direct insertion of our bounds in the recent work of Kanigowski, Lemanczyk, and Radziwill on the prime number theorem on dynamical systems that are analytic skew products gives some improvements in the exponents there.
- We can obtain a “short interval” version of a multiple ergodic theorem along primes established by Frantzikinakis-Host-Kra and Wooley-Ziegler, in which we average over intervals of the form rather than .
- We can obtain a “short interval” version of the “linear equations in primes” asymptotics obtained by Ben Green, Tamar Ziegler, and myself in this sequence of papers, where the variables in these equations lie in short intervals rather than long intervals such as .
We now briefly discuss some of the ingredients of proof of our main results. The first step is standard, using combinatorial decompositions (based on the Heath-Brown identity and (for the result) the Ramaré identity) to decompose into more tractable sums of the following types:
- Type sums, which are basically of the form for some weights of controlled size and some cutoff that is not too large;
- Type sums, which are basically of the form for some weights , of controlled size and some cutoffs that are not too close to or to ;
- Type sums, which are basically of the form for some weights of controlled size and some cutoff that is not too large.
The precise ranges of the cutoffs depend on the choice of ; our methods fail once these cutoffs pass a certain threshold, and this is the reason for the exponents being what they are in our main results.
The Type sums involving nilsequences can be treated by methods similar to those in this previous paper of Ben Green and myself; the main innovations are in the treatment of the Type and Type sums.
For the Type sums, one can split into the “abelian” case in which (after some Fourier decomposition) the nilsequence is basically of the form , and the “non-abelian” case in which is non-abelian and exhibits non-trivial oscillation in a central direction. In the abelian case we can adapt arguments of Matomaki and Shao, which uses Cauchy-Schwarz and the equidistribution properties of polynomials to obtain good bounds unless is “major arc” in the sense that it resembles (or “pretends to be”) for some Dirichlet character and some frequency , but in this case one can use classical multiplicative methods to control the correlation. It turns out that the non-abelian case can be treated similarly. After applying Cauchy-Schwarz, one ends up analyzing the equidistribution of the four-variable polynomial sequence
as range in various dyadic intervals. Using the known multidimensional equidistribution theory of polynomial maps in nilmanifolds, one can eventually show in the non-abelian case that this sequence either has enough equidistribution to give cancellation, or else the nilsequence involved can be replaced with one from a lower dimensional nilmanifold, in which case one can apply an induction hypothesis.For the type sum, a model sum to study is
which one can expand as We experimented with a number of ways to treat this type of sum (including automorphic form methods, or methods based on the Voronoi formula or van der Corput’s inequality), but somewhat to our surprise, the most efficient approach was an elementary one, in which one uses the Dirichlet approximation theorem to decompose the hyperbolic region into a number of arithmetic progressions, and then uses equidistribution theory to establish cancellation of sequences such as on the majority of these progressions. As it turns out, this strategy works well in the regime unless the nilsequence involved is “major arc”, but the latter case is treatable by existing methods as discussed previously; this is why the exponent for our result can be as low as .In a sequel to this paper (currently in preparation), we will obtain analogous results for almost all intervals with in the range , in which we will be able to lower all the way to .
Just a brief update to the previous post. Gerhard Paseman and I have now set up a web site for the Short Communication Satellite (SCS) for the virtual International Congress of Mathematicians (ICM), which will be an experimental independent online satellite event in which short communications on topics relevant to one or two of the sections of the ICM can be submitted, reviewed by peers, and (if appropriate for the SCS event) displayed in a virtual “poster room” during the Congress on July 6-14 (which, by the way, has recently released its schedule and list of speakers). Our plan is to open the registration for this event on April 5, and start taking submissions on April 20; we are also currently accepting any expressions of interest in helping out with the event, for instance by serving as a reviewer. For more information about the event, please see the overview page, the guidelines page, and the FAQ page of the web site. As viewers will see, the web site is still somewhat under construction, but will be updated as we move closer to the actual Congress.
The comments section of this post would be a suitable place to ask further questions about this event, or give any additional feedback.
UPDATE: for readers who have difficulty accessing the links above, here are backup copies of the overview page and guidelines page.
Jan Grebik, Rachel Greenfeld, Vaclav Rozhon and I have just uploaded to the arXiv our preprint “Measurable tilings by abelian group actions“. This paper is related to an earlier paper of Rachel Greenfeld and myself concerning tilings of lattices , but now we consider the more general situation of tiling a measure space by a tile shifted by a finite subset of shifts of an abelian group that acts in a measure-preserving (or at least quasi-measure-preserving) fashion on . For instance, could be a torus , could be a positive measure subset of that torus, and could be the group , acting on by translation.
If is a finite subset of with the property that the translates , of partition up to null sets, we write , and refer to this as a measurable tiling of by (with tiling set ). For instance, if is the torus , we can create a measurable tiling with and . Our main results are the following:
- By modifying arguments from previous papers (including the one with Greenfeld mentioned above), we can establish the following “dilation lemma”: a measurable tiling automatically implies further measurable tilings , whenever is an integer coprime to all primes up to the cardinality of .
- By averaging the above dilation lemma, we can also establish a “structure theorem” that decomposes the indicator function of into components, each of which are invariant with respect to a certain shift in . We can establish this theorem in the case of measure-preserving actions on probability spaces via the ergodic theorem, but one can also generalize to other settings by using the device of “measurable medial means” (which relates to the concept of a universally measurable set).
- By applying this structure theorem, we can show that all measurable tilings of the one-dimensional torus are rational, in the sense that lies in a coset of the rationals . This answers a recent conjecture of Conley, Grebik, and Pikhurko; we also give an alternate proof of this conjecture using some previous results of Lagarias and Wang.
- For tilings of higher-dimensional tori, the tiling need not be rational. However, we can show that we can “slide” the tiling to be rational by giving each translate of a “velocity” , and for every time , the translates still form a partition of modulo null sets, and at time the tiling becomes rational. In particular, if a set can tile a torus in an irrational fashion, then it must also be able to tile the torus in a rational fashion.
- In the two-dimensional case one can arrange matters so that all the velocities are parallel. If we furthermore assume that the tile is connected, we can also show that the union of all the translates with a common velocity form a -invariant subset of the torus.
- Finally, we show that tilings of a finitely generated discrete group , with a finite group, cannot be constructed in a “local” fashion (we formalize this probabilistically using the notion of a “factor of iid process”) unless the tile is contained in a single coset of . (Nonabelian local tilings, for instance of the sphere by rotations, are of interest due to connections with the Banach-Tarski paradox; see the aforementioned paper of Conley, Grebik, and Pikhurko. Unfortunately, our methods seem to break down completely in the nonabelian case.)
As I have mentioned in some recent posts, I am interested in exploring unconventional modalities for presenting mathematics, for instance using media with high production value. One such recent example of this I saw was a presentation of the fundamental zero product property (or domain property) of the real numbers – namely, that implies or for real numbers – expressed through the medium of German-language rap:
EDIT: and here is a lesson on fractions, expressed through the medium of a burger chain advertisement:
I’d be interested to know what further examples of this type are out there.
SECOND EDIT: The following two examples from Wired magazine are slightly more conventional in nature, but still worth mentioning, I think. Firstly, my colleague at UCLA, Amit Sahai, presents the concept of zero knowledge proofs at various levels of technicality:
Secondly, Moon Duchin answers math questions of all sorts from Twitter:
I’ve just uploaded to the arXiv my preprint “Perfectly packing a square by squares of nearly harmonic sidelength“. This paper concerns a variant of an old problem of Meir and Moser, who asks whether it is possible to perfectly pack squares of sidelength for into a single square or rectangle of area . (The following variant problem, also posed by Meir and Moser and discussed for instance in this MathOverflow post, is perhaps even more well known: is it possible to perfectly pack rectangles of dimensions for into a single square of area ?) For the purposes of this paper, rectangles and squares are understood to have sides parallel to the axes, and a packing is perfect if it partitions the region being packed up to sets of measure zero. As one partial result towards these problems, it was shown by Paulhus that squares of sidelength for can be packed (not quite perfectly) into a single rectangle of area , and rectangles of dimensions for can be packed (again not quite perfectly) into a single square of area . (Paulhus’s paper had some gaps in it, but these were subsequently repaired by Grzegorek and Januszewski.)
Another direction in which partial progress has been made is to consider instead the problem of packing squares of sidelength , perfectly into a square or rectangle of total area , for some fixed constant (this lower bound is needed to make the total area finite), with the aim being to get as close to as possible. Prior to this paper, the most recent advance in this direction was by Januszewski and Zielonka last year, who achieved such a packing in the range .
In this paper we are able to get arbitrarily close to (which turns out to be a “critical” value of this parameter), but at the expense of deleting the first few tiles:
Theorem 1 If , and is sufficiently large depending on , then one can pack squares of sidelength , perfectly into a square of area .
As in previous works, the general strategy is to execute a greedy algorithm, which can be described somewhat incompletely as follows.
- Step 1: Suppose that one has already managed to perfectly pack a square of area by squares of sidelength for , together with a further finite collection of rectangles with disjoint interiors. (Initially, we would have and , but these parameter will change over the course of the algorithm.)
- Step 2: Amongst all the rectangles in , locate the rectangle of the largest width (defined as the shorter of the two sidelengths of ).
- Step 3: Pack (as efficiently as one can) squares of sidelength for into for some , and decompose the portion of not covered by this packing into rectangles .
- Step 4: Replace by , replace by , and return to Step 1.
The main innovation of this paper is to perform Step 3 somewhat more efficiently than in previous papers.
The above algorithm can get stuck if one reaches a point where one has already packed squares of sidelength for , but that all remaining rectangles in have width less than , in which case there is no obvious way to fit in the next square. If we let and denote the width and height of these rectangles , then the total area of the rectangles must be
and the total perimeter of these rectangles is Thus we have and so to ensure that there is at least one rectangle with it would be enough to have the perimeter bound for a sufficiently small constant . It is here that we now see the critical nature of the exponent : for , the amount of perimeter we are permitted to have in the remaining rectangles increases as one progresses with the packing, but for the amount of perimeter one is “budgeted” for stays constant (and for the situation is even worse, in that the remaining rectangles should steadily decrease in total perimeter).In comparison, the perimeter of the squares that one has already packed is equal to
which is comparable to for large (with the constants blowing up as approaches the critical value of ). In previous algorithms, the total perimeter of the remainder rectangles was basically comparable to the perimeter of the squares already packed, and this is the main reason why the results only worked when was sufficiently far away from . In my paper, I am able to get the perimeter of significantly smaller than the perimeter of the squares already packed, by grouping those squares into lattice-like clusters (of about squares arranged in an pattern), and sliding the squares in each cluster together to almost entirely eliminate the wasted space between each square, leaving only the space around the cluster as the main source of residual perimeter, which will be comparable to about per cluster, as compared to the total perimeter of the squares in the cluster which is comparable to . This strategy is perhaps easiest to illustrate with a picture, in which squares of slowly decreasing sidelength are packed together with relatively little wasted space:
By choosing the parameter suitably large (and taking sufficiently large depending on ), one can then prove the theorem. (In order to do some technical bookkeeping and to allow one to close an induction in the verification of the algorithm’s correctness, it is convenient to replace the perimeter by a slightly weighted variant for a small exponent , but this is a somewhat artificial device that somewhat obscures the main ideas.)
Asgar Jamneshan and myself have just uploaded to the arXiv our preprint “The inverse theorem for the Gowers uniformity norm on arbitrary finite abelian groups: Fourier-analytic and ergodic approaches“. This paper, which is a companion to another recent paper of ourselves and Or Shalom, studies the inverse theory for the third Gowers uniformity norm
on an arbitrary finite abelian group , where is the multiplicative derivative. Our main result is as follows:
Theorem 1 (Inverse theorem for ) Let be a finite abelian group, and let be a -bounded function with for some . Then:
- (i) (Correlation with locally quadratic phase) There exists a regular Bohr set with and , a locally quadratic function , and a function such that
- (ii) (Correlation with nilsequence) There exists an explicit degree two filtered nilmanifold of dimension , a polynomial map , and a Lipschitz function of constant such that
Such a theorem was proven by Ben Green and myself in the case when was odd, and by Samorodnitsky in the -torsion case . In all cases one uses the “higher order Fourier analysis” techniques introduced by Gowers. After some now-standard manipulations (using for instance what is now known as the Balog-Szemerédi-Gowers lemma), one arrives (for arbitrary ) at an estimate that is roughly of the form
where denotes various -bounded functions whose exact values are not too important, and is a symmetric locally bilinear form. The idea is then to “integrate” this form by expressing it in the form for some locally quadratic ; this then allows us to write the above correlation as (after adjusting the functions suitably), and one can now conclude part (i) of the above theorem using some linear Fourier analysis. Part (ii) follows by encoding locally quadratic phase functions as nilsequences; for this we adapt an algebraic construction of Manners.So the key step is to obtain a representation of the form (1), possibly after shrinking the Bohr set a little if needed. This has been done in the literature in two ways:
- When is odd, one has the ability to divide by , and on the set one can establish (1) with . (This is similar to how in single variable calculus the function is a function whose second derivative is equal to .)
- When , then after a change of basis one can take the Bohr set to be for some , and the bilinear form can be written in coordinates as for some with . The diagonal terms cause a problem, but by subtracting off the rank one form one can write on the orthogonal complement of for some coefficients which now vanish on the diagonal: . One can now obtain (1) on this complement by taking
In our paper we can now treat the case of arbitrary finite abelian groups , by means of the following two new ingredients:
- (i) Using some geometry of numbers, we can lift the group to a larger (possibly infinite, but still finitely generated) abelian group with a projection map , and find a globally bilinear map on the latter group, such that one has a representation of the locally bilinear form by the globally bilinear form when are close enough to the origin.
- (ii) Using an explicit construction, one can show that every globally bilinear map has a representation of the form (1) for some globally quadratic function .
To illustrate (i), consider the Bohr set in (where denotes the distance to the nearest integer), and consider a locally bilinear form of the form for some real number and all integers (which we identify with elements of . For generic , this form cannot be extended to a globally bilinear form on ; however if one lifts to the finitely generated abelian group
(with projection map ) and introduces the globally bilinear form by the formula then one has (2) when lie in the interval . A similar construction works for higher rank Bohr sets.To illustrate (ii), the key case turns out to be when is a cyclic group , in which case will take the form
for some integer . One can then check by direct construction that (1) will be obeyed with regardless of whether is even or odd. A variant of this construction also works for , and the general case follows from a short calculation verifying that the claim (ii) for any two groups implies the corresponding claim (ii) for the product .This concludes the Fourier-analytic proof of Theorem 1. In this paper we also give an ergodic theory proof of (a qualitative version of) Theorem 1(ii), using a correspondence principle argument adapted from this previous paper of Ziegler, and myself. Basically, the idea is to randomly generate a dynamical system on the group , by selecting an infinite number of random shifts , which induces an action of the infinitely generated free abelian group on by the formula
Much as the law of large numbers ensures the almost sure convergence of Monte Carlo integration, one can show that this action is almost surely ergodic (after passing to a suitable Furstenberg-type limit where the size of goes to infinity), and that the dynamical Host-Kra-Gowers seminorms of that system coincide with the combinatorial Gowers norms of the original functions. One is then well placed to apply an inverse theorem for the third Host-Kra-Gowers seminorm for -actions, which was accomplished in the companion paper to this one. After doing so, one almost gets the desired conclusion of Theorem 1(ii), except that after undoing the application of the Furstenberg correspondence principle, the map is merely an almost polynomial rather than a polynomial, which roughly speaking means that instead of certain derivatives of vanishing, they instead are merely very small outside of a small exceptional set. To conclude we need to invoke a “stability of polynomials” result, which at this level of generality was first established by Candela and Szegedy (though we also provide an independent proof here in an appendix), which roughly speaking asserts that every approximate polynomial is close in measure to an actual polynomial. (This general strategy is also employed in the Candela-Szegedy paper, though in the absence of the ergodic inverse theorem input that we rely upon here, the conclusion is weaker in that the filtered nilmanifold is replaced with a general space known as a “CFR nilspace”.)This transference principle approach seems to work well for the higher step cases (for instance, the stability of polynomials result is known in arbitrary degree); the main difficulty is to establish a suitable higher step inverse theorem in the ergodic theory setting, which we hope to do in future research.
Asgar Jamneshan, Or Shalom, and myself have just uploaded to the arXiv our preprint “The structure of arbitrary Conze–Lesigne systems“. As the title suggests, this paper is devoted to the structural classification of Conze-Lesigne systems, which are a type of measure-preserving system that are “quadratic” or of “complexity two” in a certain technical sense, and are of importance in the theory of multiple recurrence. There are multiple ways to define such systems; here is one. Take a countable abelian group acting in a measure-preserving fashion on a probability space , thus each group element gives rise to a measure-preserving map . Define the third Gowers-Host-Kra seminorm of a function via the formula
where is a Folner sequence for and is the complex conjugation map. One can show that this limit exists and is independent of the choice of Folner sequence, and that the seminorm is indeed a seminorm. A Conze-Lesigne system is an ergodic measure-preserving system in which the seminorm is in fact a norm, thus whenever is non-zero. Informally, this means that when one considers a generic parallelepiped in a Conze–Lesigne system , the location of any vertex of that parallelepiped is more or less determined by the location of the other seven vertices. These are the important systems to understand in order to study “complexity two” patterns, such as arithmetic progressions of length four. While not all systems are Conze-Lesigne systems, it turns out that they always have a maximal factor that is a Conze-Lesigne system, known as the Conze-Lesigne factor or the second Host-Kra-Ziegler factor of the system, and this factor controls all the complexity two recurrence properties of the system.The analogous theory in complexity one is well understood. Here, one replaces the norm by the norm
and the ergodic systems for which is a norm are called Kronecker systems. These systems are completely classified: a system is Kronecker if and only if it arises from a compact abelian group equipped with Haar probability measure and a translation action for some homomorphism with dense image. Such systems can then be analyzed quite efficiently using the Fourier transform, and this can then be used to satisfactory analyze “complexity one” patterns, such as length three progressions, in arbitrary systems (or, when translated back to combinatorial settings, in arbitrary dense sets of abelian groups).We return now to the complexity two setting. The most famous examples of Conze-Lesigne systems are (order two) nilsystems, in which the space is a quotient of a two-step nilpotent Lie group by a lattice (equipped with Haar probability measure), and the action is given by a translation for some group homomorphism . For instance, the Heisenberg -nilsystem
with a shift of the form for two real numbers with linearly independent over , is a Conze-Lesigne system. As the base case of a well known result of Host and Kra, it is shown in fact that all Conze-Lesigne -systems are inverse limits of nilsystems (previous results in this direction were obtained by Conze-Lesigne, Furstenberg-Weiss, and others). Similar results are known for -systems when is finitely generated, thanks to the thesis work of Griesmer (with further proofs by Gutman-Lian and Candela-Szegedy). However, this is not the case once is not finitely generated; as a recent example of Shalom shows, Conze-Lesigne systems need not be the inverse limit of nilsystems in this case.Our main result is that even in the infinitely generated case, Conze-Lesigne systems are still inverse limits of a slight generalisation of the nilsystem concept, in which is a locally compact Polish group rather than a Lie group:
Theorem 1 (Classification of Conze-Lesigne systems) Let be a countable abelian group, and an ergodic measure-preserving -system. Then is a Conze-Lesigne system if and only if it is the inverse limit of translational systems , where is a nilpotent locally compact Polish group of nilpotency class two, and is a lattice in (and also a lattice in the commutator group ), with equipped with the Haar probability measure and a translation action for some homomorphism .
In a forthcoming companion paper to this one, Asgar Jamneshan and I will use this theorem to derive an inverse theorem for the Gowers norm for an arbitrary finite abelian group (with no restrictions on the order of , in particular our result handles the case of even and odd in a unified fashion). In principle, having a higher order version of this theorem will similarly allow us to derive inverse theorems for norms for arbitrary and finite abelian ; we hope to investigate this further in future work.
We sketch some of the main ideas used to prove the theorem. The existing machinery developed by Conze-Lesigne, Furstenberg-Weiss, Host-Kra, and others allows one to describe an arbitrary Conze-Lesigne system as a group extension , where is a Kronecker system (a rotational system on a compact abelian group and translation action ), is another compact abelian group, and the cocycle is a collection of measurable maps obeying the cocycle equation
for almost all . Furthermore, is of “type two”, which means in this concrete setting that it obeys an additional equation for all and almost all , and some measurable function ; roughly speaking this asserts that is “linear up to coboundaries”. For technical reasons it is also convenient to reduce to the case where is separable. The problem is that the equation (2) is unwieldy to work with. In the model case when the target group is a circle , one can use some Fourier analysis to convert (2) into the more tractable Conze-Lesigne equation for all , all , and almost all , where for each , is a measurable function, and is a homomorphism. (For technical reasons it is often also convenient to enforce that depend in a measurable fashion on ; this can always be achieved, at least when the Conze-Lesigne system is separable, but actually verifying that this is possible actually requires a certain amount of effort, which we devote an appendix to in our paper.) It is not difficult to see that (3) implies (2) for any group (as long as one has the measurability in mentioned previously), but the converse turns out to fail for some groups , such as solenoid groups (e.g., inverse limits of as ), as was essentially shown by Rudolph. However, in our paper we were able to find a separate argument that also derived the Conze-Lesigne equation in the case of a cyclic group . Putting together the and cases, one can then derive the Conze-Lesigne equation for arbitrary compact abelian Lie groups (as such groups are isomorphic to direct products of finitely many tori and cyclic groups). As has been known for some time (see e.g., this paper of Host and Kra), once one has a Conze-Lesigne equation, one can more or less describe the system as a translational system , where the Host-Kra group is the set of all pairs that solve an equation of the form (3) (with these pairs acting on by the law ), and is the stabiliser of a point in this system. This then establishes the theorem in the case when is a Lie group, and the general case basically comes from the fact (from Fourier analysis or the Peter-Weyl theorem) that an arbitrary compact abelian group is an inverse limit of Lie groups. (There is a technical issue here in that one has to check that the space of translational system factors of form a directed set in order to have a genuine inverse limit, but this can be dealt with by modifications of the tools mentioned here.)There is an additional technical issue worth pointing out here (which unfortunately was glossed over in some previous work in the area). Because the cocycle equation (1) and the Conze-Lesigne equation (3) are only valid almost everywhere instead of everywhere, the action of on is technically only a near-action rather than a genuine action, and as such one cannot directly define to be the stabiliser of a point without running into multiple problems. To fix this, one has to pass to a topological model of in which the action becomes continuous, and the stabilizer becomes well defined, although one then has to work a little more to check that the action is still transitive. This can be done via Gelfand duality; we proceed using a mixture of a construction from this book of Host and Kra, and the machinery in this recent paper of Asgar and myself.
Now we discuss how to establish the Conze-Lesigne equation (3) in the cyclic group case . As this group embeds into the torus , it is easy to use existing methods obtain (3) but with the homomorphism and the function taking values in rather than in . The main task is then to fix up the homomorphism so that it takes values in , that is to say that vanishes. This only needs to be done locally near the origin, because the claim is easy when lies in the dense subgroup of , and also because the claim can be shown to be additive in . Near the origin one can leverage the Steinhaus lemma to make depend linearly (or more precisely, homomorphically) on , and because the cocycle already takes values in , vanishes and must be an eigenvalue of the system . But as was assumed to be separable, there are only countably many eigenvalues, and by another application of Steinhaus and linearity one can then make vanish on an open neighborhood of the identity, giving the claim.
A popular way to visualise relationships between some finite number of sets is via Venn diagrams, or more generally Euler diagrams. In these diagrams, a set is depicted as a two-dimensional shape such as a disk or a rectangle, and the various Boolean relationships between these sets (e.g., that one set is contained in another, or that the intersection of two of the sets is equal to a third) is represented by the Boolean algebra of these shapes; Venn diagrams correspond to the case where the sets are in “general position” in the sense that all non-trivial Boolean combinations of the sets are non-empty. For instance to depict the general situation of two sets together with their intersection and one might use a Venn diagram such as
(where we have given each region depicted a different color, and moved the edges of each region a little away from each other in order to make them all visible separately), but if one wanted to instead depict a situation in which the intersection was empty, one could use an Euler diagram such as
One can use the area of various regions in a Venn or Euler diagram as a heuristic proxy for the cardinality (or measure ) of the set corresponding to such a region. For instance, the above Venn diagram can be used to intuitively justify the inclusion-exclusion formula
for finite sets , while the above Euler diagram similarly justifies the special case for finite disjoint sets .While Venn and Euler diagrams are traditionally two-dimensional in nature, there is nothing preventing one from using one-dimensional diagrams such as
or even three-dimensional diagrams such as this one from Wikipedia:
Of course, in such cases one would use length or volume as a heuristic proxy for cardinality or measure, rather than area.
With the addition of arrows, Venn and Euler diagrams can also accommodate (to some extent) functions between sets. Here for instance is a depiction of a function , the image of that function, and the image of some subset of :
Here one can illustrate surjectivity of by having fill out all of ; one can similarly illustrate injectivity of by giving exactly the same shape (or at least the same area) as . So here for instance might be how one would illustrate an injective function :
Cartesian product operations can be incorporated into these diagrams by appropriate combinations of one-dimensional and two-dimensional diagrams. Here for instance is a diagram that illustrates the identity :
In this blog post I would like to propose a similar family of diagrams to illustrate relationships between vector spaces (over a fixed base field , such as the reals) or abelian groups, rather than sets. The categories of (-)vector spaces and abelian groups are quite similar in many ways; the former consists of modules over a base field , while the latter consists of modules over the integers ; also, both categories are basic examples of abelian categories. The notion of a dimension in a vector space is analogous in many ways to that of cardinality of a set; see this previous post for an instance of this analogy (in the context of Shannon entropy). (UPDATE: I have learned that an essentially identical notation has also been proposed in an unpublished manuscript of Ravi Vakil.)
In everyday usage, we rely heavily on percentages to quantify probabilities and proportions: we might say that a prediction is accurate or accurate, that there is a chance of dying from some disease, and so forth. However, for those without extensive mathematical training, it can sometimes be difficult to assess whether a given percentage amounts to a “good” or “bad” outcome, because this depends very much on the context of how the percentage is used. For instance:
- (i) In a two-party election, an outcome of say to might be considered close, but to would probably be viewed as a convincing mandate, and to would likely be viewed as a landslide.
- (ii) Similarly, if one were to poll an upcoming election, a poll of to would be too close to call, to would be an extremely favorable result for the candidate, and to would mean that it would be a major upset if the candidate lost the election.
- (iii) On the other hand, a medical operation that only had a , , or chance of success would be viewed as being incredibly risky, especially if failure meant death or permanent injury to the patient. Even an operation that was or likely to be non-fatal (i.e., a or chance of death) would not be conducted lightly.
- (iv) A weather prediction of, say, chance of rain during a vacation trip might be sufficient cause to pack an umbrella, even though it is more likely than not that rain would not occur. On the other hand, if the prediction was for an chance of rain, and it ended up that the skies remained clear, this does not seriously damage the accuracy of the prediction – indeed, such an outcome would be expected in one out of every five such predictions.
- (v) Even extremely tiny percentages of toxic chemicals in everyday products can be considered unacceptable. For instance, EPA rules require action to be taken when the percentage of lead in drinking water exceeds (15 parts per billion). At the opposite extreme, recycling contamination rates as high as are often considered acceptable.
Because of all the very different ways in which percentages could be used, I think it may make sense to propose an alternate system of units to measure one class of probabilities, namely the probabilities of avoiding some highly undesirable outcome, such as death, accident or illness. The units I propose are that of “nines“, which are already commonly used to measure availability of some service or purity of a material, but can be equally used to measure the safety (i.e., lack of risk) of some activity. Informally, nines measure how many consecutive appearances of the digit are in the probability of successfully avoiding the negative outcome, thus
- success = one nine of safety
- success = two nines of safety
- success = three nines of safety
Definition 1 (Nines of safety) An activity (affecting one or more persons, over some given period of time) that has a probability of the “safe” outcome and probability of the “unsafe” outcome will have nines of safety against the unsafe outcome, where is defined by the formula (where is the logarithm to base ten), or equivalently
Remark 2 Because of the various uncertainties in measuring probabilities, as well as the inaccuracies in some of the assumptions and approximations we will be making later, we will not attempt to measure the number of nines of safety beyond the first decimal point; thus we will round to the nearest tenth of a nine of safety throughout this post.
Here is a conversion table between percentage rates of success (the safe outcome), failure (the unsafe outcome), and the number of nines of safety one has:
Success rate | Failure rate | Number of nines |
infinite |
Thus, if one has no nines of safety whatsoever, one is guaranteed to fail; but each nine of safety one has reduces the failure rate by a factor of . In an ideal world, one would have infinitely many nines of safety against any risk, but in practice there are no guarantees against failure, and so one can only expect a finite amount of nines of safety in any given situation. Realistically, one should thus aim to have as many nines of safety as one can reasonably expect to have, but not to demand an infinite amount.
Remark 3 The number of nines of safety against a certain risk is not absolute; it will depend not only on the risk itself, but (a) the number of people exposed to the risk, and (b) the length of time one is exposed to the risk. Exposing more people or increasing the duration of exposure will reduce the number of nines, and conversely exposing fewer people or reducing the duration will increase the number of nines; see Proposition 7 below for a rough rule of thumb in this regard.
Remark 4 Nines of safety are a logarithmic scale of measurement, rather than a linear scale. Other familiar examples of logarithmic scales of measurement include the Richter scale of earthquake magnitude, the pH scale of acidity, the decibel scale of sound level, octaves in music, and the magnitude scale for stars.
Remark 5 One way to think about nines of safety is via the Swiss cheese model that was created recently to describe pandemic risk management. In this model, each nine of safety can be thought of as a slice of Swiss cheese, with holes occupying of that slice. Having nines of safety is then analogous to standing behind such slices of Swiss cheese. In order for a risk to actually impact you, it must pass through each of these slices. A fractional nine of safety corresponds to a fractional slice of Swiss cheese that covers the amount of space given by the above table. For instance, nines of safety corresponds to a fractional slice that covers about of the given area (leaving uncovered).
Now to give some real-world examples of nines of safety. Using data for deaths in the US in 2019 (without attempting to account for factors such as age and gender), a random US citizen will have had the following amount of safety from dying from some selected causes in that year:
Cause of death | Mortality rate per (approx.) | Nines of safety |
All causes | ||
Heart disease | ||
Cancer | ||
Accidents | ||
Drug overdose | ||
Influenza/Pneumonia | ||
Suicide | ||
Gun violence | ||
Car accident | ||
Murder | ||
Airplane crash | ||
Lightning strike |
The safety of air travel is particularly remarkable: a given hour of flying in general aviation has a fatality rate of , or about nines of safety, while for the major carriers the fatality rate drops down to , or about nines of safety.
Of course, in 2020, COVID-19 deaths became significant. In this year in the US, the mortality rate for COVID-19 (as the underlying or contributing cause of death) was per , corresponding to nines of safety, which was less safe than all other causes of death except for heart disease and cancer. At this time of writing, data for all of 2021 is of course not yet available, but it seems likely that the safety level would be even lower for this year.
Some further illustrations of the concept of nines of safety:
- Each round of Russian roulette has a success rate of , providing only nines of safety. Of course, the safety will decrease with each additional round: one has only nines of safety after two rounds, nines after three rounds, and so forth. (See also Proposition 7 below.)
- The ancient Roman punishment of decimation, by definition, provided exactly one nine of safety to each soldier being punished.
- Rolling a on a -sided die is a risk that carries about nines of safety.
- Rolling a double one (“snake eyes“) from two six-sided dice carries about nines of safety.
- One has about nines of safety against the risk of someone randomly guessing your birthday on the first attempt.
- A null hypothesis has nines of safety against producing a statistically significant result, and nines against producing a statistically significant result. (However, one has to be careful when reversing the conditional; a statistically significant result does not necessarily have nines of safety against the null hypothesis. In Bayesian statistics, the precise relationship between the two risks is given by Bayes’ theorem.)
- If a poker opponent is dealt a five-card hand, one has nines of safety against that opponent being dealt a royal flush, against a straight flush or higher, against four-of-a-kind or higher, against a full house or higher, against a flush or higher, against a straight or higher, against three-of-a-kind or higher, against two pairs or higher, and just against one pair or higher. (This data was converted from this Wikipedia table.)
- A -digit PIN number (or a -digit combination lock) carries nines of safety against each attempt to randomly guess the PIN. A length password that allows for numbers, upper and lower case letters, and punctuation carries about nines of safety against a single guess. (For the reduction in safety caused by multiple guesses, see Proposition 7 below.)
Here is another way to think about nines of safety:
Proposition 6 (Nines of safety extend expected onset of risk) Suppose a certain risky activity has nines of safety. If one repeatedly indulges in this activity until the risk occurs, then the expected number of trials before the risk occurs is .
Proof: The probability that the risk is activated after exactly trials is , which is a geometric distribution of parameter . The claim then follows from the standard properties of that distribution.
Thus, for instance, if one performs some risky activity daily, then the expected length of time before the risk occurs is given by the following table:
Daily nines of safety | Expected onset of risk |
One day | |
One week | |
One month | |
One year | |
Two years | |
Five years | |
Ten years | |
Twenty years | |
Fifty years | |
A century |
Or, if one wants to convert the yearly risks of dying from a specific cause into expected years before that cause of death would occur (assuming for sake of discussion that no other cause of death exists):
Yearly nines of safety | Expected onset of risk |
One year | |
Two years | |
Five years | |
Ten years | |
Twenty years | |
Fifty years | |
A century |
These tables suggest a relationship between the amount of safety one would have in a short timeframe, such as a day, and a longer time frame, such as a year. Here is an approximate formalisation of that relationship:
Proposition 7 (Repeated exposure reduces nines of safety) If a risky activity with nines of safety is (independently) repeated times, then (assuming is large enough depending on ), the repeated activity will have approximately nines of safety. Conversely: if the repeated activity has nines of safety, the individual activity will have approximately nines of safety.
Proof: An activity with nines of safety will be safe with probability , hence safe with probability if repeated independently times. For large, we can approximate
giving the former claim. The latter claim follows from inverting the former.
Remark 8 The hypothesis of independence here is key. If there is a lot of correlation between the risks between different repetitions of the activity, then there can be much less reduction in safety caused by that repetition. As a simple example, suppose that of a workforce are trained to perform some task flawlessly no matter how many times they repeat the task, but the remaining are untrained and will always fail at that task. If one selects a random worker and asks them to perform the task, one has nines of safety against the task failing. If one took that same random worker and asked them to perform the task times, the above proposition might suggest that the number of nines of safety would drop to approximately ; but in this case there is perfect correlation, and in fact the number of nines of safety remains steady at since it is the same of the workforce that would fail each time.Because of this caveat, one should view the above proposition as only a crude first approximation that can be used as a simple rule of thumb, but should not be relied upon for more precise calculations.
One can repeat a risk either in time (extending the time of exposure to the risk, say from a day to a year), or in space (by exposing the risk to more people). The above proposition then gives an additive conversion law for nines of safety in either case. Here are some conversion tables for time:
From/to | Daily | Weekly | Monthly | Yearly |
Daily | 0 | -0.8 | -1.5 | -2.6 |
Weekly | +0.8 | 0 | -0.6 | -1.7 |
Monthly | +1.5 | +0.6 | 0 | -1.1 |
Yearly | +2.6 | +1.7 | +1.1 | 0 |
From/to | Yearly | Per 5 yr | Per decade | Per century |
Yearly | 0 | -0.7 | -1.0 | -2.0 |
Per 5 yr | +0.7 | 0 | -0.3 | -1.3 |
Per decade | +1.0 | + -0.3 | 0 | -1.0 |
Per century | +2.0 | +1.3 | +1.0 | 0 |
For instance, as mentioned before, the yearly amount of safety against cancer is about . Using the above table (and making the somewhat unrealistic hypothesis of independence), we then predict the daily amount of safety against cancer to be about nines, the weekly amount to be about nines, and the amount of safety over five years to drop to about nines.
Now we turn to conversions in space. If one knows the level of safety against a certain risk for an individual, and then one (independently) exposes a group of such individuals to that risk, then the reduction in nines of safety when considering the possibility that at least one group member experiences this risk is given by the following table:
Group | Reduction in safety |
You ( person) | |
You and your partner ( people) | |
You and your parents ( people) | |
You, your partner, and three children ( people) | |
An extended family of people | |
A class of people | |
A workplace of people | |
A school of people | |
A university of people | |
A town of people | |
A city of million people | |
A state of million people | |
A country of million people | |
A continent of billion people | |
The entire planet |
For instance, in a given year (and making the somewhat implausible assumption of independence), you might have nines of safety against cancer, but you and your partner collectively only have about nines of safety against this risk, your family of five might only have about nines of safety, and so forth. By the time one gets to a group of people, it actually becomes very likely that at least one member of the group will die of cancer in that year. (Here the precise conversion table breaks down, because a negative number of nines such as is not possible, but one should interpret a prediction of a negative number of nines as an assertion that failure is very likely to happen. Also, in practice the reduction in safety is less than this rule predicts, due to correlations such as risk factors that are common to the group being considered that are incompatible with the assumption of independence.)
In the opposite direction, any reduction in exposure (either in time or space) to a risk will increase one’s safety level, as per the following table:
Reduction in exposure | Additional nines of safety |
For instance, a five-fold reduction in exposure will reclaim about additional nines of safety.
Here is a slightly different way to view nines of safety:
Proposition 9 Suppose that a group of people are independently exposed to a given risk. If there are at most nines of individual safety against that risk, then there is at least a chance that one member of the group is affected by the risk.
Proof: If individually there are nines of safety, then the probability that all the members of the group avoid the risk is . Since the inequality
is equivalent to the claim follows.Thus, for a group to collectively avoid a risk with at least a chance, one needs the following level of individual safety:
Group | Individual safety level required |
You ( person) | |
You and your partner ( people) | |
You and your parents ( people) | |
You, your partner, and three children ( people) | |
An extended family of people | |
A class of people | |
A workplace of people | |
A school of people | |
A university of people | |
A town of people | |
A city of million people | |
A state of million people | |
A country of million people | |
A continent of billion people | |
The entire planet |
For large , the level of nines of individual safety required to protect a group of size with probability at least is approximately .
Precautions that can work to prevent a certain risk from occurring will add additional nines of safety against that risk, even if the precaution is not effective. Here is the precise rule:
Proposition 10 (Precautions add nines of safety) Suppose an activity carries nines of safety against a certain risk, and a separate precaution can independently protect against that risk with nines of safety (that is to say, the probability that the protection is effective is ). Then applying that precaution increases the number of nines in the activity from to .
Proof: The probability that the precaution fails and the risk then occurs is . The claim now follows from Definition 1.
In particular, we can repurpose the table at the start of this post as a conversion chart for effectiveness of a precaution:
Effectiveness | Failure rate | Additional nines provided |
infinite |
Thus for instance a precaution that is effective will add nines of safety, a precaution that is effective will add nines of safety, and so forth. The mRNA COVID vaccines by Pfizer and Moderna have somewhere between effectiveness against symptomatic COVID illness, providing about nines of safety against that risk, and over effectiveness against severe illness, thus adding at least nines of safety in this regard.
A slight variant of the above rule can be stated using the concept of relative risk:
Proposition 11 (Relative risk and nines of safety) Suppose an activity carries nines of safety against a certain risk, and an action multiplies the chance of failure by some relative risk . Then the action removes nines of safety (if ) or adds nines of safety (if ) to the original activity.
Proof: The additional action adjusts the probability of failure from to . The claim now follows from Definition 1.
Here is a conversion chart between relative risk and change in nines of safety:
Relative risk | Change in nines of safety |
Some examples:
- Smoking increases the fatality rate of lung cancer by a factor of about , thus removing about nines of safety from this particular risk; it also increases the fatality rates of several other diseases, though not quite as dramatically an extent.
- Seatbelts reduce the fatality rate in car accidents by a factor of about two, adding about nines of safety. Airbags achieve a reduction of about , adding about additional nines of safety.
- As far as transmission of COVID is concerned, it seems that constant use of face masks reduces transmission by a factor of about five (thus adding about nines of safety), and similarly for constant adherence to social distancing; whereas for instance a compliance with mask usage reduced transmission by about (adding only or so nines of safety).
The effect of combining multiple (independent) precautions together is cumulative; one can achieve quite a high level of safety by stacking together several precautions that individually have relatively low levels of effectiveness. Again, see the “swiss cheese model” referred to in Remark 5. For instance, if face masks add nines of safety against contracting COVID, social distancing adds another nines, and the vaccine provide another nine of safety, implementing all three mitigation methods would (assuming independence) add a net of nines of safety against contracting COVID.
In summary, when debating the value of a given risk mitigation measure, the correct question to ask is not quite “Is it certain to work” or “Can it fail?”, but rather “How many extra nines of safety does it add?”.
As one final comparison between nines of safety and other standard risk measures, we give the following proposition regarding large deviations from the mean.
Proposition 12 Let be a normally distributed random variable of standard deviation , and let . Then the “one-sided risk” of exceeding its mean by at least (i.e., ) carries nines of safety, the “two-sided risk” of deviating (in either direction) from its mean by at least (i.e., ) carries nines of safety, where is the error function.
Proof: This is a routine calculation using the cumulative distribution function of the normal distribution.
Here is a short table illustrating this proposition:
Number of deviations from the mean | One-sided nines of safety | Two-sided nines of safety |
Thus, for instance, the risk of a five sigma event (deviating by more than five standard deviations from the mean in either direction) should carry nines of safety assuming a normal distribution, and so one would ordinarily feel extremely safe against the possibility of such an event, unless one started doing hundreds of thousands of trials. (However, we caution that this conclusion relies heavily on the assumption that one has a normal distribution!)
See also this older essay I wrote on anonymity on the internet, using bits as a measure of anonymity in much the same way that nines are used here as a measure of safety.
Recent Comments