Graph Removal Lemma

In graph theory, the graph removal lemma states that when a graph contains few copies of a given subgraph, then all of the copies can be eliminated by removing a small number of edges.
The special case in which the subgraph is a triangle is known as the triangle removal lemma.

The graph removal lemma can be used to prove Roth's theorem on 3-term arithmetic progressions, and a generalization of it, the hypergraph removal lemma, can be used to prove Szemerédi's theorem. It also has applications to property testing.

Formulation

Let $H$ be a graph with $h$ vertices. The graph removal lemma states that for any
$\epsilon > 0$, there exists a constant $\delta = \delta(\epsilon, H) > 0$ such that for any $n$-vertex graph $G$ with fewer than $\delta n^h$ subgraphs isomorphic to $H$, it is possible to eliminate all copies of $H$ by removing at most $\epsilon n^2$ edges from $G$.

An alternative way to state this is to say that for any $n$-vertex graph $G$ with $o(n^h)$ subgraphs isomorphic to $H$, it is possible to eliminate all copies of $H$ by removing $o(n^2)$ edges from $G$. Here, the $o$ indicates the use of little o notation.

In the case when $H$ is a triangle, resulting lemma is called triangle removal lemma.

History

The original motivation for the study of triangle removal lemma was Ruzsa–Szemerédi problem. Initial formulation due to Imre Z. Ruzsa and Szemerédi from 1978 was slightly weaker than the triangle removal lemma used nowadays and can be roughly stated as follows: every locally linear graph on $n$ vertices contains $o(n^2)$ edges. This statement can be quickly deduced from a modern triangle removal lemma. Ruzsa and Szemerédi provided also an alternative proof of Roth's theorem on arithmetic progressions as a simple corollary.

In 1986 during their work on generalizations of Ruzsa–Szemerédi problem to arbitrary $r$-uniform graphs, Erdős, Frankl, and Rödl provided statement for general graphs very close to the modern graph removal lemma: if graph $H_2$ is a homomorphic image of $H_2$, then any $H_1$-free graph $G$ on $n$ vertices can be made $H_2$-free by removing $o(n^2)$ edges.

The modern formulation of graph removal lemma was first stated by Füredi in 1994. The proof generalized earlier approaches by Ruzsa and Szemerédi and Erdős, Frankl, and Rödl, also utilizing Szemerédi regularity lemma.

Graph counting lemma

A key component of the proof of graph removal lemma is the graph counting lemma about counting subgraphs in systems of regular pairs. Graph counting lemma is also very useful on its own. According to Füredi, it is used "in most applications of regularity lemma".

Heuristic argument

Let $H$ be a graph on $h$ vertices, whose vertex set is $V=\$ and edge set is $E$. Let $X_1,X_2,\ldots,X_h$ be sets of vertices of some graph $G$ such that for all $ij\in E$ pair $(X_i,X_j)$ is $\epsilon$-regular (in the sense of regularity lemma). Let also $d_$ be the density between sets $X_i$ and $X_j$. Intuitively, regular pair $(X,Y)$ with density $d$ should behave like a random Erdős–Rényi-like graph, where every pair of vertices $(x,y)\in (X\times Y)$ is selected to be an edge independently with probability $d$. This suggests that the number of copies of $H$ on vertices $x_1,x_2,\ldots,x_h$ such that $x_i\in X_i$ should be close to the expected number from Erdős–Rényi model:
$\prod_d_\prod_, X_i,$
where $E(H)$ and $V(H)$ are the edge set and the vertex set of $H$.

Precise statement

The straightforward formalization of above heuristic claim is as follows. Let $H$ be a graph on $h$ vertices, whose vertex set is $V=\$ and edge set is $E$. Let $\delta>0$ be arbitrary. Then there exists $\epsilon>0$ such that for any $X_1,X_2,\ldots,X_h$ as above, satisfying $d_>\delta$ for all $ij\in E$, the number of graph homomorphisms from $H$ to $G$ such that vertex $i\in V(H)$ is mapped to $X_i$ is not smaller then
$(1-\delta)\prod_(d_-\delta)\prod_, X_i,$

Blow-up Lemma

One can even find bounded degree subgraphs of blow-ups of $H$ in a similar setting. The following claim appears in the literature under name of the blow-up lemma and was first proven by Komlós, Sárközy and Szemerédi. Precise statement here is a slightly simplified version due to Komlós, who referred to it also as the key lemma, as it is used in numerous regularity-based proofs.

Let $H_1$ be an arbitrary graph and $t\in\mathbb_+$. Construct $H(t)$ by replacing each vertex $i$ of $H$ by independent set $V_i$ of size $t$ and replacing every edge $ij$ of $H$ by complete bipartite graph on $(V_i,V_j)$. Let $\epsilon,\delta>0$ be arbitrary reals, $N$ be a potiive integer and let $H_2$ be a subgraph of $H(t)$ with $h$ vertices and with maximum degree $\Delta$. Define $\epsilon_0=\delta^\Delta/(2+\Delta)$. Finally, let $G$ be a graph and $X_1,X_2,\ldots,X_h$ be disjoint sets of vertices of $G$ such that whenever $ij\in E(H_2)$ then $(X_i,X_j)$ is a $\epsilon$-regular pair with density at least $\epsilon+\delta$. Then if $\epsilon\leq\epsilon_0$ and $1-t\leq N\epsilon_0$, the number of injective graph homomorphisms from $H_2$ to $G$ is at least $(\epsilon_0N)^h$.

In fact, one can only restrict to counting homomorphisms such that any vertex k\in /math> of $H_2$ such that $k\in V_i$ is mapped to a vertex in $X_i$.

Proof

We will provide proof of the counting lemma in the case when $H$ is a triangle (triangle counting lemma). The proof of the general case, as well as the proof of the blow-up lemma, are very similar and do not require different techniques.

Take $\epsilon=\delta/2$. Let $X_1'\subset X_1$ be the set of those vertices in $X_1$ which have at least $(d_-\epsilon), X_2,$ neighbors in $X_2$ and at least $(d_-\epsilon), X_3,$ neighbors in $X_3$. Note that if there were more than $\epsilon, X_1,$ vertices in $X_1$ with less than $(d_-\epsilon), X_2,$ neighbors in $X_2$, then these vertices together with whole $X_2$ would witness $\epsilon$-irregularity of the pair $(X_1,X_2)$. Repeating this argument for $X_3$ shows that we must have $, X_1', >(1-2\epsilon), X_1,$. Now take arbitrary $x\in X_1'$ and define $X_2'$ and $X_3'$ as neighbors of $x$ in $X_2$ and $X_3$ respectively. By definition $, X_2', \geq (d_-\epsilon), X_2, \geq \epsilon, X_2,$ and $, X_3', \geq \epsilon, X_3,$ so by regularity of $(X_2,X_3)$ we obtain existence of at least
$(d_-\epsilon), X_2', , X_3', \geq (d_-\epsilon)(d_-\epsilon)(d_-\epsilon), X_2, , X_3,$
triangles containing $x$. Since $x$ was chosen arbitrarily from the set $X_1'$ of size at least $(1-2\epsilon), X_1,$, we obtain a total of at least
$(1-2\epsilon)(d_-\epsilon), X_2', , X_3', \geq (d_-\epsilon)(d_-\epsilon)(d_-\epsilon), X_1, , X_2, , X_3,$
which finishes the proof as $\epsilon=\delta/2$.

Proof

Proof of the triangle removal lemma

To prove the triangle removal lemma, consider an $\epsilon/4$-regular partition $V_1 \cup \cdots \cup V_M$ of the vertex set of $G$. This exists by the Szemerédi regularity lemma. The idea is to remove all edges between irregular pairs, low-density pairs, and small parts, and prove that if at least one triangle still remains, then many triangles remain. Specifically, remove all edges between parts $V_i$ and $V_j$ if

This procedure removes at most $\epsilon n^2$ edges. If there exists a triangle with vertices in $V_i, V_j, V_k$ after these edges are removed, then the triangle counting lemma tells us there are at least
$\left(1-\frac\right)\left(\frac\right)^3\left(\frac\right)^3\cdot n^3$
triples in $V_i \times V_j \times V_k$ which form a triangle. Thus, we may take
$\delta < \frac \left(1-\frac\right)\left(\frac\right)^3\left(\frac\right)^3.$

Proof of the graph removal lemma

The proof of the case of general $H$ is analogous to the triangle case, and uses graph counting lemma instead of triangle counting lemma.

Induced Graph Removal Lemma

A natural generalization of the Graph Removal Lemma is to consider induced subgraphs. In property testing it is often useful to consider how far a graph is from being induced H-free. A graph $G$ is considered to contain an induced subgraph $H$ if there is an injective map $f: V(H) \rightarrow V(G)$ such that $(f(u),f(v))$ is an edge of $G$ if and only if $(u,v)$ is an edge of $H$. Notice that non-edges are considered as well. $G$ is induced $H$-free if there is no induced subgraph $G$. We define $G$ as $\epsilon$-far from being induced $H$-free if we cannot add or delete $\epsilon n^2$ edges to make $G$ induced $H$-free.

Formulation

A version of the Graph Removal for induced subgraphs was proved by Alon, Fischer, Krivelevich, and Szegedy in 2000. It states that for any graph $H$ with $h$ vertices and $\epsilon > 0$, there exists a constant $\delta > 0$ such that if an $n$-vertex graph $G$ has fewer than $\delta n^h$ induced subgraphs isomorphic to $H$, then it is possible to eliminate all induced copies of $H$ by adding or removing fewer than $\epsilon n^2$ edges.

The problem can be reformulated as follows: Given a red-blue coloring $H'$ of the complete graph $K_h$ (Analogous to the graph $H$ on the same $h$ vertices where non-edges are blue, edges are red), and a constant $\epsilon > 0$, then there exists a constant $\delta > 0$ such that for any red-blue colorings of $K_n$ has fewer than $\delta n^h$ subgraphs isomorphic to $H'$, then it is possible to eliminate all copies of $H$ by changing the colors of fewer than $\epsilon n^2$ edges. Notice that our previous "cleaning" process, where we remove all edges between irregular pairs, low-density pairs, and small parts, only involves removing edges. Removing edges only corresponds to changing edge colors from red to blue. However, there are situations in the induced case where the optimal edit distance involves changing edge colors from blue to red as well. Thus, the Regularity Lemma is insufficient to prove Induced Graph Removal Lemma. The proof of the Induced Graph Removal Lemma must take advantage of the strong regularity lemma.

Proof

Strong Regularity Lemma

The strong regularity lemma is a strengthened version of Szemerédi's Regularity Lemma. For any infinite sequence of constants $\epsilon_0\ge \epsilon_1 \ge ...>0$, there exists an integer $M$ such that for any graph $G$, we can obtain two (equitable) partitions $\mathcal$ and $\mathcal$ such that the following properties are satisfied:

* $\mathcal$ refines $\mathcal$, that is every part of $\mathcal$ is the union of some collection of parts in $\mathcal$.
* $\mathcal$ is $\epsilon_0$-regular and $\mathcal$ is $\epsilon_$-regular.
* q(\mathcal)
* $, \mathcal, \le M$

The function $q$ is defined to be the energy function defined in Szemerédi regularity lemma. Essentially, we can find a pair of partitions $\mathcal, \mathcal$ where $\mathcal$ is regular compared to $\mathcal$, and at the same time $\mathcal, \mathcal$ are close to each other. (This property is captured in the third condition)

=Corollary of the Strong Regularity Lemma

=

The following corollary of the strong regularity lemma is used in the proof of the Induced Graph Removal Lemma. For any infinite sequence of constants $\epsilon_0\ge \epsilon_1 \ge ...>0$, there exists $\delta>0$ such that there exists a partition $\mathcal=$ and subsets $W_i \subset V_i$ for each $i$ where the following properties are satisfied:

* $, W_i, >\delta n$
* $(W_i,W_j)$ is $\epsilon_$-regular for each pair $i,j$
* $, d(W_i,W_j)-d(V_i,V_j), \le \epsilon_0$ for all but $\epsilon_0 , \mathcal, ^2$ pairs $i,j$

The main idea of the proof of this corollary is to start with two partitions $\mathcal$ and $\mathcal$ that satisfy the Strong Regularity Lemma where q(\mathcal). Then for each part $V_i \in \mathcal$, we uniformly at random choose some part $W_i \subset V_i$ that is a part in $\mathcal$. The expected number of irregular pairs $(W_i,W_j)$ is less than 1. Thus, there exists some collection of $W_i$ such that every pair is $\epsilon_$-regular!

The important aspect of this corollary is that pair of $W_i,W_j$ are $\epsilon_$-regular! This allows us to consider edges and non-edges when we perform our cleaning argument.

Proof of Sketch of the Induced Graph Removal Lemma

With these results, we are able to prove the Induced Graph Removal Lemma. Take any graph $G$ with $n$ vertices that has less than $\delta n^$ copies of $H$. The idea is to start with a collection of vertex sets $W_i$ which satisfy the conditions of the Corollary of the Strong Regularity Lemma. We then can perform a "cleaning" process where we remove all edges between pairs of parts $(W_i,W_j)$ with low density, and we can add all edges between pairs of parts $(W_i,W_j)$ with high density. We choose the density requirements such that we added/deleted at most $\epsilon n^2$ edges.

If the new graph has no copies of $H$, then we are done. Suppose the new graph has a copy of $H$. Suppose the vertex $v_i \in v(H)$ is embedded in $W_$. Then if there is an edge connecting $v_i,v_j$ in $H$, then $W_i,W_j$ does not have low density. (Edges between $W_i,W_j$ were not removed in the cleaning process) Similarly, if there is not an edge connecting $v_i,v_j$ in $H$, then $W_i,W_j$ does not have high density. (Edges between $W_i,W_j$ were not added in the cleaning process)

Thus, by a similar counting argument to the proof of the triangle counting lemma, that is the graph counting lemma, we can show that $G$ has more than $\delta n^$ copies of $H$.

Generalizations

The graph removal lemma was later extended to directed graphs and to hypergraphs.

Quantitative bounds

Usage of regularity lemma in the proof of graph removal lemma forces $\delta$ to be extremely small, bounded by tower function of height polynomial in $\epsilon^$ that is $\delta=1/\text(\epsilon^)$ (here $\text(k)$ is the tower of twos of height $k$). Tower function of height $\epsilon^$ is necessary in all regularity proofs as is implied by results of Gowers on lower bounds in regularity lemma. However, in 2011 Fox provided a new proof of graph removal lemma which does not use regularity lemma, improving the bound to $\delta=1/\text(5h^2\log\epsilon^)$ (here $h$ is number of vertices of removed graph $H$). His proof, however, uses regularity-related ideas such as energy increment, but with different notion of energy, related to entropy. This proof can be also rephrased using Frieze-Kannan weak regularity lemma as noted by Conlon and Fox. In the special case of bipartite $H$ it was shown that $\delta=\epsilon^$ is sufficient.

There is a large gap between upper and lower bounds for $\delta$ in the general case. The current best result true for all graphs $H$ is due to Alon and states that for each nonbipartite $H$ there exists constant $c>0$ such that $\delta<(\epsilon/c)^$ is necessary for the graph removal lemma to hold while for bipartite $H$ the optimal $\delta$ has polynomial dependence on $\epsilon$, which matches the lower bound. Construction for nonbipartite case is a consequence of Behrend construction of large Salem-Spencer set. Indeed, as triangle removal lemma implies Roth's theorem, existence of large Salem-Spencer set may be translated to an upper bound for $\delta$ in the triangle removal lemma. This method can be leveraged for arbitrary nonbipartite $H$ to give aforementioned bound.

Applications

Additive combinatorics

Graph theory

Property testing

See also

* Counting lemma

References

{{reflist, refs=

{{citation
, last1 = Alon , first1 = Noga , author1-link = Noga Alon
, last2 = Fischer , first2 = Eldar
, last3 = Krivelevich , first3 = Michael , author3-link = Michael Krivelevich
, last4 = Szegedy , first4 = Mario , author4-link = Mario Szegedy
, doi = 10.1007/s004930070001
, issue = 4
, journal = Combinatorica
, mr = 1804820
, pages = 451–476
, title = Efficient testing of large graphs
, volume = 20
, year = 2000
, s2cid = 44645628

{{citation
, last1 = Alon , first1 = Noga , author1-link = Noga Alon
, last2 = Shapira , first2 = Asaf
, doi = 10.1016/j.jcss.2004.04.008
, issue = 3
, journal = Journal of Computer and System Sciences
, mr = 2087940
, pages = 353–382
, title = Testing subgraphs in directed graphs
, volume = 69
, year = 2004

{{citation
, last1 = Alon , first1 = Noga , author1-link = Noga Alon
, last2 = Shapira , first2 = Asaf
, doi = 10.1137/06064888X
, issue = 6
, journal = SIAM Journal on Computing
, mr = 2386211
, pages = 1703–1727
, title = A characterization of the (natural) graph properties testable with one-sided error
, volume = 37
, year = 2008

{{citation
, last1 = Erdős , first1 = P. , author1-link = Paul Erdős
, last2 = Frankl , first2 = P. , author2-link = Peter Frankl
, last3 = Rödl , first3 = V. , author3-link = Vojtěch Rödl
, doi = 10.1007/BF01788085
, issue = 2
, journal = Graphs and Combinatorics
, mr = 932119
, pages = 113–121
, title = The asymptotic number of graphs not containing a fixed subgraph and a problem for hypergraphs having no exponent
, volume = 2
, year = 1986, s2cid = 16839886

{{citation
, last = Fox , first = Jacob , authorlink = Jacob Fox
, doi = 10.4007/annals.2011.174.1.17
, issue = 1
, journal = Annals of Mathematics
, mr = 2811609
, pages = 561–579
, series = Second Series
, title = A new proof of the graph removal lemma
, volume = 174
, year = 2011, arxiv = 1006.1300
, s2cid = 8250133

{{citation
, last = Roth , first = K. F. , authorlink = Klaus Roth
, doi = 10.1112/jlms/s1-28.1.104
, issue = 1
, journal = Journal of the London Mathematical Society
, mr = 51853
, pages = 104–109
, volume = 28
, title = On certain sets of integers
, year = 1953

{{citation
, last1 = Ruzsa , first1 = I. Z. , author1-link = Imre Z. Ruzsa
, last2 = Szemerédi , first2 = E. , author2-link = Endre Szemerédi
, contribution = Triple systems with no six points carrying three triangles
, mr = 519318
, pages = 939–945
, publisher = North-Holland , location = Amsterdam and New York
, series = Colloq. Math. Soc. János Bolyai
, title = Combinatorics (Proc. Fifth Hungarian Colloq., Keszthely, 1976), Vol. II
, volume = 18
, year = 1978

{{citation
, last = Solymosi , first = J. , author-link = József Solymosi
, s2cid = 53973423
, doi = 10.1007/978-3-642-55566-4_39
, journal = Discrete and Computational Geometry
, mr = 2038505
, pages = 825–827
, title = Note on a generalization of Roth's theorem
, volume = 25
, year = 2003
, series = Algorithms and Combinatorics
, isbn = 978-3-642-62442-1

{{citation
, last = Tao , first = Terence , authorlink = Terence Tao
, doi = 10.1016/j.jcta.2005.11.006
, issue = 7
, journal = Journal of Combinatorial Theory
, mr = 2259060
, pages = 1257–1280
, series = Series A
, title = A variant of the hypergraph removal lemma
, volume = 113
, year = 2006, arxiv = math/0503572
, s2cid = 14337591

{{citation, url=https://lucatrevisan.wordpress.com/2009/05/13/the-triangle-removal-lemma/, title=The Triangle Removal Lemma, work=in theory, first=Luca, last=Trevisan, authorlink=Luca Trevisan, date=May 13, 2009

{{citation
, last1 = Conlon , first1 = David , author1-link = David Conlon
, last2 = Fox , first2 = Jacob , author2-link = Jacob Fox
, editor1-last = Blackburn , editor1-first = Simon R.
, editor2-last = Gerke , editor2-first = Stefanie
, editor3-last = Wildon , editor3-first = Mark
, arxiv = 1211.3487
, contribution = Graph removal lemmas
, doi = 10.1017/CBO9781139506748.002
, mr = 3156927
, pages = 1–49
, publisher = Cambridge University Press , location = Cambridge, UK
, series = London Mathematical Society Lecture Note Series
, title = Surveys in Combinatorics 2013
, volume = 409
, year = 2013, s2cid = 2658118

{{Cite journal, last=Füredi, first=Zoltán, date=1995, editor-last=Chatterji, editor-first=S. D., title=Extremal Hypergraphs and Combinatorial Geometry, url=https://link.springer.com/chapter/10.1007/978-3-0348-9078-6_129, journal=Proceedings of the International Congress of Mathematicians, language=en, location=Basel, publisher=Birkhäuser, pages=1343–1352, doi=10.1007/978-3-0348-9078-6_129, isbn=978-3-0348-9078-6

{{Cite journal, last=Komlós, first=János, date=1999, title=The Blow-up Lemma, url=https://www.cambridge.org/core/journals/combinatorics-probability-and-computing/article/abs/blowup-lemma/1F094FCD0A272B5FBE5B1E5D0583E8D3, journal=Combinatorics, Probability and Computing, language=en, volume=8, issue=1–2, pages=161–176, doi=10.1017/S0963548398003502, issn=1469-2163

{{Cite journal, last1=Komlós, first1=János, last2=Sárközy, first2=Gábor N., last3=Szemerédi, first3=Endre, date=1997-03-01, title=Blow-up Lemma, url=https://doi.org/10.1007/BF01196135, journal=Combinatorica, language=en, volume=17, issue=1, pages=109–123, doi=10.1007/BF01196135, s2cid=6720143, issn=1439-6912

{{Cite journal, last=Gowers, first=W. T., date=1997, title=Lower bounds of tower type for Szemerédi's uniformity lemma, journal=Geometric and Functional Analysis, volume=7, issue=2, pages=322–337, url=https://www.semanticscholar.org/paper/Lower-bounds-of-tower-type-for-Szemer%C3%A9di's-lemma-Gowers/b03a06cb7707750dffabc9c991de8baf1c2fa001, doi=10.1007/PL00001621, s2cid=115242956

{{Cite journal, last=Alon, first=N., date=2001-10-14, title=Testing Subgraphs in Large Graphs, url=https://dl.acm.org/doi/10.5555/874063.875540, journal=Proceedings of the 42nd IEEE Symposium on Foundations of Computer Science, series=FOCS '01, location=USA, publisher=IEEE Computer Society, pages=434–441, doi=10.1109/SFCS.2001.959918, isbn=978-0-7695-1390-4, s2cid=12484006

{{Cite journal
, last1 = Erdős , first1 = P. , author1-link = Paul Erdős
, last2 = Simonovits , first2 = M. , author2-link = Miklós Simonovits
, year = 1966
, title = A limit theorem in graph theory
, pages = 51–57
, volume = 1
, journal = Studia Sci. Math. Hung.

{{Cite journal
, last = Erdős , first = P. , author-link = Paul Erdős
, year = 1966
, title = Some recent results on extremal problems in graph theory
, pages = 118–123
, journal = Theory of Graphs, International Symp. Rome

{{Cite journal
, last = Erdős , first = P. , author-link = Paul Erdős
, year = 1966
, title = On some new inequalities concerning extremal properties of graphs
, pages = 77–81
, journal = Theory of Graphs, Proc. Coll. Tihany, Hungary

{{Cite journal
, last1 = Erdős , first1 = P. , author1-link = Paul Erdős
, last2 = Katona , first2 = G. , author2-link = Gyula O. H. Katona
, year = 1966
, title = A method for solving extremal problems in graph theory
, pages = 279–319
, journal = Theory of Graphs, Proc. Coll. Tihany

Graph theory