Maximum cut

Summary

In a graph, a maximum cut is a cut whose size is at least the size of any other cut. That is, it is a partition of the graph's vertices into two complementary sets S and T, such that the number of edges between S and T is as large as possible. Finding such a cut is known as the max-cut problem.

An example of a maximum cut

The problem can be stated simply as follows. One wants a subset S of the vertex set such that the number of edges between S and the complementary subset is as large as possible. Equivalently, one wants a bipartite subgraph of the graph with as many edges as possible.

There is a more general version of the problem called weighted max-cut, where each edge is associated with a real number, its weight, and the objective is to maximize the total weight of the edges between S and its complement rather than the number of the edges. The weighted max-cut problem allowing both positive and negative weights can be trivially transformed into a weighted minimum cut problem by flipping the sign in all weights.

Lower bounds edit

Edwards[1][2] obtained the following two lower bound for Max-Cut on a graph G with n vertices and m edges (in (a) G is arbitrary, but in (b) it is connected):

(a)  
(b)  

Bound (b) is often called the Edwards-Erdős bound[3] as Erdős conjectured it. Edwards proved the Edwards-Erdős bound using probabilistic method; Crowston et al.[4] proved the bound using linear algebra and analysis of pseudo-boolean functions.

The proof of Crowston et al. allows us to extend the Edwards-Erdős bound to the Balanced Subgraph Problem (BSP) [4] on signed graphs G = (V, E, s), i.e. graphs where each edge is assigned + or –. For a partition of V into subsets U and W, an edge xy is balanced if either s(xy) = + and x and y are in the same subset, or s(xy) = – and x and y are different subsets. BSP aims at finding a partition with the maximum number b(G) of balanced edges in G. The Edwards-Erdős gives a lower bound on b(G) for every connected signed graph G. Bound (a) was improved for special classes of graphs: triangle-free graphs, graphs of given maximum degree, H-free graphs, etc., see e.g.[5][6][7]

Poljak and Turzik[8] extended the Edwards-Erdős bound to weighted Max-Cut:

 

where w(G) and w(Tmin) are the weights of G and its minimum weight spanning tree Tmin. Recently, Gutin and Yeo[9] obtained a number of lower bounds for weighted Max-Cut extending the Poljak-Turzik bound for arbitrary weighted graphs and bounds for special classes of weighted graphs.

Computational complexity edit

The following decision problem related to maximum cuts has been studied widely in theoretical computer science:

Given a graph G and an integer k, determine whether there is a cut of size at least k in G.

This problem is known to be NP-complete. It is easy to see that the problem is in NP: a yes answer is easy to prove by presenting a large enough cut. The NP-completeness of the problem can be shown, for example, by a reduction from maximum 2-satisfiability (a restriction of the maximum satisfiability problem).[10] The weighted version of the decision problem was one of Karp's 21 NP-complete problems;[11] Karp showed the NP-completeness by a reduction from the partition problem.

The canonical optimization variant of the above decision problem is usually known as the Maximum-Cut Problem or Max-Cut and is defined as:

Given a graph G, find a maximum cut.

The optimization variant is known to be NP-Hard. The opposite problem, that of finding a minimum cut is known to be efficiently solvable via the Ford–Fulkerson algorithm.

Algorithms edit

Polynomial-time algorithms edit

As the Max-Cut Problem is NP-hard, no polynomial-time algorithms for Max-Cut in general graphs are known.

Planar graphs edit

However, in planar graphs, the Maximum-Cut Problem is dual to the route inspection problem (the problem of finding a shortest tour that visits each edge of a graph at least once), in the sense that the edges that do not belong to a maximum cut-set of a graph G are the duals of the edges that are doubled in an optimal inspection tour of the dual graph of G. The optimal inspection tour forms a self-intersecting curve that separates the plane into two subsets, the subset of points for which the winding number of the curve is even and the subset for which the winding number is odd; these two subsets form a cut that includes all of the edges whose duals appear an odd number of times in the tour. The route inspection problem may be solved in polynomial time, and this duality allows the maximum cut problem to also be solved in polynomial time for planar graphs.[12] The Maximum-Bisection problem is known however to be NP-hard.[13]

Approximation algorithms edit

The Max-Cut Problem is APX-hard,[14] meaning that there is no polynomial-time approximation scheme (PTAS), arbitrarily close to the optimal solution, for it, unless P = NP. Thus, every known polynomial-time approximation algorithm achieves an approximation ratio strictly less than one.

There is a simple randomized 0.5-approximation algorithm: for each vertex flip a coin to decide to which half of the partition to assign it.[15][16] In expectation, half of the edges are cut edges. This algorithm can be derandomized with the method of conditional probabilities; therefore there is a simple deterministic polynomial-time 0.5-approximation algorithm as well.[17][18] One such algorithm starts with an arbitrary partition of the vertices of the given graph   and repeatedly moves one vertex at a time from one side of the partition to the other, improving the solution at each step, until no more improvements of this type can be made. The number of iterations is at most   because the algorithm improves the cut by at least one edge at each step. When the algorithm terminates, at least half of the edges incident to every vertex belong to the cut, for otherwise moving the vertex would improve the cut. Therefore, the cut includes at least   edges.

The polynomial-time approximation algorithm for Max-Cut with the best known approximation ratio is a method by Goemans and Williamson using semidefinite programming and randomized rounding that achieves an approximation ratio   where

 [19][20]

If the unique games conjecture is true, this is the best possible approximation ratio for maximum cut.[21] Without such unproven assumptions, it has been proven to be NP-hard to approximate the max-cut value with an approximation ratio better than  .[22][23]

In [24] there is an extended analysis of 10 heuristics for this problem, including open-source implementation.

Parameterized algorithms and kernelization edit

While it is trivial to prove that the problem of finding a cut of size at least (the parameter) k is fixed-parameter tractable (FPT), it is much harder to show fixed-parameter tractability for the problem of deciding whether a graph G has a cut of size at least the Edwards-Erdős lower bound (see Lower bounds above) plus (the parameter)k. Crowston et al.[25] proved that the problem can be solved in time   and admits a kernel of size  . Crowston et al.[25] extended the fixed-parameter tractability result to the Balanced Subgraph Problem (BSP, see Lower bounds above) and improved the kernel size to   (holds also for BSP). Etscheid and Mnich [26] improved the fixed-parameter tractability result for BSP to   and the kernel-size result to   vertices.

Applications edit

Machine learning edit

Treating its nodes as features and its edges as distances, the max cut algorithm divides a graph in two well-separated subsets. In other words, it can be naturally applied to perform binary classification. Compared to more common classification algorithms, it does not require a feature space, only the distances between elements within.[27]

Theoretical physics edit

In statistical physics and disordered systems, the Max Cut problem is equivalent to minimizing the Hamiltonian of a spin glass model, most simply the Ising model.[28] For the Ising model on a graph G and only nearest-neighbor interactions, the Hamiltonian is

 

Here each vertex i of the graph is a spin site that can take a spin value   A spin configuration partitions   into two sets, those with spin up   and those with spin down   We denote with   the set of edges that connect the two sets. We can then rewrite the Hamiltonian as

 

Minimizing this energy is equivalent to the min-cut problem or by setting the graph weights as   the max-cut problem.[28]

Circuit design edit

The max cut problem has applications in VLSI design.[28]

See also edit

Notes edit

  1. ^ Edwards (1973).
  2. ^ Edwards (1975).
  3. ^ Bylka, Idzik & Tuza (1999).
  4. ^ a b Crowston et al. (2014).
  5. ^ Alon, Krivelevich & Sudakov (2005).
  6. ^ Scott (2005).
  7. ^ Zeng & Hou (2017).
  8. ^ Poljak & Turzik (1986).
  9. ^ Gutin & Yeo (2021).
  10. ^ Garey & Johnson (1979).
  11. ^ Karp (1972).
  12. ^ Hadlock (1975).
  13. ^ Jansen et al. (2005).
  14. ^ Papadimitriou & Yannakakis (1991) prove MaxSNP-completeness.
  15. ^ Mitzenmacher & Upfal (2005), Sect. 6.2.
  16. ^ Motwani & Raghavan (1995), Sect. 5.1.
  17. ^ Mitzenmacher & Upfal (2005), Sect. 6.3.
  18. ^ Khuller, Raghavachari & Young (2007).
  19. ^ Gaur & Krishnamurti (2007).
  20. ^ Ausiello et al. (2003)
  21. ^ Khot et al. (2007).
  22. ^ Håstad (2001)
  23. ^ Trevisan et al. (2000)
  24. ^ Dunning, Gupta & Silberholz (2018)
  25. ^ a b Crowston, Jones & Mnich (2015).
  26. ^ Etscheid & Mnich (2018).
  27. ^ Boykov, Y.Y.; Jolly, M.-P. (2001). "Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images". Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001. Vol. 1. IEEE Comput. Soc. pp. 105–112. doi:10.1109/iccv.2001.937505. ISBN 0-7695-1143-0. S2CID 2245438.
  28. ^ a b c Barahona, Francisco; Grötschel, Martin; Jünger, Michael; Reinelt, Gerhard (1988). "An Application of Combinatorial Optimization to Statistical Physics and Circuit Layout Design". Operations Research. 36 (3): 493–513. doi:10.1287/opre.36.3.493. ISSN 0030-364X. JSTOR 170992.

References edit

  • Alon, N.; Krivelevich, M.; Sudakov, B. (2005), "Maxcut in H-free graphs", Combin. Probab. Comput., 14: 629–647, doi:10.1017/S0963548305007017, S2CID 123485000.
  • Ausiello, Giorgio; Crescenzi, Pierluigi; Gambosi, Giorgio; Kann, Viggo; Marchetti-Spaccamela, Alberto; Protasi, Marco (2003), Complexity and Approximation: Combinatorial Optimization Problems and Their Approximability Properties, Springer.
Maximum cut (optimisation version) is the problem ND14 in Appendix B (page 399).
  • Bylka, S.; Idzik, A.; Tuza, I. (1999), "Maximum cuts: Improvements and local algorithmic analogues of the Edwards-Erd6s inequality", Discrete Math., 194: 39–58, doi:10.1016/S0012-365X(98)00115-0.
  • Crowston, R.; Fellows, M.; Gutin, G.; Jones, M.; Kim, E. J.; Rosamond, F.; Ruzsa, I. Z.; Thomassé, S.; Yeo, A. (2014), "Satisfying more than half of a system of linear equations over GF(2): A multivariate approach", J. Comput. Syst. Sci., 80 (4): 687–696, doi:10.1016/j.jcss.2013.10.002.
  • Crowston, R.; Gutin, G.; Jones, M.; Muciaccia, G. (2013), "Maximum balanced subgraph problem parameterized above lower bound", Theor. Comput. Sci., 513: 53–64, arXiv:1212.6848, doi:10.1016/j.tcs.2013.10.026.
  • Crowston, R.; Jones, M.; Mnich, M. (2015), "Max-cut parameterized above the Edwards–Erdős bound", Algorithmica, 72 (3): 734–757, doi:10.1007/s00453-014-9870-z, S2CID 14973734.
  • Dunning, Iain; Gupta, Swati; Silberholz, John (2018), "What works best when? A systematic evaluation of heuristics for Max-Cut and QUBO", INFORMS Journal on Computing, 30 (3): 608–624, doi:10.1287/ijoc.2017.0798, S2CID 485706.
  • Edwards, C. S. (1973), "Some extremal properties of bipartite subgraphs", Can. J. Math., 25 (3): 475–485, doi:10.4153/CJM-1973-048-x, S2CID 121925638.
  • Edwards, C. S. (1975), "An improved lower bound for the number of edges in a largest bipartite subgraph", Recent Advances in Graph Theory, pp. 167–181.
  • Etscheid, M.; Mnich, M. (2018), "Linear Kernels and Linear-Time Algorithms for Finding Large Cuts", Algorithmica, 80 (9): 2574–2615, doi:10.1007/s00453-017-0388-z, hdl:11420/4693, S2CID 16301072.
  • Garey, Michael R.; Johnson, David S. (1979), Computers and Intractability: A Guide to the Theory of NP-Completeness, W.H. Freeman, ISBN 978-0-7167-1045-5.
Maximum cut (decision version) is the problem ND16 in Appendix A2.2.
Maximum bipartite subgraph (decision version) is the problem GT25 in Appendix A1.2.
  • Gaur, Daya Ram; Krishnamurti, Ramesh (2007), "LP rounding and extensions", in Gonzalez, Teofilo F. (ed.), Handbook of Approximation Algorithms and Metaheuristics, Chapman & Hall/CRC.
  • Goemans, Michel X.; Williamson, David P. (1995), "Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming", Journal of the ACM, 42 (6): 1115–1145, doi:10.1145/227683.227684, S2CID 15794408.
  • Gutin, G.; Yeo, A. (2021), "Lower Bounds for Maximum Weighted Cut", arXiv:2104.05536 [math.CO].
  • Hadlock, F. (1975), "Finding a Maximum Cut of a Planar Graph in Polynomial Time", SIAM J. Comput., 4 (3): 221–225, doi:10.1137/0204019.
  • Håstad, Johan (2001), "Some optimal inapproximability results", Journal of the ACM, 48 (4): 798–859, doi:10.1145/502090.502098, S2CID 5120748.
  • Jansen, Klaus; Karpinski, Marek; Lingas, Andrzej; Seidel, Eike (2005), "Polynomial Time Approximation Schemes for MAX-BISECTION on Planar and Geometric Graphs", SIAM Journal on Computing, 35 (1): 110–119, CiteSeerX 10.1.1.62.5082, doi:10.1137/s009753970139567x.
  • Karp, Richard M. (1972), "Reducibility among combinatorial problems", in Miller, R. E.; Thacher, J. W. (eds.), Complexity of Computer Computation, Plenum Press, pp. 85–103.
  • Khot, Subhash; Kindler, Guy; Mossel, Elchanan; O'Donnell, Ryan (2007), "Optimal inapproximability results for MAX-CUT and other 2-variable CSPs?", SIAM Journal on Computing, 37 (1): 319–357, doi:10.1137/S0097539705447372, S2CID 2090495.
  • Khuller, Samir; Raghavachari, Balaji; Young, Neal E. (2007), "Greedy methods", in Gonzalez, Teofilo F. (ed.), Handbook of Approximation Algorithms and Metaheuristics, Chapman & Hall/CRC.
  • Mitzenmacher, Michael; Upfal, Eli (2005), Probability and Computing: Randomized Algorithms and Probabilistic Analysis, Cambridge.
  • Motwani, Rajeev; Raghavan, Prabhakar (1995), Randomized Algorithms, Cambridge.
  • Newman, Alantha (2008), "Max cut", in Kao, Ming-Yang (ed.), Encyclopedia of Algorithms, Springer, pp. 489–492, doi:10.1007/978-0-387-30162-4_219, ISBN 978-0-387-30770-1.
  • Papadimitriou, Christos H.; Yannakakis, Mihalis (1991), "Optimization, approximation, and complexity classes", Journal of Computer and System Sciences, 43 (3): 425–440, doi:10.1016/0022-0000(91)90023-X.
  • Poljak, S.; Turzik, Z. (1986), "A polynomial time heuristic for certain subgraph optimization problems with guaranteed worst case bound", Discrete Math., 58 (1): 99–104, doi:10.1016/0012-365X(86)90192-5.
  • Scott, A. (2005), "Judicious partitions and related problems", Surveys in Combinatorics, London Mathematical Society Lecture Note Series, 327: 95–117.
  • Trevisan, Luca; Sorkin, Gregory; Sudan, Madhu; Williamson, David (2000), "Gadgets, Approximation, and Linear Programming", Proceedings of the 37th IEEE Symposium on Foundations of Computer Science: 617–626.
  • Zeng, Q.; Hou, J. (2017), "Bipartite Subgraphs of H-free Graphs", Bull. Aust. Math. Soc., 30 (3): 1–13, doi:10.1017/S0004972716001295.

External links edit

  • Pierluigi Crescenzi, Viggo Kann, Magnús Halldórsson, Marek Karpinski, Gerhard Woeginger (2000), "Maximum Cut", in "A compendium of NP optimization problems".
  • Andrea Casini, Nicola Rebagliati (2012), "A Python library for solving Max Cut"