In mathematics, a knee of a curve (or elbow of a curve) is a point where the curve visibly bends, specifically from high slope to low slope (flat or close to flat), or in the other direction. This is particularly used in optimization, where a knee point is the optimum point for some decision, for example when there is an increasing function and a trade-off between the benefit (vertical y axis) and the cost (horizontal x axis): the knee is where the benefit is no longer increasing rapidly, and is no longer worth the cost of further increases – a cutoff point of diminishing returns.
In heuristic use, the term may be used informally, and a knee point identified visually, but in more formal use an explicit objective function is used, and depends on the particular optimization problem. A knee may also be defined purely geometrically, in terms of the curvature or the second derivative.
Definitions
The knee of a curve can be defined as a vertex of the graph. This corresponds with the graphical intuition (it is where the curvature has a maximum), but depends on the choice of scale.
The term "knee" as applied to curves dates at least to the 1910s, and is found more commonly by the 1940s, being common enough to draw criticism. The unabridged Webster's Dictionary (1971 edition) gives definition 3h of knee as:
an abrupt change in direction in a curve (as on a graph); esp one approaching a right angle in shape.
Criticism
Graphical notions of a "knee" of a curve, based on curvature, are criticized due to their dependence on the coordinate scale: different choices of scale result in different points being the "knee". This criticism dates at least to the 1940s, being found in Worthing & Geffner (1943, Preface), who criticize:
references to the significance of a so-called knee of a curve when the location of the knee was a function of the chosen coordinate scales
Detection methods
The Kneedle algorithm The algorithm detects the best balanced tradeoff based on the mathematical curvature concept, which is defined and well studied for continuous functions. Alternatively, the kneepointDetection() function from the SamSPECTRAL R package can be used to find the knee point, where is a "phase change" in the data, by fitting two lines using linear regression.
Applications
References
- Terrell, John Alan (1913). An Experimental Investigation of a New System for Automatically Regulating the Voltage of an Alternating Current Circuit. Rensselaer Polytechnic Institute. p. 10.
... enables one to tell how near the "knee" of the curve the iron is ...
- NACA Wartime Report. L. National Advisory Committee for Aeronautics. 1943. p. 21.
... the knee of the curve lies in the region of the critical load ...
- Worthing & Geffner 1943, Preface.
- ^ Kiokemeister, Fred L. (1949). "An Analysis of Functions Describing Experimental Data". Psychophysical Research: 5.
- Thomas & Sheldon 1999, p. 18.
- Satopaa, Ville; Albrecht, Jeannie; Irwin, David; Raghavan, Barath (June 2011). "Finding a "Kneedle" in a Haystack: Detecting Knee Points in System Behavior". 2011 31st International Conference on Distributed Computing Systems Workshops. pp. 166–171. doi:10.1109/ICDCSW.2011.20. ISBN 978-1-4577-0384-3.
- Kleine, Daniel (20 January 2023). "Detecting knee- / elbow points in a graph". Medium.
- "kneepointDetection: Fits 2 regression lines to data to estimate the knee (or... in SamSPECTRAL: Identifies cell population in flow cytometry data". rdrr.io.
- "SamSPECTRAL". Bioconductor.
- Worthing, J.; Geffner, A. G. (1943). Treatment of Experimental Data.
- Thomas, Clayton; Sheldon, Bob (1999). "The "Knee of a Curve"— Useful Clue but Incomplete Support". Military Operations Research. 4 (2): 17–24. doi:10.5711/morj.4.2.17. JSTOR 43940795.