<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://help18.whiz.me/index.php?action=history&amp;feed=atom&amp;title=Glossary%3AR-Metric</id>
	<title>Glossary:R-Metric - Revision history</title>
	<link rel="self" type="application/atom+xml" href="https://help18.whiz.me/index.php?action=history&amp;feed=atom&amp;title=Glossary%3AR-Metric"/>
	<link rel="alternate" type="text/html" href="https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;action=history"/>
	<updated>2026-06-17T12:14:30Z</updated>
	<subtitle>Revision history for this page on the wiki</subtitle>
	<generator>MediaWiki 1.43.0</generator>
	<entry>
		<id>https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=10536&amp;oldid=prev</id>
		<title>SuperMemoHelp at 19:39, 12 April 2019</title>
		<link rel="alternate" type="text/html" href="https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=10536&amp;oldid=prev"/>
		<updated>2019-04-12T19:39:28Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 15:39, 12 April 2019&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:[[File:Recall_metric.jpg|thumb|SuperMemo 18 performance metric]]absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 18?|SuperMemo 18]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [https://supermemo.guru/wiki/Algorithm_SM-15 Algorithm SM-15] (known from SuperMemo 16) and the new [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-18)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:[[File:Recall_metric.jpg|thumb|SuperMemo&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;: Algorithm SM-&lt;/ins&gt;18 performance metric]]absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 18?|SuperMemo 18]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [https://supermemo.guru/wiki/Algorithm_SM-15 Algorithm SM-15] (known from SuperMemo 16) and the new [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-18)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>SuperMemoHelp</name></author>
	</entry>
	<entry>
		<id>https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=10534&amp;oldid=prev</id>
		<title>SuperMemoHelp at 19:37, 12 April 2019</title>
		<link rel="alternate" type="text/html" href="https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=10534&amp;oldid=prev"/>
		<updated>2019-04-12T19:37:26Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 15:37, 12 April 2019&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:[[File:&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Daily Algorithm SM-17 performance metric&lt;/del&gt;.jpg|thumb|SuperMemo 18 performance metric]]absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 18?|SuperMemo 18]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [https://supermemo.guru/wiki/Algorithm_SM-15 Algorithm SM-15] (known from SuperMemo 16) and the new [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-18)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:[[File:&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Recall_metric&lt;/ins&gt;.jpg|thumb|SuperMemo 18 performance metric]]absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 18?|SuperMemo 18]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [https://supermemo.guru/wiki/Algorithm_SM-15 Algorithm SM-15] (known from SuperMemo 16) and the new [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-18)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>SuperMemoHelp</name></author>
	</entry>
	<entry>
		<id>https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=10533&amp;oldid=prev</id>
		<title>SuperMemoHelp at 19:36, 12 April 2019</title>
		<link rel="alternate" type="text/html" href="https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=10533&amp;oldid=prev"/>
		<updated>2019-04-12T19:36:51Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 15:36, 12 April 2019&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 18?|SuperMemo 18]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [https://supermemo.guru/wiki/Algorithm_SM-15 Algorithm SM-15] (known from SuperMemo 16) and the new [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-18)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|thumb|SuperMemo 18 performance metric]]&lt;/ins&gt;absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 18?|SuperMemo 18]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [https://supermemo.guru/wiki/Algorithm_SM-15 Algorithm SM-15] (known from SuperMemo 16) and the new [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-18)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [https://supermemo.guru/wiki/Algorithm_SM-18 Algorithm SM-18], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt; &lt;/div&gt;&lt;/td&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-side-added&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|center|SuperMemo 18 performance metric]]&lt;/del&gt;&lt;/div&gt;&lt;/td&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-side-added&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>SuperMemoHelp</name></author>
	</entry>
	<entry>
		<id>https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=10432&amp;oldid=prev</id>
		<title>SuperMemoHelp at 07:36, 3 April 2019</title>
		<link rel="alternate" type="text/html" href="https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=10432&amp;oldid=prev"/>
		<updated>2019-04-03T07:36:55Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 03:36, 3 April 2019&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17&lt;/del&gt;?|SuperMemo &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17&lt;/del&gt;]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [https://supermemo.guru/wiki/Algorithm_SM-15 Algorithm SM-15] (known from SuperMemo 16) and the new [https://supermemo.guru/wiki/Algorithm_SM-&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17 &lt;/del&gt;Algorithm SM-&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17&lt;/del&gt;]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17&lt;/del&gt;)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [https://supermemo.guru/wiki/Algorithm_SM-&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17 &lt;/del&gt;Algorithm SM-&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17&lt;/del&gt;]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [https://supermemo.guru/wiki/Algorithm_SM-&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17 &lt;/del&gt;Algorithm SM-&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17&lt;/del&gt;], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;18&lt;/ins&gt;?|SuperMemo &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;18&lt;/ins&gt;]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [https://supermemo.guru/wiki/Algorithm_SM-15 Algorithm SM-15] (known from SuperMemo 16) and the new [https://supermemo.guru/wiki/Algorithm_SM-&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;18 &lt;/ins&gt;Algorithm SM-&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;18&lt;/ins&gt;]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;18&lt;/ins&gt;)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [https://supermemo.guru/wiki/Algorithm_SM-&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;18 &lt;/ins&gt;Algorithm SM-&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;18&lt;/ins&gt;]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [https://supermemo.guru/wiki/Algorithm_SM-&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;18 &lt;/ins&gt;Algorithm SM-&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;18&lt;/ins&gt;], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|center|SuperMemo &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17 &lt;/del&gt;performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|center|SuperMemo &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;18 &lt;/ins&gt;performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>SuperMemoHelp</name></author>
	</entry>
	<entry>
		<id>https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9997&amp;oldid=prev</id>
		<title>SuperMemoHelp at 09:54, 6 March 2019</title>
		<link rel="alternate" type="text/html" href="https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9997&amp;oldid=prev"/>
		<updated>2019-03-06T09:54:55Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 05:54, 6 March 2019&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 17?|SuperMemo 17]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [https://supermemo.guru/wiki/Algorithm_SM-15 Algorithm SM-15] (known from SuperMemo 16) and the new [&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;[SuperMemo Algorithm|&lt;/del&gt;Algorithm SM-17&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;]&lt;/del&gt;]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-17)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;[SuperMemo Algorithm|&lt;/del&gt;Algorithm SM-17&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;]&lt;/del&gt;]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;[SuperMemo Algorithm|&lt;/del&gt;Algorithm SM-17&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;]&lt;/del&gt;], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 17?|SuperMemo 17]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [https://supermemo.guru/wiki/Algorithm_SM-15 Algorithm SM-15] (known from SuperMemo 16) and the new [&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;https://supermemo.guru/wiki/Algorithm_SM-17 &lt;/ins&gt;Algorithm SM-17]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-17)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;https://supermemo.guru/wiki/Algorithm_SM-17 &lt;/ins&gt;Algorithm SM-17]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;https://supermemo.guru/wiki/Algorithm_SM-17 &lt;/ins&gt;Algorithm SM-17], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|center|SuperMemo 17 performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|center|SuperMemo 17 performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>SuperMemoHelp</name></author>
	</entry>
	<entry>
		<id>https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9955&amp;oldid=prev</id>
		<title>SuperMemoHelp at 11:46, 4 March 2019</title>
		<link rel="alternate" type="text/html" href="https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9955&amp;oldid=prev"/>
		<updated>2019-03-04T11:46:01Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 07:46, 4 March 2019&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 17?|SuperMemo 17]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;[SuperMemo Algorithm SM&lt;/del&gt;-15&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;|&lt;/del&gt;Algorithm SM-15&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;]&lt;/del&gt;] (known from SuperMemo 16) and the new [[SuperMemo Algorithm|Algorithm SM-17]]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-17)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [[SuperMemo Algorithm|Algorithm SM-17]]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [[SuperMemo Algorithm|Algorithm SM-17]], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 17?|SuperMemo 17]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;https://supermemo.guru/wiki/Algorithm_SM&lt;/ins&gt;-15 Algorithm SM-15] (known from SuperMemo 16) and the new [[SuperMemo Algorithm|Algorithm SM-17]]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Toolkit menu|Toolkit]] : [[Toolkit menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-17)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [[SuperMemo Algorithm|Algorithm SM-17]]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [[SuperMemo Algorithm|Algorithm SM-17]], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|center|SuperMemo 17 performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|center|SuperMemo 17 performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>SuperMemoHelp</name></author>
	</entry>
	<entry>
		<id>https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9935&amp;oldid=prev</id>
		<title>SuperMemoHelp: Tools -&gt; Toolkit</title>
		<link rel="alternate" type="text/html" href="https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9935&amp;oldid=prev"/>
		<updated>2019-03-03T10:13:08Z</updated>

		<summary type="html">&lt;p&gt;Tools -&amp;gt; Toolkit&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 06:13, 3 March 2019&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 17?|SuperMemo 17]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [[SuperMemo Algorithm SM-15|Algorithm SM-15]] (known from SuperMemo 16) and the new [[SuperMemo Algorithm|Algorithm SM-17]]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Tools &lt;/del&gt;menu|&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Tools&lt;/del&gt;]] : [[&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Tools &lt;/del&gt;menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-17)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [[SuperMemo Algorithm|Algorithm SM-17]]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [[SuperMemo Algorithm|Algorithm SM-17]], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 17?|SuperMemo 17]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [[SuperMemo Algorithm SM-15|Algorithm SM-15]] (known from SuperMemo 16) and the new [[SuperMemo Algorithm|Algorithm SM-17]]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Toolkit &lt;/ins&gt;menu|&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Toolkit&lt;/ins&gt;]] : [[&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Toolkit &lt;/ins&gt;menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-15)-LSRM(Alg-17)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [[SuperMemo Algorithm|Algorithm SM-17]]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [[SuperMemo Algorithm|Algorithm SM-17]], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|center|SuperMemo 17 performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|center|SuperMemo 17 performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>SuperMemoHelp</name></author>
	</entry>
	<entry>
		<id>https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9711&amp;oldid=prev</id>
		<title>SuperMemoHelp at 00:16, 23 May 2017</title>
		<link rel="alternate" type="text/html" href="https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9711&amp;oldid=prev"/>
		<updated>2017-05-23T00:16:40Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 20:16, 22 May 2017&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 17?|SuperMemo 17]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [[SuperMemo Algorithm SM-15|Algorithm SM-15]] (known from SuperMemo 16) and the new [[SuperMemo Algorithm|Algorithm SM-17]]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Tools menu|Tools]] : [[Tools menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17&lt;/del&gt;)-LSRM(Alg-&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;15&lt;/del&gt;)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [[SuperMemo Algorithm|Algorithm SM-17]]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [[SuperMemo Algorithm|Algorithm SM-17]], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&#039;s new in SuperMemo 17?|SuperMemo 17]], &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is used solely to compare [[SuperMemo Algorithm SM-15|Algorithm SM-15]] (known from SuperMemo 16) and the new [[SuperMemo Algorithm|Algorithm SM-17]]. It is shown as percentage in &#039;&#039;&#039;Statistics&#039;&#039;&#039; and &#039;&#039;&#039;[[Tools menu|Tools]] : [[Tools menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&#039;&#039;&#039;. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;15&lt;/ins&gt;)-LSRM(Alg-&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;17&lt;/ins&gt;)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; greater than zero shows superiority of [[SuperMemo Algorithm|Algorithm SM-17]]. &#039;&#039;&#039;R-Metric&#039;&#039;&#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [[SuperMemo Algorithm|Algorithm SM-17]], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|center|SuperMemo 17 performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|center|SuperMemo 17 performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>SuperMemoHelp</name></author>
	</entry>
	<entry>
		<id>https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9461&amp;oldid=prev</id>
		<title>SuperMemoHelp at 22:14, 18 June 2016</title>
		<link rel="alternate" type="text/html" href="https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9461&amp;oldid=prev"/>
		<updated>2016-06-18T22:14:52Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 18:14, 18 June 2016&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l2&quot;&gt;Line 2:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 2:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&amp;#039;s new in SuperMemo 17?|SuperMemo 17]], &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; is used solely to compare [[SuperMemo Algorithm SM-15|Algorithm SM-15]] (known from SuperMemo 16) and the new [[SuperMemo Algorithm|Algorithm SM-17]]. It is shown as percentage in &amp;#039;&amp;#039;&amp;#039;Statistics&amp;#039;&amp;#039;&amp;#039; and &amp;#039;&amp;#039;&amp;#039;[[Tools menu|Tools]] : [[Tools menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&amp;#039;&amp;#039;&amp;#039;. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-17)-LSRM(Alg-15)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; greater than zero shows superiority of [[SuperMemo Algorithm|Algorithm SM-17]]. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [[SuperMemo Algorithm|Algorithm SM-17]], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&amp;#039;s new in SuperMemo 17?|SuperMemo 17]], &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; is used solely to compare [[SuperMemo Algorithm SM-15|Algorithm SM-15]] (known from SuperMemo 16) and the new [[SuperMemo Algorithm|Algorithm SM-17]]. It is shown as percentage in &amp;#039;&amp;#039;&amp;#039;Statistics&amp;#039;&amp;#039;&amp;#039; and &amp;#039;&amp;#039;&amp;#039;[[Tools menu|Tools]] : [[Tools menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&amp;#039;&amp;#039;&amp;#039;. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-17)-LSRM(Alg-15)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; greater than zero shows superiority of [[SuperMemo Algorithm|Algorithm SM-17]]. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [[SuperMemo Algorithm|Algorithm SM-17]], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;br&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Example:&lt;/del&gt;&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;center&lt;/ins&gt;|SuperMemo 17 performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt; &lt;/div&gt;&lt;/td&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-side-added&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;left&lt;/del&gt;|SuperMemo 17 performance metric]]&lt;/div&gt;&lt;/td&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-side-added&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>SuperMemoHelp</name></author>
	</entry>
	<entry>
		<id>https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9460&amp;oldid=prev</id>
		<title>SuperMemoHelp at 22:10, 18 June 2016</title>
		<link rel="alternate" type="text/html" href="https://help18.whiz.me/index.php?title=Glossary:R-Metric&amp;diff=9460&amp;oldid=prev"/>
		<updated>2016-06-18T22:10:54Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 18:10, 18 June 2016&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;;&amp;lt;span id=&amp;quot;R-Metric&amp;quot;&amp;gt;R-Metric&amp;lt;/span&amp;gt; (Recall Metric)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&amp;#039;s new in SuperMemo 17?|SuperMemo 17]], &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; is used solely to compare [[SuperMemo Algorithm SM-15|Algorithm SM-15]] (known from SuperMemo 16) and the new [[SuperMemo Algorithm|Algorithm SM-17]]. It is shown as percentage in &amp;#039;&amp;#039;&amp;#039;Statistics&amp;#039;&amp;#039;&amp;#039; and &amp;#039;&amp;#039;&amp;#039;[[Tools menu|Tools]] : [[Tools menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&amp;#039;&amp;#039;&amp;#039;. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-17)-LSRM(Alg-15)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; greater than zero shows superiority of [[SuperMemo Algorithm|Algorithm SM-17]]. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [[SuperMemo Algorithm|Algorithm SM-17]], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot;&gt;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;:absolute measure of performance of two [[Glossary:Spaced_repetition|spaced repetition]] algorithms based on their ability to predict recall before a [[Glossary:Grade|grade]] is scored. In [[What&amp;#039;s new in SuperMemo 17?|SuperMemo 17]], &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; is used solely to compare [[SuperMemo Algorithm SM-15|Algorithm SM-15]] (known from SuperMemo 16) and the new [[SuperMemo Algorithm|Algorithm SM-17]]. It is shown as percentage in &amp;#039;&amp;#039;&amp;#039;Statistics&amp;#039;&amp;#039;&amp;#039; and &amp;#039;&amp;#039;&amp;#039;[[Tools menu|Tools]] : [[Tools menu#Statistics|Statistics]] : [[Analysis]] : [[Analysis#Use|Use]] : Efficiency : [[Analysis#Use_:_Efficiency_:_R-Metric|R-Metric]]&amp;#039;&amp;#039;&amp;#039;. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; is a difference between the performance of the two algorithms: &amp;lt;code&amp;gt;R-Metric=LSRM(Alg-17)-LSRM(Alg-15)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is the least squares predicted recall measure for a given algorithm. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; greater than zero shows superiority of [[SuperMemo Algorithm|Algorithm SM-17]]. &amp;#039;&amp;#039;&amp;#039;R-Metric&amp;#039;&amp;#039;&amp;#039; less than zero indicates underperformance of the new algorithm. &amp;lt;code&amp;gt;LSRM&amp;lt;/code&amp;gt; is a square root of the average of squared absolute differences in recall predictions: &amp;lt;code&amp;gt;abs(Recall-PredictedRecall)&amp;lt;/code&amp;gt;, where &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 0 for failing [[Glossary:Grade|grades]] and &amp;lt;code&amp;gt;Recall&amp;lt;/code&amp;gt; is 1 for passing grades. &amp;lt;code&amp;gt;PredictedRecall&amp;lt;/code&amp;gt; is a prediction issued by the algorithm before the [[Glossary:Repetition|repetition]]. In [[SuperMemo Algorithm|Algorithm SM-17]], the prediction is a weighted average of the value taken from the [[Glossary:Recall_matrix|Recall[] matrix]], and [[Glossary:Retrievability|R (retrievability)]] computed from [[Glossary:Stability|S (stability)]] and the used [[Glossary:Interval|interval]]. The weight used is based on prior repetition cases which inform of the significance of the Recall[] matrix prediction (the prediction becomes more meaningful with more prior repetition data)&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-side-deleted&quot;&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-side-deleted&quot;&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Example:&lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-side-deleted&quot;&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-side-deleted&quot;&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;[[File:Daily Algorithm SM-17 performance metric.jpg|100px|thumb|left|SuperMemo 17 performance metric]]&lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>SuperMemoHelp</name></author>
	</entry>
</feed>