<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Evaluating the Player Evaluators, Part III (Razzball and RotoTimes)</title>
	<atom:link href="http://www.lastplayerpicked.com/evaluating-the-player-evaluators-part-iii-razzball-and-rototimes/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.lastplayerpicked.com/evaluating-the-player-evaluators-part-iii-razzball-and-rototimes/</link>
	<description>Fantasy Baseball Dollar Values, Rankings, and Discussion</description>
	<lastBuildDate>Thu, 09 Feb 2012 00:33:28 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3.1</generator>
	<item>
		<title>By: Rudy Gamble</title>
		<link>http://www.lastplayerpicked.com/evaluating-the-player-evaluators-part-iii-razzball-and-rototimes/#comment-36</link>
		<dc:creator>Rudy Gamble</dc:creator>
		<pubDate>Thu, 15 Jan 2009 14:04:15 +0000</pubDate>
		<guid isPermaLink="false">http://www.lastplayerpicked.com/?p=59#comment-36</guid>
		<description>Thanks Mays.  I think if you enforce minimums of 5 SP per team that you&#039;ll find things get much closer.  Pitching is different than hitting in that you&#039;ve got 2 ratio stats to 1 and there&#039;s less correlation b/w the ratio/counting stats for pitchers than hitters b/c of middle/late relievers - i.e., if the Razzball Point Shares ends up &#039;punting&#039; catchers, it&#039;s not like there&#039;s a catcher in the 20th round who is going to be positive in two categories like Geoff Geary (who was probably owned by 0.1% of all teams last year).

I&#039;m less worried about 2 catchers b/c I think your system values them higher anyway so the Razzball teams wouldn&#039;t pick them.  Might have some impact against the other teams.</description>
		<content:encoded><![CDATA[<p>Thanks Mays.  I think if you enforce minimums of 5 SP per team that you&#8217;ll find things get much closer.  Pitching is different than hitting in that you&#8217;ve got 2 ratio stats to 1 and there&#8217;s less correlation b/w the ratio/counting stats for pitchers than hitters b/c of middle/late relievers &#8211; i.e., if the Razzball Point Shares ends up &#8216;punting&#8217; catchers, it&#8217;s not like there&#8217;s a catcher in the 20th round who is going to be positive in two categories like Geoff Geary (who was probably owned by 0.1% of all teams last year).</p>
<p>I&#8217;m less worried about 2 catchers b/c I think your system values them higher anyway so the Razzball teams wouldn&#8217;t pick them.  Might have some impact against the other teams.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Mays</title>
		<link>http://www.lastplayerpicked.com/evaluating-the-player-evaluators-part-iii-razzball-and-rototimes/#comment-35</link>
		<dc:creator>Mays</dc:creator>
		<pubDate>Thu, 15 Jan 2009 04:11:23 +0000</pubDate>
		<guid isPermaLink="false">http://www.lastplayerpicked.com/?p=59#comment-35</guid>
		<description>@Rudy: I appreciate you taking a look at this.  You are right about bias, not to mention that all of this involves a pretty small sample.

I liked the tests you did as well, although I think that ignoring positions makes it harder to draw conclusions.  For my experiments, I really wanted a scenario that was as much as possible a &quot;real&quot; draft.  This seemed like the most fair way to do it.

I&#039;ll run one more simulation with Point Shares to see if I can address some of your concerns.</description>
		<content:encoded><![CDATA[<p>@Rudy: I appreciate you taking a look at this.  You are right about bias, not to mention that all of this involves a pretty small sample.</p>
<p>I liked the tests you did as well, although I think that ignoring positions makes it harder to draw conclusions.  For my experiments, I really wanted a scenario that was as much as possible a &#8220;real&#8221; draft.  This seemed like the most fair way to do it.</p>
<p>I&#8217;ll run one more simulation with Point Shares to see if I can address some of your concerns.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Mays</title>
		<link>http://www.lastplayerpicked.com/evaluating-the-player-evaluators-part-iii-razzball-and-rototimes/#comment-34</link>
		<dc:creator>Mays</dc:creator>
		<pubDate>Thu, 15 Jan 2009 04:02:07 +0000</pubDate>
		<guid isPermaLink="false">http://www.lastplayerpicked.com/?p=59#comment-34</guid>
		<description>@Nick: Wow!  You&#039;ve really been thinking this through!  When I said earlier that the baseline doesn&#039;t matter, I wasn&#039;t thinking about comparing positions, just comparing two players at the same position.

However, you are correct that the baseline will affect how one position relates to another.  The basic idea is that the replacement-level baseline gives the biggest boost to the top players at a scarce position.  An average-player baseline bumps the top-tier less, but also drops the worst players.  (The players closest to average are affected the least.)</description>
		<content:encoded><![CDATA[<p>@Nick: Wow!  You&#8217;ve really been thinking this through!  When I said earlier that the baseline doesn&#8217;t matter, I wasn&#8217;t thinking about comparing positions, just comparing two players at the same position.</p>
<p>However, you are correct that the baseline will affect how one position relates to another.  The basic idea is that the replacement-level baseline gives the biggest boost to the top players at a scarce position.  An average-player baseline bumps the top-tier less, but also drops the worst players.  (The players closest to average are affected the least.)</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Nick</title>
		<link>http://www.lastplayerpicked.com/evaluating-the-player-evaluators-part-iii-razzball-and-rototimes/#comment-30</link>
		<dc:creator>Nick</dc:creator>
		<pubDate>Wed, 14 Jan 2009 22:59:41 +0000</pubDate>
		<guid isPermaLink="false">http://www.lastplayerpicked.com/?p=59#comment-30</guid>
		<description>And for reference, the replacement levels for this league are

C: -6.61
SS: -3.68
2B: -3.60
3B: -2.86
OF: -2.88
1B: -2.46
MI: -3.68
CI: -2.39
Util: -2.88
P: -2.34</description>
		<content:encoded><![CDATA[<p>And for reference, the replacement levels for this league are</p>
<p>C: -6.61<br />
SS: -3.68<br />
2B: -3.60<br />
3B: -2.86<br />
OF: -2.88<br />
1B: -2.46<br />
MI: -3.68<br />
CI: -2.39<br />
Util: -2.88<br />
P: -2.34</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Nick</title>
		<link>http://www.lastplayerpicked.com/evaluating-the-player-evaluators-part-iii-razzball-and-rototimes/#comment-29</link>
		<dc:creator>Nick</dc:creator>
		<pubDate>Wed, 14 Jan 2009 22:58:34 +0000</pubDate>
		<guid isPermaLink="false">http://www.lastplayerpicked.com/?p=59#comment-29</guid>
		<description>Yes, still going with this for some reason...

If, when computing the average above replacement for each position, we include multi-position players in all eligible positions, the positional averages become

C:  -3.71
SS:  -0.46
2B:  -0.28
3B:  0.63
OF:  0.82
1B:  1.57

Pretty similar results, but they&#039;re a bit more tightly bunched and the averages more closely follow the defensive spectrum.

The differences between replacement and average are then

C:  -2.9
SS:  -3.22
2B:  -3.32
3B:  -3.49
OF:  -3.7
1B:  -4.03

I&#039;m not sure which method is &quot;correct.&quot;  Or if it really matters.  But I thought it was better to have some numbers when discussing.</description>
		<content:encoded><![CDATA[<p>Yes, still going with this for some reason&#8230;</p>
<p>If, when computing the average above replacement for each position, we include multi-position players in all eligible positions, the positional averages become</p>
<p>C:  -3.71<br />
SS:  -0.46<br />
2B:  -0.28<br />
3B:  0.63<br />
OF:  0.82<br />
1B:  1.57</p>
<p>Pretty similar results, but they&#8217;re a bit more tightly bunched and the averages more closely follow the defensive spectrum.</p>
<p>The differences between replacement and average are then</p>
<p>C:  -2.9<br />
SS:  -3.22<br />
2B:  -3.32<br />
3B:  -3.49<br />
OF:  -3.7<br />
1B:  -4.03</p>
<p>I&#8217;m not sure which method is &#8220;correct.&#8221;  Or if it really matters.  But I thought it was better to have some numbers when discussing.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Nick</title>
		<link>http://www.lastplayerpicked.com/evaluating-the-player-evaluators-part-iii-razzball-and-rototimes/#comment-28</link>
		<dc:creator>Nick</dc:creator>
		<pubDate>Wed, 14 Jan 2009 19:34:27 +0000</pubDate>
		<guid isPermaLink="false">http://www.lastplayerpicked.com/?p=59#comment-28</guid>
		<description>More regarding using different baselines, as my 4 team NL only league may have been a bit unrealistic...

Using a standard roto league and 2008 stats (same as in this simulation) these are the positional averages that I came up with.

C:  -3.71
SS:  -0.46
2B:  0.13
3B:  0.77
OF:  0.73
1B:  1.73

I did not &quot;double count&quot; players who were eligible for multiple positions when finding the mean.  I arbitrarily assigned them to &quot;most difficult to play&quot; position according to the C, SS, 2B, 3B, OF, 1B spectrum.  I realize that doing this assumes some things we&#039;d rather not assume, but I had to do something.  Also, I didn&#039;t compute averages for CI, MI, and DH cause I was lazy.  When computing the averages (I guess I should say &quot;mean&quot;) I used the cutoff given by the price guide for replacement level as the last player included in the calculation.

Looking at the differences between the replacement baseline and the avg baseline, we get

C:  -2.9
SS:  -3.22
2B:  -3.73
3B:  -3.63
OF:  -3.61
1B:  -4.19

I would conclude from this that since there is not a constant difference between the baselines, it does in fact matter which one we use.  If we adjust the raw scores to be scores above average rather than replacement, we&#039;ll see that the value of top 1B is decreased, while the top SS and C become more valuable.

Again, I think that deciding which position was &quot;more scarce&quot; to begin with may have significantly influenced these results (and for that matter I&#039;m sure I made a math error somewhere), but it certainly does leave me with a lot of questions.</description>
		<content:encoded><![CDATA[<p>More regarding using different baselines, as my 4 team NL only league may have been a bit unrealistic&#8230;</p>
<p>Using a standard roto league and 2008 stats (same as in this simulation) these are the positional averages that I came up with.</p>
<p>C:  -3.71<br />
SS:  -0.46<br />
2B:  0.13<br />
3B:  0.77<br />
OF:  0.73<br />
1B:  1.73</p>
<p>I did not &#8220;double count&#8221; players who were eligible for multiple positions when finding the mean.  I arbitrarily assigned them to &#8220;most difficult to play&#8221; position according to the C, SS, 2B, 3B, OF, 1B spectrum.  I realize that doing this assumes some things we&#8217;d rather not assume, but I had to do something.  Also, I didn&#8217;t compute averages for CI, MI, and DH cause I was lazy.  When computing the averages (I guess I should say &#8220;mean&#8221;) I used the cutoff given by the price guide for replacement level as the last player included in the calculation.</p>
<p>Looking at the differences between the replacement baseline and the avg baseline, we get</p>
<p>C:  -2.9<br />
SS:  -3.22<br />
2B:  -3.73<br />
3B:  -3.63<br />
OF:  -3.61<br />
1B:  -4.19</p>
<p>I would conclude from this that since there is not a constant difference between the baselines, it does in fact matter which one we use.  If we adjust the raw scores to be scores above average rather than replacement, we&#8217;ll see that the value of top 1B is decreased, while the top SS and C become more valuable.</p>
<p>Again, I think that deciding which position was &#8220;more scarce&#8221; to begin with may have significantly influenced these results (and for that matter I&#8217;m sure I made a math error somewhere), but it certainly does leave me with a lot of questions.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Rudy Gamble</title>
		<link>http://www.lastplayerpicked.com/evaluating-the-player-evaluators-part-iii-razzball-and-rototimes/#comment-26</link>
		<dc:creator>Rudy Gamble</dc:creator>
		<pubDate>Wed, 14 Jan 2009 14:05:15 +0000</pubDate>
		<guid isPermaLink="false">http://www.lastplayerpicked.com/?p=59#comment-26</guid>
		<description>Hey Mays -
Interesting test.  Simulated draft tests are difficult to do w/o introducing bias.  When comparing Razzball against ESPN and RotoTimes, I bypassed this in favor of a test to see how well each rater&#039;s &#039;points&#039; per category correlated to reality (http://razzball.com/the-player-rater-rater/).  Razzball did admirably given this type of test ignored player position (which we are the only one of those three to account).

For a 12-team league, our Point Shares assume 1 catcher per team (vs. the 2 in your test) and a 108 pitcher universe of about 67/41 or 66/42 in starters/relievers (5.5 SP/3.5 RP per team).  This netted an average of 1,265 innings per team.

I would argue that creating 4 800 IP teams is an artificial construct.  You&#039;re never going to see a league where 4 teams punt pitcher counting stats.  I&#039;d be interested to see how the test would go if you credited each team a realistic 5 starters and aim for a 1200 IP avg per team.    

I&#039;ve done point shares for 2 Catcher leagues vs 1.  It does bump up Catcher values.  If you want, I can send you Point Shares for a 12-team, 2-catcher league.

Keep up the good work -
Rudy</description>
		<content:encoded><![CDATA[<p>Hey Mays -<br />
Interesting test.  Simulated draft tests are difficult to do w/o introducing bias.  When comparing Razzball against ESPN and RotoTimes, I bypassed this in favor of a test to see how well each rater&#8217;s &#8216;points&#8217; per category correlated to reality (<a href="http://razzball.com/the-player-rater-rater/" rel="nofollow">http://razzball.com/the-player-rater-rater/</a>).  Razzball did admirably given this type of test ignored player position (which we are the only one of those three to account).</p>
<p>For a 12-team league, our Point Shares assume 1 catcher per team (vs. the 2 in your test) and a 108 pitcher universe of about 67/41 or 66/42 in starters/relievers (5.5 SP/3.5 RP per team).  This netted an average of 1,265 innings per team.</p>
<p>I would argue that creating 4 800 IP teams is an artificial construct.  You&#8217;re never going to see a league where 4 teams punt pitcher counting stats.  I&#8217;d be interested to see how the test would go if you credited each team a realistic 5 starters and aim for a 1200 IP avg per team.    </p>
<p>I&#8217;ve done point shares for 2 Catcher leagues vs 1.  It does bump up Catcher values.  If you want, I can send you Point Shares for a 12-team, 2-catcher league.</p>
<p>Keep up the good work -<br />
Rudy</p>
]]></content:encoded>
	</item>
</channel>
</rss>

