THE BOOK cover
The Unwritten Book
is Finally Written!

Read Excerpts & Reviews
E-Book available
as Amazon Kindle or
at iTunes for $9.99.

Hardcopy available at Amazon
SABR101 required reading if you enter this site. Check out the Sabermetric Wiki. And interesting baseball books.
Shop Amazon & Support This Blog
RECENT FORUM TOPICS
Jul 12 15:22 Marcels
Apr 16 14:31 Pitch Count Estimators
Mar 12 16:30 Appendix to THE BOOK - THE GORY DETAILS
Jan 29 09:41 NFL Overtime Idea
Jan 22 14:48 Weighting Years for NFL Player Projections
Jan 21 09:18 positional runs in pythagenpat
Oct 20 15:57 DRS: FG vs. BB-Ref

Advanced

Tangotiger Blog

<< Back to main

Monday, November 16, 2015

Different estimates of player performance

By Tangotiger 07:44 PM

?There's different ways to measure the inflation rate, the unemployment rate.  There's also different ways to measure player performance.  This is a good thing, as long as most estimates are "similar".  As a whole, are these similar enough?  You tell me.


#1    Bobby Mueller 2015/11/17 (Tue) @ 23:42

I understand why there are differences in WAR between Baseball-Reference and Fangraphs, but I would prefer they not have differences as large as three wins, as in the case of Drew Hutchison, Andrew Cashner, and Chris Sale, three pitchers mentioned in the article.

An extreme example for this year is Zack Greinke versus Chris Sale. According to bWAR, Greinke was a nine-win pitcher (9.3 bWAR) and Sale was at 3.3 bWAR. That’s a huge difference. According to fWAR, Sale provided more value with 6.2 fWAR to Greinke’s 5.9.

Greinke pitched 222.7 innings with a 1.66 ERA and 2.76 FIP.
Sale pitched 208.7 innings with a 3.41 ERA and 2.73 FIP.

I understand that bWAR is based on actual runs allowed and fWAR is based on FIP and I can keep that in mind when I look at their numbers, but it is difficult to get people who are just getting interested in a more analytical look at baseball to understand this.


#2    MGL 2015/11/18 (Wed) @ 05:46

Unfortunately (or fortunately, or neither), there are many ways to look at and evaluate past performance and call it “wins”. That is especially true with pitchers.

When you use one or two words to try and describe or quantify something that requires many words, you often run into this problem. Not unlike the “skill” and “luck” dichotomy we are discussing on the DFS threads.


#3    Tangotiger 2015/11/18 (Wed) @ 08:23

I agree with MGL, as it’s both fortunate and unfortunate.

It simply shows that, given the data being used, we are acknowledging the uncertainty present.  Just because Greinke has a low BABIP doesn’t mean that Greinke has a low BABIP: it means the DODGERS WITH GREINKE have a low BABIP.  How much that is the fielders and how much that is the pitcher is up for grabs.

Similarly, BABIP with men on base would need to be split.  Do we know how well the Dodgers fielders actually played with Greinke?  How about when the RF throws out a runner at home?  Well, guess what, rWAR says that Greinke did that, while fWAR says he didn’t.

Therefore, we should be grateful that Fangraphs and Baseball Reference have taken such polar opposite views, since the truth MUST be somewhere in the middle.  But if one or both move too much in the other direction, they may go past the middle!

So, if they are too close, it’s going to be worse. 

Just split the two in half, and move on.


#4    Bobby Mueller 2015/11/19 (Thu) @ 04:37

Tango, that’s a good way of explaining it, that the truth must be somewhere in the middle between Fangraphs and B-R. I was looking at the AL Cy Young Award and the different WARs for the top six pitchers:

7.2 bWAR, 6.1 fWAR, 6.7 combinedWAR—Keuchel
6.0 bWAR, 6.4 fWAR, 6.2 combinedWAR—Price
4.2 bWAR, 5.5 fWAR, 4.9 combinedWAR—Kluber
5.8 bWAR, 3.8 fWAR, 4.8 combinedWAR—Gray
4.3 bWAR, 5.3 fWAR, 4.8 combinedWAR—Archer
3.3 bWAR, 6.2 fWAR, 4.8 combinedWAR—Sale

I mentioned in the top post how Gray and Sale were valued so differently by the two versions of WAR, but it’s also interesting to look at Archer and Gray. If you split the difference between bWAR and fWAR, they were equal. The numbers the voters like to see, wins and ERA, both favor Gray, while Archer had four more innings pitched and many more strikeouts. Gray finished 3rd and Archer was 5th in the voting. Sale snuck in there at 4th with one more win than Archer, one less win than Gray, and a higher ERA than both. Kluber was way down the ballot, with just 9 wins and a 3.49 ERA, but with a 4.9 WAR when you split the difference between Fangraphs and B-R, slightly better than Gray, Archer, and Sale.


#5    MGL 2015/11/19 (Thu) @ 17:15

I don’t subscribe to the “truth is somewhere in between” theory. Especially with pitchers. There is no “truth” because there is no way to precisely define what the hell you’re measuring. It’s like all the duscussions we’ve had about MVP awards. There are so many reasonable ways to describe retrospective value. The only thing the various WAR tools have in common are the definition of replacement (which can never be precisely measured) and the runs to wins conversion (and that is approximated).

And then there is the issue of UZR. As we’ve discuses a million times, the “truth” is a regressed version of UZR.

So lots of issues that I don’t think are properly addressed with a “truth is somewhere in between” construct.


Click MY ACCOUNT in top right corner to comment

<< Back to main


Latest...

COMMENTS

Apr 26 22:33
Statcast Lab: Distance/Time Model to Catcher Throwing Out Runners

Apr 23 18:01
Will clubs use a two-outfield alignment?

Apr 16 20:54
Statcast Lab: CS accuracy model

Apr 06 18:58
Strikeouts v other outs

Apr 05 21:07
Rewatching Gibson/Eck, with the Pitch Timer

Mar 24 15:31
Improving WAR - Finding the replacement level

Mar 21 14:42
WPA, RE24 and LI, OR the day Dave Kingman hit 3 HR, had the best game of his life, while costing his team the game

Mar 20 11:02
Are clubs becoming smarter at stealing bases?

Mar 11 16:12
Predictiveness of the Tools of Pitching

Mar 09 15:19
Get ready for stolen bases in 2023

Mar 08 00:00
Statcast Lab: Block Pitches Model for Catchers

Mar 07 16:19
Improving WAR - Alternative to WPA

Mar 06 16:13
Improving WAR - Synchronicity of Scoring Runs

Mar 03 12:06
Improving WAR: Leveraged Innings

Mar 02 00:35
Time shifting Front Offices

Feb 27 11:09
Improving WAR - Determining extent to link Game by Game Wins to Player Performance

Feb 24 20:21
Who is the most fun player in MLB, outside of Ohtani?

Feb 21 13:11
Improving WAR - Individualized Won-Loss Records

Feb 20 21:56
RE24 2012-2022: Run Expectancy, Chance of Scoring, Opportunities

Feb 17 13:44
Lies, Damned Lies, and Batting Average