Tuesday, November 23, 2010

BCS Week- BCS Computers

As part of it's rankings the BCS includes 6 computer rankings (all without margin of victory). Here's a breakdown of all 6, with some thoughts on they're accuracy. For those of you looking for dirt on the BCS, look at the last 3.

Sagarin Elo Ratings
Jeff Sagarin is THE big name in sports rankings systems, and without including him the BCS would be making a serious mistake. His Elo system is not his primary ranking, but it is the one that fits BCS requirements (the other is predictive). The Elo system is based off the rankings used by chess players, which has worked well over the years, but he doesn't give details.

Peter Wolfe's Ratings
Peter Wolfe is another big name, and he also has some very good rankings. His are probably the most mathematically sound, he uses the Bradley-Terry method to find the ratings that maximize the probability that the results of the real world happened. It's a great basis, but the one problem is that under that method all undefeated teams should have infinitely high ratings. Since this doesn't happen he presumably includes some limiting factor, but it's likely sort of arbitrary, reducing the mathematical rigorousness.

Ken Massey Ratings
Ken Massey doesn't give many details on his BCS ranking system, but it gives good results and his other ratings are documented as being mathematically solid. I'm guessing actually that his ratings are similar to mine, but I'm not sure. Even if they stunk though he'd deserve to be included for all his contributions to the rating community.

Anderson Hester Ratings
There is very little description for these ratings, but from what there is I see two problems.
1. They only include opponents record and opponents opponents record. This does not look deep enough into strength of schedule, and over rewards teams in weaker conferences (all conferences will have roughly .500 for both records, regardless of strength).
2. They include a conference rating as part of strength of schedule. Should New Mexico's losses reflect negatively on playing TCU? I don't think so.
Fortunately for the AH ratings the two flaws kind of cancel each other out. There are still better ways to rank teams though.

Colley Matrix Ratings
The Colley Matrix Ratings are great because they are mathematically sound and he even gives details on how the ratings work. They are not so good though, because they don't rank teams very well. He uses FBS games (and FCS vs FBS games in a weird way) only, but I've programmed his system and here's how the top 10 looks with all 730 teams:
1. Auburn
2. LSU
3. TCU
4. North Central
5. Boise St
6. Oregon
7. Stanford
8. St Thomas
9. Missouri
10. Wesley
Not only is LSU now ahead of TCU, but there are suddenly teams from other divisions like D3 St. Thomas up there. Does North Central deserve to be there? No, and this flaw severely limits the Colley Matrix method.

Richard Billingsly Rankings
Billingsly's rankings are by his own admission the least mathematically complex of the BCS rankings. They were also created through a process of his own tinkering. While it's neat that he was able to just mess with the games until it works, that involves way too much personal bias to be a part of deciding the national championship. The other, more glaring problem is that he uses the previous year's final rankings as part of his formula. While it's true that teams don't change too much between years, each season should be completely separate if you're evaluating the national champion of that year. He admits that the preseason rankings have an effect on undefeated teams. In week 8 of the BCS this year Missouri averaged 6th in the computer polls and was in the top 10 in all but Billingsley's, where they were unranked because they didn't play well last season. A system like that definitely should not be a part of the BCS.

So 3 systems (Anderson/Hester, Colley, Billingsly) should not be included in the BCS, who replaces them? Here are three of my favorites:
Pugh Ratings- These have great math behind them, and the work too.
Doktor Entropy Ratings-These are commonly cited as a good set of rankings, although they'd have to be adjusted to join the BCS.
Random Walker Rankings-Randomly ranking monkeys is a cool premise, with some neat theory behind it.

17 comments:

  1. It's amazing in favor of me to have a web site, which is good designed for my experience. thanks admin
    Stop by my blog post :: festival tent

    ReplyDelete
  2. I've been surfing online more than 3 hours today, yet I never found any interesting article like yours. It is pretty worth enough for me. In my view, if all webmasters and bloggers made good content as you did, the net will be much more useful than ever before.
    Here is my web site AV

    ReplyDelete
  3. Pretty nice post. I just stumbled upon your weblog
    and wished to say that I have truly enjoyed surfing around your weblog posts.
    After all I'll be subscribing for your feed and I am hoping you write again soon!
    my site :: click the following page

    ReplyDelete
  4. Hey there just wanted to give you a quick heads up and let you
    know a few of the pictures aren't loading correctly. I'm not sure why but I think
    its a linking issue. I've tried it in two different web browsers and both show the same results.
    Visit my web-site ; click the next page

    ReplyDelete
  5. This post offers clear idea for the new visitors of blogging, that truly
    how to do blogging.
    my webpage: superyacht seo

    ReplyDelete
  6. Hi there, its fastidious paragraph about media print, we all know media
    is a fantastic source of information.

    Feel free to surf to my web page :: new releases
    My web page :: new releases,dvd,blu-ray,movies,tv shows

    ReplyDelete
  7. Every weekend i used to pay a visit this web page, because i
    want enjoyment, since this this site conations really good
    funny data too.

    Here is my web page - Shabby Chic Moebel Karlsruhe

    ReplyDelete
  8. When someone writes an paragraph he/she maintains the thought of a user in his/her brain that how a user can know it.
    Thus that's why this piece of writing is perfect. Thanks!

    Feel free to surf to my website: gracie st sugustine

    ReplyDelete
  9. Hurrah, that's what I was looking for, what a data! present here at this blog, thanks admin of this web site.

    Here is my blog - Diablo III
    my page: Diablo 3

    ReplyDelete
  10. This is the right blog for anybody who hopes to understand this topic.

    You understand a whole lot its almost hard to argue with you (not
    that I personally would want to…HaHa). You definitely put a new spin on a topic that has been written about for years.
    Great stuff, just excellent!

    My page Teen Porn

    ReplyDelete
  11. I just could not leave your web site prior to suggesting that I extremely loved the standard information an individual
    supply for your visitors? Is gonna be again ceaselessly in order to check out
    new posts

    my site; www.cuteteenporn.net

    ReplyDelete
  12. I have read so many posts about the blogger lovers however this piece of
    writing is genuinely a nice piece of writing,
    keep it up.

    my homepage http://www.wildpartygirls.org

    ReplyDelete
  13. For most recent information you have to pay a visit world-wide-web
    and on world-wide-web I found this site as a most excellent web page for most recent
    updates.

    Stop by my web site: xxx-fuck.net

    ReplyDelete
  14. Please let me know if you're looking for a writer for your blog. You have some really good articles and I feel I would be a good asset. If you ever want to take some of the load off, I'd absolutely love to write some content for your blog in exchange for a
    link back to mine. Please blast me an email if interested.
    Thank you!

    Also visit my webpage; cuteteenporn.net

    ReplyDelete
  15. Peculiar article, totally what I was looking for.


    my web blog; http://www.xxxmoviegalls.com

    ReplyDelete
  16. Hello! I just wanted to ask if you ever have any
    problems with hackers? My last blog (wordpress) was hacked and I ended up losing a few months of hard work due to no back up.
    Do you have any solutions to protect against hackers?


    My web page; hotgirlsexcam.com

    ReplyDelete
  17. Write more, thats all I have to say. Literally, it seems as though you relied on the video
    to make your point. You clearly know what youre talking
    about, why waste your intelligence on just posting videos to your blog when you could
    be giving us something informative to read?


    Have a look at my site ... webcam sex videos

    ReplyDelete