How We Test

By Joey Shadeck | March 11th, 2021

Our mission at Moneyline.com is simple: provide thorough and unbiased reviews of online sportsbooks.

For the Moneyline.com 2021 Online Sportsbook Review published in March 2021, hundreds of data points were collected over six months and used to score sportsbooks. For odds data, odds from hundreds of games were collected for six different leagues, which means well over 850 separate games were used in the odds ranking category. We use weighted rankings to rank spread, moneyline, and total bets. With over 34,000 total data points for odds, Moneyline boasts the most transparent coverage of how good a sportsbooks odds are.

We take pride in our Moneyline.com data quality and will be attempting to verify all variables with each sportsbook as we grow, ensuring the highest quality for our site.

Testing Devices

All testing is conducted on the devices listed below, using a hardwired, 50 MB Internet connection. Mobile device testing is conducted using an 802.11n wireless WiFi connection; 4G connections are used when WiFi is not available. Unless noted, all websites and web-based platforms are tested using the latest version of the Google Chrome browser.

Desktop: Six ASUS 24″ LED Monitors, Intel Core i7-3770 Processor, 8 GB Corsair Vengeance DDR3 1600 MHz memory, 2 AMD Radeon HD 7770 video cards, and a 120 GB ADATA S510 SSD Hard Drive. Windows 10 operating system.

Tablet: iPad Air 2 with the most current iOS. Safari Browser.

Smartphone: iPhone 7 with the most current iOS. Safari Browser.

How We Test Moneyline

Review Categories, Variables

For the Moneyline.com 2021 Online Sportsbook Review, all sportsbooks were assessed on 120 different variables across 8 core areas: Sports and Bets Offered, Odds, Live Betting, Mobile Betting, Bonuses and Promotions, Education, Ease of Use, and Overall.

The variable counts of each category were as follows: 

Review Category Variables
Sports and Bets Offered 70
Odds 12
Live Betting 26
Mobile Betting 23
Bonuses and Promotions 4
Education 6
Ease of Use 1


Overall Score Calculation

All main categories are factored in to compile the Overall ranking for each broker. The weightings of each category were as follows: 

Review Category Weighting
Sports and Bets Offered 22.5%
Odds 10%
Live Betting 10%
Mobile Betting 20%
Education 5%
Bonuses and Promotions 22.5%
Ease of Use 10%


Awards

Moneyline.com awarded“Best in Class” awards to sportsbooks across all eight core categories. A “Best in Class” designation means finishing in the top seven sportsbooks for that category.

The following individual Industry awards were also distributed:

  • #1 Sportsbook Community - Barstool Sportsbook
  • #1 Unique Bet Type - PointsBet
  • #1 Best Pre-Game Statistics - DraftKings
  • #1 Blog - TheDuel (FanDuel)
  • #1 Welcome Bonus - PointsBet
  • #1 Web Trading Platform
  • #1 Free to Play Contests - DraftKings
  • #1 Live Betting Contest - PlayAction (FanDuel)
  • #1 Education Center - 888sport
  • Best Moneyline Odds - Caesars
  • Best Spread Odds - William Hill
  • Best Total Odds - FOX Bet
  • Most Online Slots Golden Nugget

Category Scoring Methodology

While most categories are scored using our default method of combining Yes / No points (Variable score) with a 1 - 10 Net Promoter Score (Opinion score), scoring does vary, as shown below.

  • Sports and Bets Offered - Yes/No with Opinion
  • Odds - Custom
  • Live Betting - Yes/No with Opinion
  • Mobile Betting - Yes/No with Opinion
  • Bonuses & Promotions - Opinion only
  • Education - Yes/No with Opinion
  • Ease of Use - Opinion only

Each individual category score is also translated into a star rating. Specifically:

  • 95% - 100% = 5 Stars
  • 85% - 94.99% = 4.5 Stars
  • 75% - 84.99% = 4 Stars
  • 65% - 74.99% = 3.5 Stars
  • 55% - 64.99% = 3 Stars
  • 45% - 54.99% = 2.5 Stars
  • 35% - 44.99% = 2 Stars
  • 25% - 34.99% = 1.5 Stars
  • 15% - 24.99% = 1 Stars
  • 5% - 14.99% = 0.5 Stars
  • 0% - 4.99% = 0 Stars

How We Score: Yes/No with Opinion

First, points are awarded for each “Yes” answer. The number of points awarded depends on the variable. Next, the total points earned from “Yes” answers is then divided by the total points possible to calculate a final Yes/No score.

To determine a final score for the category, this Yes/No score is then combined with an opinion score (1 – 10, with one being “very bad” and ten being “very good”). The weighting of the Yes/No score compared to the opinion score varies for each category. For example, 70% Yes/No, 30% Opinion.

Categories assessed in this manner include Sports and Bets Offered, Odds, Live Betting, Mobile Betting, Education, Bonuses and Promotions, and Ease of Use. Note, Odds do not incorporate an opinion score. Also, in assessing Ease of Use, sportsbooks are assessed on a 100% opinion weighted score.


How We Score: Custom

Scoring Odds requires separate custom formulas due to complexity.

Data from more than 1,700 bets (including moneyline, spread and total bets) was used to generate each sportsbook’s comparative odds ranking. Leagues and bet types collected include NCAA football moneyline bets, NCAA basketball moneyline bets, NFL moneyline, spread and total bets, NBA spread, moneyline and total bets, NHL moneyline, puckline and total bets, and soccer 3-way result (moneyline) bets. When collecting odds, we made sure to collect the same games at the same time for each sportsbook, ensuring data accuracy.

arrow_drop_upBack to top