Powered by Gartner Methodology

Download FrontRunners Material

Published FrontRunners:
ATS August 2017 http://www.softwareadvice.com/hr/applicant-tracking-software-comparison/#top-products
EMR August 2017 http://www.softwareadvice.com/medical/electronic-medical-record-software-comparison/#top-products
Maintenance Management August 2017 http://www.softwareadvice.com/cmms/#top-products
CRM August 2017 http://www.softwareadvice.com/crm/#top-products
Retail July 2017 http://www.softwareadvice.com/retail/#top-products
Help Desk July 2017 http://www.softwareadvice.com/help-desk/#top-products
LMS July 2017 http://www.softwareadvice.com/lms/#top-products
Construction Project Management July 2017 http://www.softwareadvice.com/construction/project-management-software-comparison/#top-products
Hotel Management June 2017 http://www.softwareadvice.com/hotel-management/#top-products
Manufacturing June 2017 http://www.softwareadvice.com/manufacturing/#top-products
Nonprofit Donor Management June 2017 http://www.softwareadvice.com/nonprofit/fundraising-software-comparison/#top-products
Call Center May 2017 http://www.softwareadvice.com/call-center/#top-products
Construction Estimating May 2017 http://www.softwareadvice.com/construction/cost-estimating-software-comparison/#top-products
Field Service May 2017 http://www.softwareadvice.com/field-service/#top-products
Mental Health May 2017 http://www.softwareadvice.com/medical/mental-health-emr-billing-software-comparison/#top-products
Accounting April 2017 http://www.softwareadvice.com/accounting/#top-products
Business Intelligence April 2017 http://www.softwareadvice.com/bi/#top-products
Enterprise Resource Planning April 2017 http://www.softwareadvice.com/erp/#top-products
Inventory Management April 2017 http://www.softwareadvice.com/inventory-management/#top-products
Project Management March 2017 http://www.softwareadvice.com/project-management/#top-products
HRIS March 2017 http://www.softwareadvice.com/hr/#top-products
Payroll March 2017 http://www.softwareadvice.com/hr/payroll-software-comparison/#top-products
Property Management March 2017 http://www.softwareadvice.com/property/#top-products
Applicant Tracking January 2017 http://www.softwareadvice.com/hr/applicant-tracking-software-comparison/#top-products
FrontRunners Refresh Schedule:
September 2017 November 2017
Project Management Construction Estimating
Property Management Field Service
Inventory Management Call Center
Payroll Mental Health
October 2017 December 2017
ERP Hotel Management
Accounting Manufacturing
Business Intelligence Nonprofit Donor Management
HRIS  

FrontRunners Methodology



The Basics

The FrontRunners methodology assesses and calculates a score for products on two primary dimensions: Capability on the x-axis and Value on the y-axis.

The Capability score is an overall weighted average of scores including:

      1. End-user ratings of one to five stars on the product’s functionality.
      2. End-user ratings of one to five stars on the product’s ease of use.
      3. End-user ratings of one to five stars on the product’s customer support.
      4. A score, relative to other products in the market, for the product's inclusion of key functionality for the software category.
      5. A score, relative to other products in the market, representing the number of other products that integrate with it.

The Value score is an overall weighted average of scores including:

      1. End-user ratings of one to five stars on overall satisfaction with the product.
      2. End-user ratings of one to five stars on how valuable users consider the product to be relative to its price.
      3. End-user ratings of one to five stars on how likely they are to recommend the product to others.
      4. A score, relative to other products in the market, for the size of the product's customer base.
      5. A score, relative to other products in the market, for the number of professionals in the market who have experience with the product (e.g., users, developers, administrators).
      6. A score, relative to other products in the market, representing the total number of user reviews across the three Gartner web properties.
      7. A score, relative to other products in the market, representing the average number of times per month internet users search for the product on Google.

Markets are defined by a core set of functionality, and products considered for, and included in, FrontRunners must offer that core set of functionality. Additional related functionality can contribute to the capability score for a product. To qualify for consideration in a FrontRunners quadrant, a product must have a minimum number of unique, user-submitted product reviews across the three Gartner Digital Markets web properties: softwareadvice.com, capterra.com and getapp.com. The minimum number of reviews required per product may differ by category, but will generally be between 10 and 20 unique reviews.

More Methodology Details

The FrontRunners methodology assesses products on two primary dimensions: Capability on the x-axis and Value on the y-axis. Products receive a score between one and five for each axis. Products that meet a minimum score for each axis are included as FrontRunners. The minimum score cutoff to be included in the FrontRunners graphic varies by category, depending on the range of scores in each category. For products included, the Capability and Value scores determine their positions on the FrontRunners graphic.

FrontRunners Quadrant

The Capability score is based on three criteria: user ratings on capability, a functionality breadth analysis, and a business confidence assessment.

      1. The capability user ratings criterion captures user satisfaction with the product’s capabilities. The capability ratings score is a weighted average of the one- to five- star rating scores from three user ratings:
        1. Functionality
        2. Ease of use
        3. Customer support
      2. The functionality breadth analysis is based on:
        1. The product’s coverage of core software category functions
        2. The number of other products it integrates with, along with the number of other products that state they integrate with it

For each of these data points, the methodology calculates the percentile ranking for each product relative to all other products in the software category that have qualified for FrontRunners consideration. That percentile ranking is then translated into a one to five score.

      1. The business confidence assessment is an indicator of whether the software company will likely continue to invest in the product for the next 12-18 months. The analysis is based on four data points:
        1. The product’s current customer base
        2. The annual growth rate of the product’s customer base
        3. The vendor’s current employee base
        4. The annual growth rate of the vendor’s employee base

If the company's size and product's customer base are both significant and growing, then the likelihood that the business will invest in the product is higher than in the alternative scenarios. For each of these four data points, the methodology calculates the percentile ranking for each product relative to all other products in the software category that have qualified for FrontRunners consideration. That percentile ranking is then translated to a one to five score.

The overall one to five Capability score is a weighted average of the scores for user ratings, functionality breadth and business confidence.

The Value score is based on two criteria: user ratings on value and product adoption.

        1. The value user ratings criterion captures users' satisfaction with the business value provided by the product. The value ratings score is a weighted average of the one to five star rating scores from three user ratings:
          1. Overall ratings of the product.
          2. How likely users are to recommend the product to others.
          3. How valuable users consider the product to be relative to its price.
        2. The product adoption data analysis assesses if the product is positioned in the market as more of an industry standard with higher adoption (thus earning a higher score), or as an emerging competitor with more limited adoption (thus earning a lower score). The product adoption methodology analysis for each product is based on four data points:
          1. The size of the product's customer base.
          2. The number of professionals in the market who have experience with the product (e.g., users, developers, administrators).
          3. The total number of user reviews across the three Gartner web properties.
          4. The average number of times per month internet users search for the product on Google.

For each of these four data points, the methodology calculates the percentile ranking for each product relative to all other products in the software category that have qualified for FrontRunners consideration. That percentile ranking is then translated into a one to five score.

The overall one to five Value score is a weighted average of the scores for value user ratings and product adoption.

Data

Data sources include user reviews and ratings, public data sources and data from technology vendors. The user-generated product reviews data incorporated into FrontRunners is collected from submissions to all three Gartner Digital Markets sites (softwareadvice.com, capterra.com and getapp.com). As a quality check, we ensure the reviewer is valid, that the review meets quality standards and that it is not a duplicate.

The business confidence and product adoption data comes from public sources, collected by either a third-party data provider or by Gartner associates. As a quality check, we compare this data against data submitted by the providers. We use this data to calculate a product's percentile ranking, which allows us to determine how products compare relative to one another rather than determine an absolute number.

The functionality breadth data is collected from the technology providers. We check the data provided and challenge data that seems inflated or unlikely. We use this data to calculate a product's percentile ranking, which allows us to determine how products compare relative to one another rather than determine an absolute number.

See FrontRunners frequently asked questions (FAQ) for more information on the methodology.

External Usage Guidelines

Providers must abide by the FrontRunners External Usage Guidelines when referencing FrontRunners content. Except in digital media with character limitations, the following disclaimer MUST appear with any/all FrontRunners reference(s) and graphic use:

FrontRunners scores and graphics are derived from individual end-user reviews based on their own experiences, vendor-supplied information and publicly available product information; they do not represent the views of Gartner or its affiliates.

Terms and Conditions
Qualifying vendor's corporate logo is used to identify its position in the FrontRunners Quadrant. Qualifying vendor grants to Software Advice a non-exclusive, worldwide license to use its corporate logo for this purpose, provided that such use (i) adheres to qualifying vendor’s standard approved format; and (ii) is limited to the Software Advice website and related FrontRunners materials.  

Vendors should submit only publicly available information and should not submit any information that they deem to be confidential.