The process used to research and create the NMC Technology Outlook for STEM Education: 2013-2018 is very much rooted in the methods used throughout the Horizon Project. All editions of the NMC Horizon Report and Technology Outlook series are produced using a carefully constructed process that is informed by both primary and secondary research. Dozens of technologies, meaningful trends, and critical challenges are examined for possible inclusion in the report for each edition. Every report draws on the considerable expertise of an internationally renowned advisory board that first considers a broad set of important emerging technologies, challenges, and trends, and then examines each of them in progressively more detail, reducing the set until the final listing of technologies, trends, and challenges is selected.

This process takes place online, where it is captured and placed in the NMC Horizon Project wiki. The wiki is intended to be a completely transparent window onto the work of the project, and contains the entire record of the research for each of the various editions.

The wiki used for the STEM Edition can be found at

The procedure for selecting the topics in the report included a modified Delphi process now refined over years of producing the NMC Horizon Report series, and began with the assembly of the advisory board. The advisory board represents a wide range of backgrounds, nationalities, and interests, yet each member brings a particularly relevant expertise. Over the decade of the NMC Horizon Project research, more than 800 internationally recognized practitioners and experts have participated on project advisory boards; in any given year, a third of advisory board members are new, ensuring a flow of fresh perspectives each year. Nominations to serve on the advisory board are encouraged — see

Once the advisory board for a particular edition is constituted, their work begins with a systematic review of the literature — press clippings, reports, essays, and other materials — that pertains to emerging technology. Advisory board members are provided with an extensive set of background materials when the project begins, and are then asked to comment on them, identify those that seem especially worthwhile, and add to the set. The group discusses existing applications of emerging technology and brainstorms new ones. A key criterion for the inclusion of a topic in this edition is its potential relevance to teaching, learning, and research in STEM+ education. A carefully selected set of RSS feeds from hundreds of relevant publications ensures that background resources stay current as the project progresses. They are used to inform the thinking of the participants throughout the process.

Following the review of the literature, the advisory board engages in the central focus of the research — the research questions that are at the core of the NMC Horizon Project. These questions were designed to elicit a comprehensive listing of interesting technologies, challenges, and trends from the advisory board:

    1. Which of the key technologies catalogued in the Horizon Project Listing will be most important to teaching, learning, or research in STEM+ education within the next five years?
    2. What key technologies are missing from our list? Consider these related questions:
      1. What would you list among the established technologies that some educational institutions are using today that arguably ALL institutions should be using broadly to support or enhance STEM+ teaching, learning, or research?
      2. What technologies that have a solid user base in consumer, entertainment, or other industries should educational institutions be actively looking for ways to apply?
      3. What are the key emerging technologies you see developing to the point that STEM+ learning-focused institutions and programs should begin to take notice during the next four to five years?
    3. What do you see as the key challenges related to teaching, learning, or research that STEM+ educational institutions and programs will face during the next five years?
    4. What trends do you expect to have a significant impact on the ways in which STEM+ educational institutions and programs approach our core missions of teaching, learning, and research?

One of the advisory board’s most important tasks is to answer these questions as systematically and broadly as possible, so as to ensure that the range of relevant topics is considered. Once this work is done, a process that moves quickly over just a few days, the advisory board moves to a unique consensus-building process based on an iterative Delphi-based methodology.

In the first step of this approach, the responses to the research questions are systematically ranked and placed into adoption horizons by each advisory board member using a multi-vote system that allows members to weight their selections. Each member is asked to also identify the timeframe during which they feel the technology would enter mainstream use — defined for the purpose of the project as about 20% of institutions adopting it within the period discussed. (This figure is based on the research of Geoffrey A. Moore and refers to the critical mass of adoptions needed for a technology to have a chance of entering broad use.) These rankings are compiled into a collective set of responses, and inevitably, the ones around which there is the most agreement are quickly apparent.

From the comprehensive list of technologies originally considered for any report, the 12 that emerge at the top of the initial ranking process — four per adoption horizon — are further researched and expanded. Once this list is identified, the group, working with both NMC staff and practitioners in the field, begins to explore the ways in which these twelve important technologies might be used for teaching, learning, and research in STEM+ education. A significant amount of time is spent researching real and potential applications for each of the areas that would be of interest to practitioners.

For additional detail on the project methodology or to review the actual instrumentation, the ranking, and the interim products behind the report, please visit