The Wayback Machine - https://web.archive.org/web/20110718165449/http://beyondgreypinstripes.org:80/about/methodology.cfm
print header
Methodology

Beyond Grey Pinstripes is an independent, biennial business school survey and ranking managed by the Aspen Institute's Center for Business Education. Results are published every other year.

Findings from the survey highlight how academic institutions prepare students to meet the business challenges of tomorrow. Beyond Grey Pinstripes is unique—Aspen celebrates coursework, research and activities that prepare MBAs for social, ethical and environmental stewardship. Aspen evaluates business school programs on the following metrics:

  • Required and elective courses with innovative content addressing relevant issues in mainstream, for-profit business
  • Faculty research on social, ethical and environmental topics published in peer-reviewed business journals

2010-2012 Beyond Grey Pinstripes Timeline

2010-2012 Beyond Grey Pinstripes Timeline

Quick Links

OUTREACH AND ELIGIBILITY
DATA COLLECTION / SURVEY
DATA CLEANING AND VALIDATION
SCORING / RANKING CALCULATIONS


Outreach and Eligibility

At the start of the cycle, The Aspen Center for Business Education (Aspen CBE) sends invitations to nearly 600 business schools around the world which are eligible to participate in the survey and ranking.

U.S. business schools that are accredited by AACSB, EQUIS or AMBA are invited to participate. Schools outside the US with these accreditations are also invited to participate, as are other international schools that are recognized as leading institutions within their country or region.

Schools that meet our eligibility criteria and communicate an interest in participating in the survey are given a personalized username and password that grants their staff access to the Beyond Grey Pinstripes online data collection site.

Aspen CBE staff hold web conferences to help schools prepare to complete the survey and to explain the scoring methodology. Our introductory web conference is available for review by participating schools by contacting info@beyondgreypinstripes.org.

Throughout the data collection period, support is available to all participating schools via email and telephone.


Data Collection / Survey

Data for the Beyond Grey Pinstripes survey are collected online. The survey has 4 parts:

Survey Section Requested Content
Introduction:
Basic school information
Schools are asked to report basic information about their MBA programs: size of classes, number of faculty, number of credits/credit hours required for graduation etc. Schools are also asked to submit a short (under 500 words) narrative description that explains how they prepare students for social, ethical and environmental stewardship. This description is presented on the Beyond Grey Pinstripes website in the “In their own words” section on each school‘s page.
Part I:
MBA Coursework
Schools are asked to provide a written description of any course offered to MBA students that includes content relating to social, ethical and environmental impacts. This content should be clearly stated in each description. We also ask schools to include a course syllabus to support the course description. For each course schools report: the department in which the class is offered, course faculty, number of full-time MBA students enrolled in each course, credits/credit hours for each course, and whether the course is an elective or “core”. Only courses required of all MBA students should be reported as core courses. In addition, schools must estimate what percentage of each class is dedicated to relevant content: under 25%, 26%-50%, 51% to 75% or over 75%.
Part II:
Institutional Support
In the “Institutional Support” section of the survey we invite schools to tell us about extracurricular activities, internship programs, clubs, career development initiatives, institutes and centers, joint degrees and specializations that the school offers that they believe help prepare their students for social and environmental stewardship in their professional endeavors. The data provided in this section are not analyzed and included in the ranking, but we do post the information on our Beyond Grey Pinstripes website so that prospective students, among others, can view it and learn more about what happens outside the classroom at each participating school. (We expect to have an enhanced website available for launch in the fall, 2011 that will provide a more dynamic interface - with more social networking and data search options. This new site will help prospective students find and use this information more easily.)
Part III:
Faculty Research
In the “Faculty Research” portion of the survey, we ask schools to provide the abstracts of all relevant articles published by their faculty in 2009 and 2010 that focus on social, ethical and environmental issues in business. This information is submitted using an Excel spreadsheet template downloaded directly from the survey site. On this spreadsheet, schools also report the names of the faculty who wrote the article and the name of the journal in which it was published.

Data Cleaning and Validation

When the survey site closes, the Aspen CBE team makes an effort to “clean” the data for obvious errors. For example, in certain instances, such as if a rural school reported an MBA student enrollment of 10,000, Aspen CBE staff would contact the school in an attempt to correct this obvious mistake.

Other than obvious errors, staff at Aspen CBE do not attempt to assess the validity of the self-reported data. To support the transparency and accuracy of data reporting we:

  1. Require an online signature from the person at each school completing the survey, pledging honesty and accuracy.
  2. Make most reported data publicly available online so that peer schools, students, and alumni can review each school’s submission.

Scoring / Ranking Calculations

Coursework and Research data submitted by the schools are scored by teams of Ph.D and DPA Research Fellows whose work is overseen by the Aspen CBE project team. These Research Fellows are selected in a competitive process from leading institutions around the world.

Research Fellows are trained carefully on the scoring protocol. Scoring is done “blind” (to the extent possible, without school or faculty names associated with data) and in pairs. Research Fellows score the courses and research separately and then compare scores with their partners. They must agree on a score or flag the course or research for further review by the Aspen project team.

For each course, the Research Fellows must decide first of all whether the course contains content related to social, ethical and/or environmental stewardship. If yes, they must then decide if the course gets additional credit for meeting the “for profit impact” metric described below.

In the case of research, the Research Fellows review article titles and abstracts and decide whether the content relates to social, ethical and/or environmental stewardship.

The calculated and reviewed data are aggregated into four “raw score” metrics for each school, as follows:

  1. Availability of Relevant Courses (20%) counts the number of courses offered that the scoring team agrees contain social, environmental or ethical content. This metric answers the question: how much opportunity do students have to take courses with this content?
  2. Student Exposure (25%) measures the extent to which students are actually exposed to such content. The formula used in this calculation is the following: [(percent of course time dedicated to such issues) x (course credits / total degree credits) x (course enrollment / total school enrollment)]. Thus, all things being equal, longer courses, or dedicated courses, or courses with higher enrollments (whether required or simply popular electives) will be worth more in this calculation.
  3. Relevant Courses on For-Profit Impact (30%) is a simple count of the number of courses that not only demonstrate their relevance to the survey (see “Availability of Relevant Courses” above), but specifically address the intersection of social and environmental issues in mainstream, for-profit business. In other words, this metric measures how many courses explicitly discuss how for-profit, mainstream business can be a force for improving social and environmental conditions. For example, course content that focuses on the nonprofit sector or on a philosophical approach to ethics would get credit in the “Availability of Relevant Courses” metric, but would not get credit in this metric. However, a course in finance for new ventures, for example, that discusses the organizational practices that are needed “to sustain the lasting health of natural, social and economic systems,” would receive this additional credit. (The quote is from one course description submitted in the last round).
  4. Faculty Research (25%) counts the number of scholarly articles written by business school faculty, published in peer-reviewed, business journals in calendar years 2009 and 2010, that contain social, environmental or ethical content. This metric is designed to indicate the extent to which professors on campus explore these issues in their own research. Research Fellows review all article titles and abstracts using similar criteria to the “Availability of Relevant Courses” metric. Then, accepted journal articles are weighted according to its journal quality, as determined by its journal impact factor.

The “raw score” metrics – the outcomes of the four categories above - are adjusted by using a statistical smoothing process called square-root standard deviation about the mean, which produces numerical values that represent how well a school has done relative to the other schools in the survey. Each of these four values, or z-scores, are weighted as indicated above and then summed to arrive at an overall point total. The final ranking is an ordinal list of the top 100 schools, by total points received.