Download PDF

summary

 An experienced evaluator, researcher, and educator. A resourceful team player who excels at building trust & collaboration in working relationships. Adept at designing and conducting  quantitative & qualitative research and evaluation as well identifying actionable insight from data. 

SPECIALTIES

  • Quantitative & Qualitative Design Based Research: Advanced Multivariate Statistics.
  • Assessment development and validation
  • Successfully Designed, Developed,and Led Staff Development Training Workshops, and Taught Undergraduate & Graduate Courses for Both Traditional & Adult Learners.
  • SQL, Python, R, SPSS, Dedoose, and LaTex

Education

MA Social Psychology

Claremont Graduation University
19992002

Claremont, CA 91711

Relevant Experience

Evaluation Project manager

data2insight, LLC
20152016

Provides project management for data2insight, a data science firm that values learning and growth based on sound evidence, evaluation and performance measurement. Manages and implements up to seven strategic evaluations for clients and helps clients make evidence-based decisions. Responsible for developing project scope, budget and timeline development implementation; including logic models (theory of action, theory of change), evaluation design, and data analysis planning, data collection, data analysis, and the communication of findings; Also manages a team of twelve subcontractors.

Research Consultant

LIFE Center / University of WASHINGTON
20152015

Advised graduate students on research design & methodology, & statistical methods. Conducted data analysis of qualitative classroom research. 

Research Manager / Analyst

Center for Game Science / UNIVERSITY OF WASHINGTON
20122015

Supported the Center for Game Science's mission of increasing student and teacher efficacy around math and science learning.

  • Conducted experimental & design-based research on educational video games. +Achieved statistically significant learning gains across the Center's educational math games (Refraction, Treefrog Treasure, and Refraction).
  • Advised/mentored graduate students on research design & methodology, & statistical methods. 
  • Managed multiple product (educational video games) revisions based on research & user-testing results.
  • Drove project management of multiple simultaneous research projects, collaborations across multiple institutions
  • Managed numerous IRBs & informed consents (Includes development of new applications, modifications, as well as managing renewals). 
  • Collaborated on the implementation of statewide (WA state, MN), & international (Norway & France) Algebra campaigns.
  • Developed & delivered staff training around data collection & user testing of new game revisions.
  • Consulted with nonprofit partners EnLearn* on their Platform research & development 
  • Consulted with We Want To Know** on the design & implementation of pilot studies for their algebra video game DragonBox.

*(EnLearn aims to provide a comprehensive platform for automated data-driven optimization of the learning including student learning, teacher improvement, and parent and peer involvement.)

**http://wewanttoknow.com

Program Evaluation & Assessment Manager

Tenacity, InC
20082011
  • Designed, developed and implemented educational and fitness evaluation plans. 
  • Drove project management of the implementation of evaluation plans across functional teams.
  • Built strong collaborative relationships with both organizational leadership and site staff.
  • Delivered ongoing data analysis and reporting to funders. 
  • Designed, developed, and validated bi-annual student and parent surveys. 
  • Developed & delivered staff training.

Senior Research Manager

Monitor Group / Monitor Kantor Enterprises
20062009
  • Collaborated on the development of four proprietary behavioral propensity instruments.
  • Designed, developed and implemented validation studies of each instrument. 
  • Managed product development of web-based applications, across a team of developers, content experts, and organizational consults, allowing online administration of instruments for clients and the auto-generation of individual and team reports for the client and organizational consultants.
  • Conducted usability studies on the web based applications.

Evaluation Manager

BELL
20052006
  • Designed, developed and implemented evaluation plans. 
  • Drove project management of data collection, database management, data analysis.
  • Developed strong collaborative working relationships with staff in Boston, New York City, Baltimore, & Washington DC. 
  • Developed & delivered staff training around data collection, data management and assessment administration across multiple sites.
  • Implemented role-out of new assessment software across multiple sites. 
  • Wrote annual program evaluation reports & developed actionable insights based on data for upcoming academic year.
  • Conducted needs assessment.

Program Manager Post-Doctoral Programs

Boston University Goldman School of Dental Medicine
20032005

Supported the school’s mission of providing excellent education to dental professionals by driving the evaluation of the post-doctoral programs.

  • Designed, developed and implemented educational research studies and evaluation plans.
  • Scheduled and managed data collection, database management, data analysis. 
  • Wrote executive summaries and reports.
  • Developed administrative staff protocol specific training. 
  • Developed sampling plans. 
  • Survey and instrument design, development and validation. 
  • Conducted needs assessments.
  • Conducted & wrote literature reviews. 
  • Supervised research assistants.

Teaching Experience

Adjunct Faculty 

2010-2011    University of Massachusetts. Department of Psychology.

2009-2010    Boston College. Department of Psychology.

2002-2003     Woodbury University Department of Psychology & Mathematics.

Skills:

  • Has a comprehensive grasp of course content areas (see Courses Taught below).
  • Able to motivate students and maintain high levels of engagement.
  • Successful problem solver and evaluator of results.
  • Excellent written & verbal communication skills.
  • Consistently maintains a positive, supportive, & cooperative disposition toward others.
  • Is committed to promoting academic excellence in students.
  • Detail-oriented & punctual with a demonstrated ability to follow through on assigned tasks.
  • Able to effectively mentor student research projects and inspire curiosity.

Responsibilities:

  • Facilitated class instruction utilizing a variety of instructional strategies to maintain student engagement. 
  • Evaluated student performance promptly & accurately according to rubrics shared in the syllabus.
  • Maintained records of student attendance, participation, & progress.
  • Selected curriculum that met departmental needs, developed & managed syllabus materials.
  • Communicated with students outside of class to provide supplementary instruction when needed.
  • Surveyed students in order to obtain information about their needs and feedback about the course
  • Advised/mentored undergraduates on individual and group research projects

Courses Taught:

Research Methods
Introduction to StatisticsSocial Psychology
Advanced Applied StatisticsResearch Methods II (Statistics)Current Trends in Moral Psychology
Social CognitionGeneral Psychology

Select publications

Large-Scale Education Challenges. (2015). Yen-En Liu, Christy Ballweber, Eleanor O’Rourke, Eric Butler, Phonraphe Thummaphan, Zoran Popović. (TOCHI).

Brain Points: A Growth Mindset Incentive Structure Boosts Persistence in an Educational Game.  (2014). Eleanor O’Rourke, Kyla Haimovitz, Christy Ballweber, Carol S. Dweck, Zoran Popović.  (CHI).

Hint Systems May Negatively Impact Performance in Educational Games.  (2014). Eleanor O’Rourke, Christy Ballweber, Zoran Popović (L@S) Learning at Scale.