UIW Mission University of the Incarnate Word is a Catholic institution that welcomes to its community persons of diverse backgrounds, in the belief that their respectful interaction advances the discovery of truth, mutual understanding, self-realization, and the common good.
Position Summary The Director of Assessment and Program Evaluation (DAPE) reports directly to the Associate Dean for Medical and Interprofessional Education and provides assessment and psychometric support and services to faculty and staff across a 4-year curriculum in the DO program and other graduate programs at the SOM. The DAPE provides leadership in assessment and program evaluation, while coordinating these efforts within the UIWSOM framework of lifelong learning through collaborative scholarship, innovative educational excellence and learner-centered curricula. The DAPE applies necessary knowledge for best practices in development, design and implementation of direct observations of skills, checklists, rating scales, case presentations, Multi-source feedback and other direct observations protocols. The candidate should have thorough knowledge of assessment methods (reliability, generalizability, protocol analyses, validity theories, etc.) to work independently on most aspects of clinical assessment and evaluation initiatives.
This position is considered a “Responsible Employee” under Title IX federal regulations and “Mandatory Reporter” under Texas state law and The UIW Sexual Misconduct Policy. As a Mandatory Reporter this position requires you as the employee to promptly report any incident that you witness or receive information about violating Title IX. These reporting responsibilities are set out in the UIW Sexual Misconduct Policy.
Job Duty Name Responsibilities
Description of Job Duties • Provides operational oversight for assessment, under the direction of the Associate Dean for Medical and Interprofessional Education in the Office of Medical and Interprofessional Education. • Maintains the systematic plan of evaluation and assessment for educational programs at UIWSOM. • Ensures timely completion of activities contained in the systematic plan of evaluation and assessment. • Serves as chair of the Continuous Program Improvement team at the SOM. • Creates and administers surveys of alumni, residency directors, and employers. • Prepares, reviews, and interprets data and makes recommendations to the Senior Leadership Team and Curriculum Committees. • Supervises the creation, collection and maintenance of data for program and accreditation reports. • Participates in self-studies and other accreditation report writing and development. • Assumes the role of Executive Proctor with the NBOME to support the medical education examination program. • Develops and selects evaluation instruments, strategies, and rubrics to measure program outcomes and the effectiveness of the curriculum, teaching activities and learning services for the Office of Medical and Interprofessional Education. • Develops and administers assessment instruments to assess program outcomes and prepares the analysis, interpretation, and reporting of results. • Trains faculty in effective student assessment including: understanding of student assessment methodologies, assessment tools/instruments and pedagogies that supports the medical education curriculum of UIWSOM. • Trains faculty in the use of data to improve student learning. • Participates in professional development activities to keep current in the field of medical education, assessment, evaluation, and research methodologies. • Works collaboratively with Phase Directors, Curriculum Support Manager and Phase Coordinators.
This job description is not intended to be all-inclusive. As such, the person holding this position will perform other duties as assigned by the Dean, or Associate Dean for Medical and Interprofessional Education of UIWSOM.
Knowledge Skills and Abilities 1. Demonstrate experience, knowledge, and skill in assessment and program evaluation. 2. Possess skills for providing administrative oversight, direction, leadership, and motivation for faculty and staff. 3. Outstanding organizational and verbal and written communication skills 4. Demonstrate intermediate skills (or better) in statistical software that includes Tableau. 5. Identify and apply best practices in development, design and implementation of direct observations of skills, checklists, rating scales, case presentations, Multi-source feedback and other direct observation protocols. 6. Ability to work with confidential material with an attention to detail. 7. Ability to work collaboratively and effectively in a team-based multi-cultural environment with deans staff, peers, and full-time and community-based faculty. 8. Demonstrate effective time management skills and ability to meet deadlines. 9. Commitment to social justice and values-driven medical education. 10. Ability to tolerate exposure to short, intermittent, and/or prolonged periods of sitting and/or standing in performance of job duties. 11. May be required to accomplish job duties using various types of equipment/supplies to include, but not limited to, pens, pencils, calculators, computer keyboards, telephone, etc. 12. May be required to transport oneself and others to other UIW offices, affiliated sites, and to off-campus sites to attend meetings, conferences, workshops, seminars, etc. 13. Employee shall adhere to all applicable rules and regulations of the University, the Conference, and the NCAA. 14. Ability to work effective with individuals from diverse communities and cultures.
Required Education Master’s Degree
Required Work Experience 1. Minimum of five years of experience in the field (e.g. educational measurement, psychometrics, or other closely related field). 2. Demonstrated effective oral and written communication skills for technical audiences. 3. Experience with quantitative analysis in more than one statistical application (e.g., Tableau, SPSS, SAS, EQS), including experience writing scripts for analysis. 4. Demonstrated thorough knowledge of assessment methods (reliability, generalizability, protocol analyses, validity theories, etc.) to work independently on most aspects of assessment to include clinical assessment and evaluation initiatives. Experience managing multiple priorities and deadlines, including adapting in response to changes in work priorities and processes.
Preferred Qualifications 1. PhD or EdD preferred in educational measurement, psychometrics, or in medical education or a health-related field. 2. Experience writing technical reports including results of quantitative/qualitative analyses. Experience with an ongoing assessment programs (elg., NBOME boards exams, subject exams, MCAT, national assessment programs (Graduation Questionnaire,etc.). Experience communicating quantitative information to non-technical audiences. Experience working with medical school faculty in assessment of clinical performance. Demonstrated knowledge of adult learning theory, pedagogical approaches and assessment processes. 3. Familiarity with COCA, LCME or other accrediting bodies 4. Demonstrated knowledge of creating, implementing and measuring student learning outcomes at the program and course levels 5. Proven ability to work collaboratively and foster a team environment. 6. Proven ability to work independently and autonomously 7. Ability to handle sensitive situations and highly confidential information. Must be proficient in Microsoft Office, SPSS or similar statistical pack and curriculum management systems (One45 or similar).
Work Hours Work hours are typically between 8AM and 5PM with flexibility for some evening or weekend hours based on department needs.
Posting Number: AS908PO Job Type: Full Time Job Category: Administrator (exempt) Reports To: Associate Dean of Medical and Interprofessional Education Open Date: 01/08/2020 Open Until Filled: Yes