The Southern California Clinical and Translational Science Institute (SC CTSI) supports clinical and translational research and is part of a broad national network of over 60 institutions with Clinical and Translational Science Awards (CTSAs) from the National Institutes of Health that work to translate research into better health. A crucial component of the the SC CTSI’s success is a rigorous approach to evaluation and improvement for local projects and processes coupled with effective participation in quality and improvement with the national CTSA consortium. We are seeking an experienced evaluation expert to lead and implement best practices for planning, evaluation and improvement and ensure that SC CTSI continues to be an effective data- and metrics-driven organization.
The Evaluation & Improvement (EI) Associate Director will report to SC CTSI Directors and works closely with core group leaders and staff within the Institute to develop metrics of success and methodologies for collecting and analyzing data regarding metrics, to implement evaluation projects, and to design and evaluate approaches to improvement. The EI Director will also contribute to the national efforts to harmonize evaluation and improvement across the national CTSA consortium. This position is an excellent opportunity for an individual who seeks to apply skills in evaluation and improvement to advance local and national efforts to translate research into solutions for better health.
Key Responsibilities:
40% Leadership & Implementation
Lead strategic planning and evaluation of performance and impact of SC CTSI core groups and new initiatives
Develop evaluation plans using qualitative and quantitative approaches to identify real world impact resulting from work of the SC CTSI
Implement and manage the Institute’s evaluation approaches to measure success across SC CTSI functions through methologies such as interventions, surveys, focus groups, and financial analyses of return on investment.
Establish processes and strategies for evaluating and improving performance against metrics
Collaborate with core groups and SC CTSI leadership to prepare annual evaluation reviews and make recommendations to SC CTSI goals, activities, personnel or budget
Identify delays and challenges in meeting goals and timelines. Work with Institute and Core leaders to develop, implement evaluate process improvements
Implement systems by which programs’ progress toward goals and data on internal SC CTSI metrics can be reported and assessed
20% Analysis
Develop methodologies to collect and analyze data to assess progress and impact of SC CTSI services and research
Develop a coordinated approach to research analysis and metrics across the SC CTSI
Facilitate data collection and electronic tracking
Perform quantitive and qualitative analyses as needed
Collaborate with USC faculty to identify innovative evaluation approaches and analytical plans
Continually expand and refine data sources that can be leveraged to measure SC CTSI’s progress and impact on research and the community
20% Reporting
Assess and Report SC CTSI performance
Report performance of SC CTSI programs and activities in relation to metrics
Work with Institute and Core leaders to assess the impact of the SC CTSI on our research environment, with our partners and within the community
Prepare annual and routine reports for internal and external stateholders including NIH annual progress report and Common Metrics, advisory boards and Institute leaders
Support core groups in reporting progress and impact in communications to leadership and stakeholders.
Develop dashboards and other approaches to real-time monitoring of projects
10% Staff Management
Oversee the Evaluation and Improvement program team
Oversee all evaluation, analysis and reporting work from EI team members
Propose team structure and staffing as needed to effectively support SC CTSI evaluation and improvement needs
Hire, train and providing coaching and oversight to EI staff.Make salary, promotion and discipline decisions in accordance with SC CTSI and USC HR policies
Complete annual performance reviews and provding timely feedback to staff for performance improvement
10% Consortium activities
Participate in the national CTSA consortium, including Common Metrics development groups and CTSA Evaluators group
Represent the SC CTSI on national committees focused on collaborative approaches to planning, evaluation, tracking, and reporting
Lead the adoption of other successful models and approaches
Participate in national efforts to harmonize metrics across the CTSA network
Knowledge, Skills and Abilities:
Experience with evaluation and improvement at a comparable organization, ideally in academia or in the biomedical arena
Experience with one or more planning and evaluation approaches, such as Results Based Accountability
Able to handle a fast-paced environment with high volume of data
Proven track record of effectively managing evaluation and data in a complex, highly distributed research environment (academic or business)
Experience managing complex technology and data-driven projects to achieve real world impact goals
Understanding of sponsored-research project budgeting and ability to successfully perform complex budget management
Education, Training and Experience –
Advanced degree in social sciences, public health, program evaluation or health sciences (Master’s and above) or equivalent experience and training, with experience in health or social sciences in biomedical or relevant quantitative or qualitative research environment
5+ years of experience leading program evaluation and improvement; experience in academic settings strongly preferred
Proven track record in disseminating successes in academic environment (e.g. peer reviewed publications, invited presentations, etc)
10+ years experience in a relevant research, biomedical, pharmaceutical or clinical setting practicing program/project management for complex, interdisciplinary programs or projects; showing increasing seniority in related fields in any capacity
Experience in leading change in policies and processes across complex, matrix organizations.
Minimum Education: Bachelor’s degree, Combined experience/education as substitute for minimum education Minimum Experience: 3 years Minimum Field of Expertise: Directly related professional and supervisory experience in area of program specialization