• Contents

• All Sections

11.1 Self -Evaluation, Monitoring, Review

Policy

Scoil Mhuire Adult Education continually monitors and evaluates our programmes, the quality of provision and the learning and teaching environment in order to ensure high quality programmes and to identify opportunities for development and improvement in both first and second provider schools.

Its purpose is to review, evaluate and report on the education, training, research and related services provided, the quality assurance system and the procedures which underpins these. Ongoing monitoring and regular review and evaluation are essential, in both first and second provider schools, if we are to ensure that we are meeting the requirements of learners, staff, tutors, QQI and other stakeholders. Self-evaluation enables us to consolidate areas of effective practice while also directing us to areas that require improvement and need to be addressed. Review and self-evaluation differ in frequency and scale.

To ensure effective and thorough self-evaluation we take the views of all stakeholders, learners, graduates, staff, tutors, employers, QQI, external authenticators and governance units into account and regard them as central to the processes.

We regard the selection of a suitable external evaluator who is competent to make a positive contribution to the process and to future plans for the programme as being key to the success of the self-evaluation exercise.

The outputs of all our review and evaluation processes are reported on in aggregate form to the Board of Management and/or our Quality Committee and used to implement change and improvement, helping us to identify best practice and stay abreast of developments that impact on our programmes.

11.2 Responsibility

The Quality Committee maintains oversight of all monitoring, review and self-evaluation processes and reviews reports.

The table below illustrates the ongoing monitoring and review that takes place.

Ongoing Monitoring and Evaluation

| --- | --- | --- | --- | | Learner Surveys/ Analysis of learner feedback/ Class Representation | Learners/Tutor /Quality Officer  | During and on Completion of Course  | Course Objectives/ Tutor Delivery/  Material Provided/ Administration/ Course Information/ Assessment  | | Tutor Feedback Forms.(Programme Monitoring)   | Tutor/Quality Officer   | During and on Completion of Programme | Personal Reflection/ Timing/ Training/  Course Information/ Support from Mgt.  | | Analysis of Recorded Complaints | Quality Officer  | Quarterly  | Complaints Register | | Monitor Learner Numbers/ Completion Rates   | Quality Officer/ Data Committee | Ongoing  | Enrolments /Attendance | | Informal Correspondence with Learners and Tutors  | Quality Officer/ Management Team/ Programme Team  | Ongoing | All Aspects of programme content and provision  | | Management Meeting   | Management/ Officers  | Weekly  | Ongoing Progress | | Results Analysis  | Administration Officer | Ongoing  | Results Sheets  | | Evaluate adequacy of Facilities | Quality Committee | Annually | Minutes of Meetings  | | Monitoring of Tutor Performance in first and second providers | Quality Officer/ Director of AE/ Director of AE & QA Monitor of second provider school/ RAP/ Quality Committee | Ongoing  | Learner feedback/ complaints/ attendance/ IV and EA Reports |

Back to Top

Monitoring and Evaluation is divided into three parts:

1. Ongoing Monitoring and Evaluation: This is the ongoing internal analysis of progress and comparison against specific performance indicators.
2. Programme Reviews: This is the periodic review of programme activity. It has a broad systemic focus and is carried out at specified intervals of two years.
3. Self-evaluation: This is a process involving the reflection, review and reporting on the quality and effectiveness of programmes using data collected over a five-year period. External expertise is brought in to help in this process.

11.3 Internal Self-Monitoring

Back to Top

11.4 Programme Reviews - Every Two Years

Policy

Our Programmes Team review and critically re-appraise programmes, in first and second provider schools, every two years and make modifications within the bounds of validation. Programme reviews are also forward looking, and we use the review data to inform the development of the programme. The PRT is made up of all those who are directly involved in all aspects of the programme. The Programmes Officer is responsible for convening the meetings and managing the documentation and reporting to the Quality Committee

Procedure

• The Programmes Officer plans the review and confirms the outline of the Programme Review Report Form and a timeline.
• The Programmes Officer produces a draft programme report based on the agreed headings in the Programme Review Report Form.
• The Management Team meets to discuss the findings/recommendations in the draft programme report and agrees an action plan for programme enhancement.
• The Programmes Officer presents the draft programme report/action plan to the QC for review, comment and approval.
• The Programmes Officer and Quality Officer updates the programme content after every review and highlights the changes to the tutors at programme team meetings
• The Director and Management Team monitors the implementation of the action plan and documents progress. The action plan is viewed as a living document which is regularly referenced, edited and updated.
• The Programmes Officer reports on progress at programme team meetings and highlights any gaps.

What does the PRT review?

• Data on learner enrolments, retention, completion and progression from our learner record system
• The curriculum content/programme materials and resources – are they up-to-date/reflect best practice/in line with current thinking and regulation
• The assessment strategy
• Adequacy of learner materials and supports, premises, equipment and facilities
• Programme staffing, management, administration
• Data from ongoing monitoring and evaluation
• Grade analysis and benchmarking
• Authentication reports
• Views of employers and other stakeholders e.g., work placement supervisors
• Overall learning experience and success of the programme

Monitoring of Quality of Work Placements

The tutor is responsible for monitoring the quality of work placements and reporting on it to the Quality Officer.

The tutor monitors the following:

• Feedback from the workplace supervisors
• Quality of the work experience journals
• Feedback from the learners on placement and from the external authenticator
• Assessment results for the work experience module

Responsibilities

Programme Review is the responsibility of the Programmes Team, aided by the Quality Officer and tutors. It is monitored by the Director of Adult Education and approved by the external evaluator. It is carried out on a yearly basis and encompasses all QQI programmes.

The Programme Review Process includes:

• Effective planning and preparation.
• Setting appropriate schedules and deadlines.
• Communicating processes to panel members.
• Construction of a self-evaluation checklist.
• Gathering all the relevant information for review.
• Ensuring the self-evaluation report is complete and signed off.
• Ensuring that the Improvement Plan is complete.

Programme Review Report

This report is prepared by an Assistant Director and contains the following:

1. Programme Summary
2. Programme Statistics
3. Evaluation Methodology
4. Executive Summary
5. Strengths and Effective Practice
6. Areas for Improvement
7. Recommendations

The Programmes collects and analyses both quantitative and qualitative data from:

• Learners
• Management