Ministry of Planning, Development & Special Initiatives
LOG IN

SECTION 4: FRAMEWORK FOR MONITORING AND EVALUATION

Based on international guidelines [1] [2], this section outlines a comprehensive mechanism for monitoring and evaluation (M&E), which is also aligned with the EPIS framework discussed in Section 6. It utilizes a mixed-methods approach for data collection, verification, and analyses by integrating both qualitative (QL) and quantitative (QN) methods.

Monitoring is defined as a continuous and systematic process of data recording and targeted assessments throughout the life of the MHPSS program. The monitoring activities include tracking stakeholders’ engagement, capacity-building components, and feedback loops from both service providers and users. Similarly, evaluation is conceptualized as the systematic assessment of the MHPSS program’s achievements at various levels, such as training assessments and in-depth analyses of service provision. This structured M&E framework not only depicts the effectiveness and impact of the MHPSS model but also provides valuable insights for strategic decision-making and ensuring sustainability and scalability.

Table 7.1 presents a systematic M&E framework with distinct domains (and subdomains, where needed), corresponding indicators, and means for data collection and verification. To ensure accurate monitoring at all levels, the framework has also been organized into tiers (1–4), where needed. This tiered approach meets the specific needs of different groups of service providers (e.g., community mental health workers (Hamdard Force), clinical psychologists, primary care physicians, and specialists) by tailoring unique indicators to monitor and evaluate their performance.

TABLE 7.1: AN M&E FRAMEWORK

Domains(Sub-domains in italics)TiersIndicatorsSources of dataFormat

1

EXPLORATION PHASE

1.1
Situational analysis
All tiersA comprehensive situation analysis reportDesk review / FGDsQualitative
1.2
Financial support
  • A financial proposal
  • Allocation of funds
Desk review
1.3
Inter-sectoral collaboration
  • Stakeholders list with defined roles and responsibilities and details of MHPSS focal point
  • Stakeholders’ engagement via coordination meetings
  • A stakeholder’s meeting for Needs Assessment
  • A stakeholders’ workshop to share the MHPSS implementation plan, define roles and responsibilities
  • Compile a service directory for the referral mechanism
FGDs / KIIs
1.4
Access to MHPSS digital solution
  • Subscription to the MHPSS digital solution
  • Integration of telecom solution
Portal data analysisQN
1.5
Mental health education campaign
A plan for a mental health education campaignKIIs / Desk reviewQL

2

PREPARATION PHASE

2.1
Capacity building: Recruitment
All tiersSelection and registration of mental health workforceMHPSS web portalQN
2.2.1
Trained workforce
All tiers
  • Number of individuals trained (demographics, contact details)
  • Number of people with lived experience
LMS - Courses completion report / portal registration dataQuantitative
2.2.2
Training outcomes — (1)
1Training courses: Knowledge assessmentLMS - Courses assessment / feedback report
2.2.2
Training outcomes — (2)
2Competency in MyCare+ managementLMS - assessment report
2.2.2
Training outcomes — (3)
3Competency in knowledge, skills, attitude, and confidenceLMS - training assessment reports [3]
2.2.2
Training outcomes — (4)
4Competency in teaching methodologyLMS - training assessment report
2.2.3
Training evaluation
All tiersFeedback surveys by the trained mental health workforceLMS - feedback report / FGDsQL
2.3
Pilot MHPSS services
A pilot evaluation report that includes:
  • MHPSS feasibility assessment (identification of challenges in service delivery)
  • Service provision data analysis
FGDs / portal dataQL / QN
2.4
Mental health campaign
A report of campaign evaluationKIIs / portal data / campaign reportQL / QN

3

IMPLEMENTATION PHASE

3.1.1
Service users
All tiers
  • Number of people referred; demographics; clinical problems
  • Number of people who access MyCare+; demographics; clinical data; sought an appointment
  • Number of people: demographics; clinical data; pharmacological & psychosocial interventions
  • Number of cases that received supervision
Portal / HF app / MyCare+ / mhGAP app data analysisQL / QN
3.1.2
Service outcome
All tiers
  • Number of mental health workforce members provided support
  • Number of cases managed; referred to other tiers; referred to other services
Portal data analysisQN
3.1.3
Service evaluation
Feedback by service usersPortal data analysis / KIIsQL
3.2.1
Cases supervised
All tiersNumber of cases supervised (routine or urgent)Portal data analysisQuantitative
3.2.2
Supervision outcome
Number of cases where supervision is provided for: assessment, management, referralPortal data analysisQuantitative
3.3
Program fidelity
Fidelity assessment report [4]FGDs / KIIsQualitative

4

SUSTAINABILITY PHASE

4.1
Evidence gathering
All tiersReview and evaluation of services in all phases [5]Qualitative
4.2
Prepare a sustainability report
Perform data analysis and present insights from the implementationA sustainability report on MHPSS service outcomes including:
  • MHPSS services
  • Fidelity analysis
  • Actionable insights for scaling up and replicating at new sites
4.3
Re-evaluate the services to scale up
Conduct regular meetings with stakeholders and service users to evaluate the servicesA revised plan (developed through a collaborative approach) for scaling or replicating the MHPSS model at new sites

REFERENCES

  1. IASC, 2022 https://interagencystandingcommittee.org/sites/default/files/migrated/2023-01/IASC%20MHPSS%20Minimum%20Service%20Package.pdf

  2. WHO, 2023 https://applications.emro.who.int/docs/9789292740986-eng.pdf?ua=1

  3. Adapted assessment tools: mhGAP-HIG knowledge questionnaire; ENACT; MICA-4; confidence assessment questionnaire

  4. Fidelity assessment will be based on qualitative feedback from both service users and providers

  5. Based on Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT)

Subscribe to our newsletter

Mental Health Strategic Planning & Coordination Unit Health Section Ministry of Planning, Development & Special Initiatives

MHSP&C UnitMHPSS ModelMHPSS Implementation PlanMHPSS Resources