Resource Library > Impact Evaluation > Evaluation Framework

Funding Agency Assessment

The evaluation of the work of the agency will be based on the legislative as well as the strategic objectives that have been identified for the organization. Measures which have been successfully used to provide this assessment include: its relationships with stakeholders and partners; the allocation of grants across different priority areas; and the impact of the agency on funded organizations.

Funds allocation

This component constitutes the analysis of routinely collected internal data, i.e. information assembled by the funding agency on a grant management system. This type of information is critical for reporting the annual performance of the organization and for comparing activity over a number of years. Measures may include:

  • the number of projects and programmes supported annually by the agency;
  • the distribution of funding to identified health priorities;
  • the distribution of funding to projects reaching priority target populations;
  • allocations to provinces, regions and districts;
  • allocations to specific programme areas;
  • the number of training courses or seminars organized;
  • the number (%) of projects that involve a capacity-building component;
  • the number (%) of projects and programmes that report the establishment of healthier environments; or

the number of partner organizations and stakeholders working with the funding agency.

Data collection methods

A robust grants management system should be able to provide comprehensive grantee data including:

  • the name of the grantee organization and person responsible;
  • the type of organization and sector (government, NGO, volunteer, etc);
  • key health issue(s) addressed;
  • key target group(s), age, and geographical location; and
  • other funding sources.

Impact of the fund recipients (grantees)

This component involves conducting surveys of organizations that receive funding from the agency. Ideally, this should occur early in the funding body’s establishment phase and then every two or three years to determine:

  • the quality of the business relationships between the funding agency and applicant groups;
  • views on the expectations of the funding agency, its processes, and reporting systems;
  • the impact of the grants on the health promotion skills and activities of recipients;
  • perceptions of the effects of the funding agency on the recipient organization, such as profile in the community or public awareness of the organization;
  • experiences of establishing, implementing and evaluating health promotion activities; and
  • barriers to organizational change and problems encountered.

Data collection methods

A postal/email survey may be used to collect this information from all organizations receiving grants. To ensure an adequate response rate, it may be necessary to follow up by telephone. This type of survey of funded organizations provides an important source of data on the agency’s impact on NGOs and other key partner organizations and may also point to areas where administrative improvements or further training are required.

Reference

World Health Organization. (2004). The establishment and use of dedicated taxes for health. World Health Organization Regional Office for the Western Pacific.

Read more