Aid Program Performance Report 2015-16

Annex C - Evaluation Planning

List of evaluations completed in the reporting period

Investment number and name (if applicable)	Name of evaluation	Date completed	Date Evaluation report Uploaded into AidWorks	Date Management response uploaded into AidWorks	Published on website
INI194 PNG-Australia Law and Justice Partnership	Evaluation of the RPNGC Family and Sexual Violence Units	December 2015	Not applicable	Not applicable	31 December 2015

List of program prioritised evaluations planned for the next 12 months

Evaluation title	Investment number and name (if applicable)	Date – planned commencement (month/year)	Date – planned completion (month/year)	Purpose of evaluation	Evaluation type
Health Capacity Development and Service Delivery program	INK214	July 2016	November 2016	To verify success and inform future investments	Mid-term review
Papua New Guinea – Australia Transport Sector Support Program Phase 2 (TSSP)	INK081	August 2016	February 2017	To assess the positive, negative, intended and unintended consequences of TSSP over its two phases and identify areas for improvement.	Independent evaluation
Reproductive Health Training Unit	INK214	August 2016	November 2016	To provide recommendations for future support	End of program review
The Maternal and Child Health Initiative	INK214	September 2016	December 2016	To make an independent assessment of the effectiveness and value for money of the program	End of program assessment

Annex D - Aid Quality Check ratings

AQC ratings*

Investment name	Approved budget and duration	year on year	Relevance	Effectiveness	Efficiency	Monitoring and Evaluation	Sustainability	Gender equality	Risks and Safeguards
PNG Education program (INJ761, INJ316)	$274m 2011-17	2016 AQC	6	5	5	3	5	4	6
		2015 AQC	5	5	4	4	5	5	5
PNG Health Capacity Development and Service Delivery (INK214)	$284m 2011-17	2016 AQC	6	5	5	5	3	5	5
		2015 AQC	6	6	6	6	6	6	6
Papua New Guinea Drought (INL847)	$8.5m 2015-17	2016 AQC	5	3	5	5	5	5	5
PNG Health and HIV Multilateral Partnerships (INJ858)	$68m 2011-16	2016 AQC	6	5	5	5	5	5	4
		2015 AQC	5	4	3	4	5	4	5
PNG Health and HIV Procurement Program (INK651)	$78m 2013-16	2016 AQC	6	5	3	5	4	5	5
		2015 AQC	6	5	5	4	5	5	5
PNG Health and HIV Financing Program (INK653)	$48m 2013-17	2016 AQC	5	5	4	3	5	5	4
		2015 AQC	5	5	5	3	5	5	5
Transport Sector Support Program (INK081)	$377m 2015-19	2016 AQC	6	5	5	5	5	4	6
		2015 FAQC	5	5	5	4	4	4	5
World Bank PNG Multi-Donor Trust Fund (INL752)	$30m 2015-19	2016 AQC	5	4	4	3	4	3	3
		2015 AQC	n/a	n/a	n/a	n/a	n/a	n/a	n/a

Supporting Electoral Processes in PNG (INJ466)	$27m 2011-18	2016 AQC	5	5	5	3	4	4	5
		2015 AQC	5	4	5	4	4	4	4
Private Sector and Rural Development (INL497)	$60m (2014-20)	2016 AQC	6	3	4	4	4	4	4
		2015 AQC	Exempt	Exempt	Exempt	Exempt	Exempt	Exempt	Exempt
Pacific Leadership and Governance Precinct Program (INL610)	$69m (2014-19)	2016 AQC	6	5	3	3	4	4	4
		2015 AQC	5	4	4	4	4	4	5
PNG Microfinance Expansion Project (INJ550)	$6.9m (2010-18)	2016 AQC	6	5	5	6	5	5	5
		2015 AQC	6	5	5	5	5	5	5
Strongim Gavman Program and Twinning Cluster (INI767, INJ364)	$217m (2009-17)	2016 AQC	5	4	3	2	3	4	3
		2015 AQC	6	4	3	3	3	4	3
Gender Equality / Gender Based Violence (INI402)	$58m (2008-20)	2016 AQC	6	5	5	5	3	6	5
		2015 AQC	5	5	3	5	4	6	3
Sports for Development (INL684)	$10m (2015-18)	2016 AQC	4	3	4	4	3	5	4
		2015 AQC	Exempt	Exempt	Exempt	Exempt	Exempt	Exempt	Exempt

*AQC investment performance over the previous 12 months and where available last year’s AQC ratings are included.

FAQC ratings

Final AQCs assess performance over the lifetime of the investment (ratings are not compared to previous years).

Investment name	Approved budget and duration	Overall rating	Relevance	Effectiveness	Efficiency	Monitoring and Evaluation	Sustainability	Gender equality	Risks and Safeguards
Scholarships PNG (INI815, INJ262, INJ465)	$94m 2009-16	5	5	5	5	5	6	6	5
PNG Disaster Risk Management Program (INJ302)	$9.2m 2010-16	3	4	4	3	3	4	4	3
PNG-Australia Law and Justice Partnership (INI194)	$183m 2009-16	5	6	5	5	5	4	5	5
Strongim Pipol Strongim Nesen (INI382)	$104m 2009-16	4	5	5	3	4	3	5	4
Church Partnerships Program Phase II (INJ313)	$50m 2010-16	4	5	4	3	3	4	5	4
Kokoda Track Initiative (INH843)	$26m 2008-16	4	4	3	4	2	3	3	4
Provincial and Local Level Governments Program (INK615)	$106m 2012-16	4	5	4	3	3	4	4	4
Economic and Public Sector Program (INI903)	$126m 2009-16	4	5	3	4	4	3	5	4

Definitions of rating scale:

Satisfactory (4, 5 and 6)

 6 = Very good; satisfies criteria in all areas.  5 = Good; satisfies criteria in almost all areas.

 4 = Adequate; on balance, satisfies criteria; does not fail in any major area.

Less than satisfactory (1, 2 and 3)

 3 = Less than adequate; on balance does not satisfy criteria and/or fails in at least one major area.

 2 = Poor; does not satisfy criteria in major areas.  1 = Very poor; does not satisfy criteria in many major area.

1^ PNG Department of Treasury, Mid-Year Economic and Fiscal and Fiscal Outlook Report, www.treasury.gov.pg accessed August 2016.

2^ PNG National Statistical Office, National Population and Housing Census 2011, www.nso.gov.pg accessed August 2016.

3^ Toft, S. and Bonnel, S. (eds.) (1985) ‘Marriage and Domestic Violence in Rural Papua New Guinea’, Law Reform Commission of Papua New Guinea. Occasional Paper No. 18.

4^ World Health Organization, Trends in maternal mortality: 1990 to 2015, www.who.int Accessed August 2016.

5^ Government of Papua New Guinea, 2015, Millennium Development Goals Summary Report for Papua New Guinea 2015

6^ All conversions in the document are for illustrative purposes only and reflect exchange rates as at August 2016

7^ Asian Development Bank Member Fact Sheet, www.adb.org accessed August 2016.

8^ Department of Foreign Affairs and Trade, A new direction for Australian aid in PNG, www.dfat.gov.au accessed August 2016.

9^ UNDP, Papua New Guinea: Phones against corruption, www.asia-pacific.undp.org accessed August 2016.

10^ The decline could also be attributed to more rigorous contestation of results in the AQC process this year.