Natural and Cultural Heritage Fund (NCHF) - Round 1 - Monitoring and Evaluation Framework Guidance

Published: September 2020

 

Version Control

Date	Issue	Status	Author	Authorised by
9/01/2019	1	DRAFT	EM	IR
14/03/2019	2	DRAFT	EM	IR
20/03/2019	3	FINAL	EM	IR
18/02/2020	4	UPDATE	EM	-
17/06/2020	5	UPDATE	EM	-
15/09/2020	6	FINAL	LC	EM

 

Introduction

This note sets out the framework that will be used to monitor and evaluate the success of the Natural and Cultural Heritage Fund Strategic Intervention.

The guidance covers the monitoring, evaluation and reporting that is done by NatureScot for the Strategic Intervention overall and that to be done by grantees for projects which receive funding from us.  

When applying for funding, applicants need to summarise in the application form how they will monitor the implementation of their project.   Where a project is awarded funding, we will expect a Monitoring & Evaluation Framework to be prepared prior to the contract being signed by us.  This should detail how you will evaluate and report the predicted outputs, results and outcomes.  This guidance outlines the information that needs to be collected and how it should be reported. 

This guidance is based on the Guidance Document on Monitoring and Evaluation, produced by the European Commission for the European Regional Development Fund (ERDF) Programme.   It also follows the principles in the Scottish Government’s Monitoring and Evaluation Strategy for the 2014-2020 Scottish Operational Programmes.  

This guidance should be followed alongside the Monitoring and Evaluation Plan available in the share file which provides a template which projects may wish to use to manage their framework.

The Scottish Context

National Performance Framework

The Natural and Cultural Heritage Fund Strategic Intervention contributes towards delivering National Outcomes under the Scottish Government’s National Performance Framework, in particular:

• We value, enjoy, protect and enhance our environment

Further information on Scotland’s National Performance Framework is available on the Scottish Government website.

National Surveys

The Office for National Statistics Sustainable Tourism Employment statistics will be used to monitor impact of the Operational Programme. Whilst the source data in the Operational Programme has come from the Office of National Statistics the Managing Authority actually use the Scottish Government statistics which include Sustainable Tourism and has a breakdown by local authority area.  These outline the definition of ‘Sustainable Tourism’ and the associated SIC codes.

There are a number of other Scotland-wide surveys which NatureScot will use as part of the assessment of the impact of the Natural and Cultural Heritage Strategic Intervention.  These include for example:

• Scottish Household Survey
• Scotland’s People & Nature Survey (SPANS)
• Scotland’s Visitor Survey (Visit Scotland)

NatureScot will be commissioning research to independently gather evidence of the contribution the NCHF has made to support tourism in remote and rural areas across the Highlands and Islands so as to quantify the return on investment across the region.

Why undertake Monitoring and Evaluation?

Through the NCHF investment we are making we want to improve visitor perceptions and create or sustain jobs in remote and rural areas.

The purpose of monitoring and evaluation is to provide evidence of the extent to which we have achieved this.  It also allows us to track the management of the funded Projects, the inputs, outputs and results, and the impact that these make both individually and cumulatively.

As the Lead Partner delivering the Strategic Intervention, NatureScot is expected by the EU and the Scottish Government to oversee a programme of monitoring and evaluation that:

• Evidences delivery of the Natural & Cultural Heritage Strategic Intervention in an efficient manner;
• Assesses whether the Natural & Cultural Heritage Strategic Intervention has produced the desired results and what its impact has been; and
• Informs the Scottish Government of the contribution made by the Natural & Cultural Heritage Strategic Intervention towards meeting their National Indicators.

How to plan for Monitoring and Evaluation

All grantees are required to report against a selection of the measures and indicators noted in this guidance.  Those that are most appropriate to what the project will deliver should be chosen; it is not necessary to report against all of them.  Of course, grantees can design their own additional measures over and above those in this guidance and this is encouraged.

All the measures to be used must be included in the Monitoring, Evaluation and Reporting Framework, to be prepared by all projects which are awarded funding prior to a signed contract being issued by us.  The final list of measures is agreed with NatureScot as part of that Framework.

The Monitoring Framework

This section sets out the framework of indicators that can be used to monitor, evaluate and report on various aspects of the Natural and Cultural Heritage Fund Strategic Intervention and the projects that contribute to it.  These include:

• Results Indicators – to be reported on by NatureScot using information collected from national surveys and from Grantees.
• Outcome Measures – to be reported on by Grantees for their projects.  NatureScot collates the information from all projects in order to report on the outcomes achieved by the Strategic Intervention as a whole.
• Process Measures – to be reported on by NatureScot using information collected from Grantees.

Further detail on each of the indicators is provided below and in the measures definitions in Annexes 2-4.

Result Indicators (reported on by NatureScot)

Results are the overall changes we want to see from the Natural and Cultural Heritage Fund Strategic Intervention.   In particular, we want to see a 5% increase in jobs in sustainable tourism across the Highlands & Islands area.

A Result Indicator for this has been agreed with the European Commission (see Table 1) for the Strategic Intervention as a whole.  This will be reported by NatureScot, so no action is required from grantees. 

Table 1 - Result Indicators

Indicator Name	Description	Outcome sought
Increase in employment in Sustainable Tourism	5% increase in baseline value of 26,200 jobs equivalent to a further 1,310 Full Time Equivalent roles.   Source data is ONS business Register and Employment Survey (BRES)	27,510 jobs in sustainable tourism recorded in the Highlands & Islands by 2023

Outcome Measures (reported on by Grantees)

A number of measures have been identified which will help us to monitor and evaluate the intended results (outcomes) for the Natural and Cultural Heritage Fund Strategic Intervention.  These are shown in table 2.

Table 2 - Outcome Measures

No.	Measure Name
Measure 1 (Outcome 3)	Employment generation - the number of jobs created in delivering your project and then sustained by it in the long term (i.e. not just for the construction or build of the project).  This is to be measured by the number of full time equivalent jobs resulting from your project whether through direct employment or in sustaining jobs elsewhere in the community.  .
Measure 2 (Outcome 2)	Visitor experiences and perceptions are positive - measure of the number of people who have participated in a natural or cultural heritage experience as a result of your project and how they rated their experience.
Measure 3 (Outcome 01)	Increase in attendance at heritage events or places of culture or nature - measured by the number of adults who have attended or visited a heritage event or place as a result of your project.
Measure 4 (Outcome 03)	Increases in length of tourist season - the extent to which your project helps to extend the tourist season, expand markets, increase footfall or length of stay to one or more remote and rural area(s).
Measure 5 (Outcome 3)	New products and services - the extent to which your project offers new products or increases the availability of services to meet customer needs, demands or expectations.
Measure 6 (Outcome 4)	Increases in opportunities to spend, see and stay - the extent to which your project provides increased opportunity to spend, see and stay in remote and rural areas contributing to economic growth and social sustainability.  This can be measured using visitor survey information on length of stay in the area and estimates of spend.
Measure 7 (Outcome 3)	Improved perceptions of local people - benefits perceived by local people who live in your project’s area such as: the percentage of adults who rate that it is a very good place to live and/or has been improved by your project and the extent to which they have been able to contribute to local decisions.

A description of these outcomes and how they should be monitored and reported on is contained in Annex 3.

Not all of these apply to all projects.  The outcome measures which are relevant to each project should be set out in the Monitoring & Evaluation Framework agreed between the grantee and NatureScot.  Information and data for each agreed measure will be collected by grantees for their project and reported to NatureScot through the quarterly and final Progress Reports. 

The frequency of reporting for each measure will be agreed as part of the Monitoring & Evaluation Framework – some measures require to be reported on each quarter, while others may only require to be reported on by exception or in the final report.

Grantees may, of course, use other measures over and above those we have suggested to monitor progress and evaluate the impact of their project.   Alternatively, grantees may use their own existing measures (as well as, or instead of, the menu measures), if they tell a strong story related to the outcomes the Natural and Cultural Heritage Fund Strategic Intervention wishes to achieve.   Where grantees propose to use outcome measures other than those defined in Annex 3, then a definition for each additional measure must be completed in a similar format to that used in the annex, along with agreement on frequency and format of reporting.  These should also be included in the agreed Monitoring & Evaluation Framework for the project.

Process measures (reported on by NatureScot)

Process measures are used to monitor progress in delivering projects and to report on these individually and collectively. NatureScot will collect information from grantees through quarterly and final Progress Reports (see below).

Lead Partner - Strategic Intervention Process Monitoring

NatureScot’s performance as Lead Partner for the Natural and Cultural Heritage Fund Intervention will be assessed by Scottish Government and the EU against measures such as:

• Application process - customer experience, quality of guidance
• Change Requests – number submitted and time taken to process
• Claims – submission on time and accuracy
• Transactions - compliance and failure rates
• Eligible spend percentage against overall budget
• Customer experience – feedback, complaints and compliments
• Communications activity – success in promoting the Strategic Intervention and compliance with EU and Scottish Government branding requirements

Grantee - Project Management Process Monitoring

Grantees’ performance will be assessed by NatureScot against the following measures, using data collected by NatureScot when processing claims.

• Progress reports submitted on time
• Claims submitted on time
• Claim Return %
• Claim Return rate
• Transaction failure rate
• Claim submission after completion
• Eligible Spend against Budget Forecast

Refer to Annex 4 for the process measure definitions. 

We will also gather data from the checklist in the Procurement Aide Memoire, which will be required to be submitted with quarterly claim reports, including:

• Evidence of contract advertising
• Evidence of compliance with contract thresholds
• Evidence of compliant tender procedure

Qualitative Methods

The use of qualitative evidence in monitoring, evaluation and reporting provides a rich source of information to demonstrate the benefits of a project and the outcomes it has achieved.  Qualitative evidence can include examples, case studies, surveys, workshop outputs, art pieces, stories, activity reports, first person pieces, digital film diaries, newsletters, plays, and so on.  The options are broad ranging and innovation and creativity is encouraged.

The following principles should be considered when planning qualitative monitoring:

Plan ahead:

• Be clear what kind of evidence you want to collect at the planning stage and how it will be used in reporting
• Ensure there is sufficient budget for it and appropriately skilled people to undertake it
• Prepare an implementation plan and share it with participants, so they know what to expect
• Have a framework in place to secure approval from people to use images of them or information about them

Involve people:

• Where possible, get the target audience involved in planning the monitoring and reporting and get them involved in gathering evidence
• Get creative and make it fun – think about what will be compelling when we tell the story of the natural and cultural heritage fund

Reporting

Strategic Intervention - Reporting done by NatureScot

NatureScot is responsible for monitoring progress of all Projects individually and collectively towards delivering the Strategic Intervention’s outcomes and Horizontal Themes:

• Outcome 1: Heritage assets are more accessible and better promoted.  Awareness of the distinctive heritage assets of the region is increased, making them more accessible and better understood in ways which are consistent with their sensitive management and sustainable use.
   
• Outcome 2: The quality of visitor experience to the heritage assets is enhanced.  The quality of the experience and products on offer to visitors to the region are enhanced through the provision of good quality, accessible facilities and/or information relating to heritage assets, in ways which fill gaps in provision, disperse benefits and encourage or attract visitors to discover and explore responsibly.
   
• Outcome 3: New products, services and jobs based on heritage assets are sustained and/or created.  New products or services based on the region’s natural and cultural assets are developed, creating and/or maintaining jobs, helping to sustain local populations and benefitting local communities. Projects should contribute to sustainable social and economic growth based on sustainable environmental management and productive economic use of natural and cultural heritage assets.
   
• Outcome 4: There is co-ordinated promotion and interpretation of heritage assets across the region.  Aspects of the distinctive natural and/or cultural heritage of the region (such as Gaelic and the region’s music or textiles) are promoted through innovative digital interpretation projects and interpretative media. This should be done in ways which protect the natural and/or cultural heritage assets being promoted, improve accessibility and information for visitors and expand visitor markets.
   
• Horizontal Theme 1 - Sustainable development
   
• Horizontal Theme 2 - Equal opportunities and non-discrimination
   
• Horizontal Theme 3 - Equality between Men and Women

We will evaluate whether the Strategic Intervention is being delivered on time and on budget.  We will also upload quarterly monitoring reports submitted with claims, including nil returns, to EUMIS for each of the Projects.

NatureScot will provide the Managing Authority with an Annual Report on progress with delivering the Strategic Intervention and progress towards meeting targets.  This report will also contain a narrative on results under each of the Outcomes and Horizontal Themes and provide evidence on compliance, process management and communications.

Project Reporting - Reporting done by Grantees

Grantees are required to report on all of the chosen measures at appropriate frequencies (see below), as agreed in the Monitoring & Evaluation Framework for their project.  For some outputs and results, grantees will be asked to produce qualitative evidence to allow NatureScot to produce a narrative on why and how the Natural & Cultural Heritage Strategic Intervention has worked.

Milestones for the delivery of projects will be identified and agreed between the grantee, NatureScot and Managing Authority.  The completion of milestones will be linked to payment claims.  Grantees will be required to report the actual progress of implementation of each project against the planned forecast on a quarterly basis as part of completing a Progress Report (whether or not submitting a quarterly claim). 

Following the final claim, annual reporting of results is expected by grantees until 2023.

The following table illustrates reporting frequencies:

Table 3 - Reporting Frequencies

Report Type	Frequency
Progress Reports (Output/Result & Delivery Measures)	Quarterly
Final Report	1 month after Project completion
Annual Reporting of Results	Following final claim, until 2023
Auditable data	Retain until 2030

Quarterly Reporting - Progress Report

Quarterly Progress Reports are required throughout the delivery period for the project.  These must be provided on the template provided by NatureScot.  These should include a report on progress against the measures agreed in the project’s Monitoring & Evaluation Framework. 

Final Report

Grantees will be required to provide a Final Report at the completion of the Project.  A template for this will be provided by NatureScot (following a similar format to the Quarterly Progress Reports). 

Within 1 month of completion, the following should be provided to NatureScot:

• A final Project report
• A one page ‘case study’ highlight report
• A short digital film for use online and at presentations showcasing the Project: capturing the Project from start to finish – aims, challenges, existing situation, what was done, the end result, people’s perceptions

Annual Monitoring Reports

Grantees are required to provide annual reports starting 1 year after submission of the Final Report through until the end of the monitoring period in 2023.  A template for this will be provided by NatureScot.

Auditable Data

Further evidence on the project may be requested up to the end of the EU auditable period (2030).

Use of Reported Information and Format

The data and information collected as part of monitoring progress against the measures may be used by the Lead Partner (NatureScot) and/or Managing Authority (Scottish Government) in reports, case studies and publicity material.  Therefore, it is important that grantees ensure all participants and staff that feature in the reporting are aware of this and have given the appropriate consent for their details to be shared.  The Scottish Government has created a consent form which Projects can download and use for this purpose (see page 20).

Some of the measures require information in the form of GIS data, photographs and digital film clips.  Grantees are required to submit data in these formats to the specifications set out in Annex 1.

Annex 1 - Specifications for GIS data, photographs and digital film

GIS data (applies to Natural and Cultural Heritage Fund grantees where mapping is required)

All GIS data submitted by grantees should be complete with metadata captured to the latest UK GEMINI standard (currently (December 2015) UK GEMINI 2.2).  Guidance on the UK GEMINI standard can be found on the website of the Association for Geographic Information, who oversee the standard.

Photographic specification

All photographs commissioned or submitted should be in a digital format (jpg file). Images should be the maximum size that can be achieved by the camera.  If we require smaller versions NatureScot can repurpose the file.  Each image should have the following metadata (information):

• Image ID
• Title
• Photographer (can be the organisation)
• Short description
• Date taken
• National Grid location  
• Permissions
• Copyright

If the images/digital films are to be supplied by freelance professionals then the images should have the requested file metadata tagged to the IPTC field of each image file.  If not, then a separate accompanying spread sheet with the metadata will be required.

Please note that there's no routine deleting of images, so once an image is uploaded it will be on the NatureScot Image Library as long as NatureScot support it.

Grantees must give NatureScot the right to use the photographs, transparencies or digital images, including digital film images they provide to us.  Grantees must get any permissions, including copyright, needed for these images to be used, including the consent of any persons appearing in them where applicable, before being sent to us and before they are to be used.

Digital Film Specification

All submitted or commissioned digital film clips should be provided digitally as an uncompressed digital film. Digital film clips should be in a format capable of being uploaded to social media, for example through the NatureScot YouTube channel.  There is no file size constraint for digital films but ideally they should be filmed at 1080p 25fps.  If the digital films are uploaded to YouTube at that size they can be played back at lower resolutions.

As a last resort, where the large size of the digital film files makes it not feasible to email digital film clips, then hard copies will be required either as DVDs or Pen Drives.  DVDs or Pen Drives should then be sent to the NCHF Admin Officer. Digital film clips should show the name and organisation (if relevant) of those talking on screen.

Each digital film clip should have the following metadata attached and be contained in a separate accompanying spreadsheet:

• Digital film ID
• Title
• Photographer (can be the organisation)
• Short description
• Date taken
• Permissions
• Copyright

Annex 2 - Result Indicator Definition

This is reported on by NatureScot using information collected from national surveys and from Grantees.

The source data in the OP has come from the Office of National Statistics the Managing Authority actually use the Scottish Government statistics which include Sustainable Tourism and has a breakdown by local authority area. These outline the definition of ‘Sustainable Tourism’ and the associated SIC codes.

Indicator Name	Description	Outcome sought
Increase in employment in Sustainable Tourism	5% increase in baseline value of 26,200 jobs equivalent to a further 1,310 Full Time Equivalent roles.   Source data is ONS business Register and Employment Survey (BRES)	27,510 jobs in sustainable tourism recorded in the Highlands & Islands by 2023

 

Indicator Name	INDICATOR A: Increase in employment in Sustainable Tourism
Description	A record of the number of jobs equivalent to a further 1,310 Full Time Equivalent roles.
Outcome sought	Create New or Sustain Existing number of jobs
Data collector	Source data is ONS business Register and Employment Survey (BRES)
Scope	Funded Projects within the Natural and Cultural Heritage Fund Strategic Intervention
Frequency of data collection	Whenever new Projects are agreed
Data items	Number of jobs created as a result of NCHF agreed Projects in transition area (Highlands & Islands).
Frequency of report	2020, 2023
Notes	“Agreed” Projects mean the contract is let. Target is a further 1,310 Full Time Equivalent roles in HIE areas by 2023 Grantees are not required to report this indicator

Annex 3 - Outcome Measure Definitions

Outcome Measures – to be reported on by Grantees for their projects.  NatureScot collates the information from all projects in order to report on the outcomes achieved by the Strategic Intervention as a whole.

Measure Name	1: Employment generation
Description	This relates to the number of jobs created in delivering your project and then sustained by it in the long term.  To be measured by the number of full time equivalent jobs resulting from your project whether through direct employment or in sustaining jobs elsewhere in the community.
Contribution to Outcomes	New products, services and jobs based on heritage assets are sustained and/or created (Outcome 3)
Data collector	Source data is ONS business Register and Employment Survey (BRES) The source data in the OP has come from the Office of National Statistics the Managing Authority actually use the Scottish Government statistics which include Sustainable Tourism and has a breakdown by local authority area. These outline the definition of ‘Sustainable Tourism’ and the associated SIC codes.
Scope	This measure includes a record of the number of jobs equivalent to full time equivalent roles. It can identify jobs that your project has contributed to supporting including sustainable tourism roles and other types of jobs across a range of industries.
Frequency of data collection	To be agreed with the Lead Partner
Data items	Planned and actual number of new or sustained jobs within remote and rural areas.
Presentation Format	Using GIS, Grantees should estimate the impact of the Project on job creation. The different types of jobs and the geographical proximity of where these are.
Frequency of report	To be agreed with the Lead Partner

 

Measure Name	2: Visitor experiences and perceptions are  positive
Description	This relates to the number of people who have participated in a natural or cultural heritage experience as a result of your project, their perception and how they rated their experience.
Contribution to Outcomes	Heritage assets are more accessible and better promoted The quality of visitor experience to the heritage assets is enhanced There is co-ordinated promotion and interpretation of heritage assets across the region (Outcomes 1, 2 and 3)
Data collector	Grantee (via onsite or online survey)
Scope	This measurement includes visitor perception. The Grantee must demonstrate that the visitor awareness of the distinctive heritage assets of the region is increased and better understood.  Assets should be more accessible and encourage or attract visitors to discover and explore responsibly.
Frequency of data collection	To be agreed with the Lead Partner
Data items	Number of visitors with an improved perception of the quality of provision. Number of people by month or year. Customer rating or visitor perception scores. Awareness and understanding of heritage assets. Accessibility numbers and number of outputs that have been added to increase accessibility.
Presentation Format	Evidence that the visitor perception of their experience is positive. Evidence that the site accessibility has been improved. Evidence of the quality of the site before the start of works may include photographs that illustrate the quality of the site before and after the works. Evidence that the visitor perception of the visitor provision is improved in terms of quality and accessibility Evidence that visitor awareness and understanding of the heritage assets are improved.
Frequency of report	To be agreed with the Lead Partner

 

Measure Name	3: Increase in attendance at cultural or natural heritage events or places of culture and nature
Description	This relates to an increase in the number of adults who have attended or visited a heritage event or place as a result of your project.
Contribution to Outcomes	Heritage assets are more accessible and better promoted  (Outcome 1)
Data collector	Grantee (via onsite counter or online tickets)
Scope	The measurement includes demonstration of an increase in participation or attendance.
Frequency of data collection	To be agreed with the Lead Partner
Data items	Evidence of participation or attendance
Presentation Format	Number of heritage  events created Number opportunities  of heritage places to visit created or improved Description of the heritage events or places of heritage that  are more accessible as a result of the project.   For the final report, a pdf A4 map should be provided, showing the Project boundary, the opportunity created or improved and the asset that has been made more accessible.
Frequency of report	To be agreed with the Lead Partner

 

Measure Name	4: Increases in length of tourist season
Description	This relates to the extent to which your project helps to extend the tourist season, expand markets, increase footfall or length of stay to one or more remote and rural area(s).
Outcome sought	New products, services and jobs based on heritage assets are sustained and/or created (Outcomes 3)
Data collector	Grantee
Scope	This measurement unit includes the contribution your project makes to extend the tourist season, expand markets, increase footfall or length of stay to one or more remote and rural area(s).
Frequency of data collection	To be agreed with the Lead Partner
Data items	Number of visitors to one or more remote and rural area(s). Length of stay to one or more remote and rural area(s). Number of businesses supported by the contribution your project. Evidence of the contribution your project has made to extend the tourist season or expand markets.
Presentation Format	- specify the number of visitors to one or more remote and rural area(s). - specify the increase in the length of visitor stay -specify the extent to which your project has contributed to extending the tourist season or expanding markets
Frequency of report	To be agreed with the Lead Partner

 

Measure Name	5: New products and services based on heritage assets
Description	This measure relates to the extent to which your project offer new products or increase the availability of services to meet customer needs, demands or expectations.
Outcome sought	New products, services and jobs based on heritage assets are sustained and/or created: New products or services based on the region’s natural and cultural assets are developed, creating and/or maintaining jobs, helping to sustain local populations and benefitting local communities. Projects should contribute to sustainable social and economic growth based on sustainable environmental management and productive economic use of natural and cultural heritage assets. (Outcome 3)
Data collector	Grantee
Scope	The measurement unit includes the new products or services based on the region’s natural and cultural assets. It includes the  opportunities your project creates to help sustain local populations and benefit local communities.   The measurement unit includes the provision of good quality, accessible facilities and/or information relating to heritage assets and how your project is contributing to sustainable social and economic growth based on sustainable environmental management and productive economic use of natural and cultural heritage assets. This may include: facilities: infrastructure provided to improve visitor provision such as parking, toilets and hospitality. events: organised opportunities such as heritage information days, heritage talks and or walks, etc activities: providing information through leaflets, websites, social media, etc volunteering: organised opportunities for unpaid participation in skills training, work days etc The data should be collected to enable the protected characteristics relevant to the community to be monitored, including: young people (under 25 years) people living in the most deprived 15% SIMD areas people experiencing exclusion – black and ethnic minorities any other characteristics pertinent to the community in which the Project is being undertaken
Frequency of data collection	To be agreed with Lead Partner
Data items	Number of new products or increased availability of services to meet customer needs, demands or expectations. Number of visitors engaged through events/activities and/or volunteering opportunities.
Presentation Format	For reporting, grantees should describe the method they plan to use for providing evidence of a new product or an increase in availability of a service. For example to demonstrate  increase in the availability of new services indicate participation records, headcounts, registration sheets, number of hits on website, certificates issued. Grantee may consider reporting on the  following: the number of heritage events the number of visitors engaged through events the number of activities the number of visitors  engaged through activities the number of volunteering opportunities for local people the number of local people or communities of interest engaged through volunteering. Grantees may also wish to provide a photograph storyboard for key events and activities.
Frequency of report	Quarterly

 

Measure Name	6: Increases in opportunities to spend, see and stay
Description	This relates to the extent to which your project provides increased opportunity to spend, see and stay in remote and rural areas contributing to economic growth and social sustainability.  This can be measured using visitor survey information on length of stay in the area and estimates of spend.
Outcome sought	Heritage assets are more accessible and better promoted : Awareness of the distinctive heritage assets of the region is increased, making them more accessible and better understood in ways (Outcome 1 )
Data collector	Grantee (via Local authority open space audit, strategy or similar)
Scope	This measure includes demonstration of an increased opportunities to spend, see and stay in remote and rural areas
Frequency of data collection	To be agreed with the Lead Partner
Data items	This can be measured using visitor survey information on length of stay in the area and estimates of spend.
Presentation Format	Evidence of visitor information on footfall, length of stay and spend.
Frequency of report	To be agreed with the Lead Partner

 

Measure Name	7: Improved perceptions of local people -
Description	This relates to the quality of the experience and products on offer to visitors and how people living close to the area of the Project perceive their local neighbourhood. It relates to the benefits perceived by local people who live in your project’s area such as the percentage of adults who rate that it is a very good place to live and/or improved by your project and the extent to which they have been able to contribute to local decisions.
Outcome sought	The quality of visitor experience to the heritage assets is enhanced: The quality of the experience and products on offer to visitors to the region are enhanced through the provision of good quality, accessible facilities and/or information relating to heritage assets, in ways which fill gaps in provision, disperse benefits and encourage or attract visitors to discover and explore responsibly. New products, services and jobs based on heritage assets are sustained and/or created: New products or services based on the region’s natural and cultural assets are developed, creating and/or maintaining jobs, helping to sustain local populations and benefitting local communities. Projects should contribute to sustainable social and economic growth based on sustainable environmental management and productive economic use of natural and cultural heritage assets. Outcome 2 & 3
Data collector
Scope	This measurement unit includes the contribution your project makes to extend the tourist season, expand markets, increase footfall or length of stay to one or more remote and rural area(s).
Frequency of data collection	To be agreed with the Lead Partner
Data items	Percentage of people living within 300m of the Project who state they are either satisfied or fairly satisfied with the quality of the visitor provision, visitor experience and products on offer to visitors and how people living close to the area of the Project perceive their local neighbourhood.   Percentage of people living within 300m of the Project who state they have been able to contribute to local decisions.
Presentation Format	Information from people involved in and benefitting from the heritage projects may be collected through: door to door surveys; feedback from community organisations; personal case studies etc.
Frequency of report	To be agreed with the Lead Partner

Annex 4 - Process Measure Definitions

NatureScot as Lead Partner will collate the data outlined in this annex from the Progress Reports and Annual Reports submitted by Grantees.

Measure Name	1: Progress reports on time
Description	The % of progress reports by grantee, submitted by deadline.
Outcome sought	Progress Reports to be submitted from the first relevant quarter end by each Project whether expenditure has occurred or not and on time to avoid delay submitting batched claims to the Scottish Government by the Lead Partner.
Data collector	Lead Partner
Scope	Relates to all approved Project Progress Reports.
Frequency of data collection	Quarterly
Data items	Count of progress reports; date submitted; due date; calculation comparing due date with date submitted
Presentation Format	Bar chart
Frequency of report	Quarterly

 

Measure Name	2: Claims submitted on time
Description	The % of eligible claims submitted on time to Lead Partner.
Outcome sought	Grantees submit claims per the agreed budget and per the agreed timeline.
Data collector	Lead Partner
Scope	All approved Project claims.
Frequency of data collection	Quarterly
Data items	Date claim submitted; due date; grantee name; project name; claim id; reason for non-submission of claim
Presentation Format	Bar chart
Frequency of report	Quarterly

 

Measure Name	3: Claim return %
Description	The % of claims that have to be returned to the grantee by the Lead Partner.
Outcome sought	No claims returned by Lead Partner.
Data collector	Lead Partner
Scope	All approved Project claims.
Frequency of data collection	Quarterly
Data items	Claims received; Grantee name; Project name; date submitted; date returned; reason for return
Presentation Format	Bar chart
Frequency of report	Quarterly

 

Measure Name	4: Claim return rate
Description	The number of times any one claim has to be returned to the grantee by the Lead Partner for correction.
Outcome sought	No claim returns.
Data collector	Lead Partner
Scope	All approved Project claims.
Frequency of data collection	Quarterly
Data items	Claim ID; date claim made; date returned; reason for return; Grantee name; Project name
Presentation Format	Bar chart
Frequency of report	Quarterly

 

Measure Name	5: Transaction audit check failure rate
Description	The number of transactions that fail the Lead Partner audit and compliance check.
Outcome sought	100% compliance with no failure rate.
Data collector	Lead Partner
Scope	All approved Project claims.
Frequency of data collection	Quarterly
Data items	Claim Id; grantee name; project name; claim date submitted; pass/fail; date of pass/fail; reason for fail
Presentation Format	Bar chart
Frequency of report	Quarterly

 

Measure Name	6: Claim submission after completion
Description	The % of claims left outstanding more than 6 months after the Project is complete.
Outcome sought	No claims submitted after completion.
Data collector	Lead Partner
Scope	Relates to all approved Project claims.
Frequency of data collection	Quarterly
Data items	Total number of claims; Grantee name; Project name; date submitted; end date of Project
Presentation Format	Bar chart
Frequency of report	Quarterly

 

Measure Name	7: Expenditure profile
Description	Actual spend against budget forecast (Qtr, Year, Phase).
Outcome sought	Actual defrayed expenditure is in line with budget.
Data collector	Lead Partner
Scope	Managing material variances against budget - Progress Reports and Re-Forecasting.
Frequency of data collection	Quarterly
Data items	Grantee name; project name; claim amount; claim date; current budget; forecast budget; quarter end date; year end date (date of report being made in those two cases); phase name
Presentation Format	Bar Chart
Frequency of report	Quarterly

 

Contact