Natural and Cultural Heritage Fund (NCHF) - Round 1 - Monitoring and Evaluation Framework Guidance
Published: September 2020
Date |
Issue |
Status |
Author |
Authorised by |
---|---|---|---|---|
9/01/2019 |
1 |
DRAFT |
EM |
IR |
14/03/2019 |
2 |
DRAFT |
EM |
IR |
20/03/2019 |
3 |
FINAL |
EM |
IR |
18/02/2020 |
4 |
UPDATE |
EM |
- |
17/06/2020 |
5 |
UPDATE |
EM |
- |
15/09/2020 |
6 |
FINAL |
LC |
EM |
Introduction
This note sets out the framework that will be used to monitor and evaluate the success of the Natural and Cultural Heritage Fund Strategic Intervention.
The guidance covers the monitoring, evaluation and reporting that is done by NatureScot for the Strategic Intervention overall and that to be done by grantees for projects which receive funding from us.
When applying for funding, applicants need to summarise in the application form how they will monitor the implementation of their project. Where a project is awarded funding, we will expect a Monitoring & Evaluation Framework to be prepared prior to the contract being signed by us. This should detail how you will evaluate and report the predicted outputs, results and outcomes. This guidance outlines the information that needs to be collected and how it should be reported.
This guidance is based on the Guidance Document on Monitoring and Evaluation, produced by the European Commission for the European Regional Development Fund (ERDF) Programme. It also follows the principles in the Scottish Government’s Monitoring and Evaluation Strategy for the 2014-2020 Scottish Operational Programmes.
This guidance should be followed alongside the Monitoring and Evaluation Plan available in the share file which provides a template which projects may wish to use to manage their framework.
The Scottish Context
National Performance Framework
The Natural and Cultural Heritage Fund Strategic Intervention contributes towards delivering National Outcomes under the Scottish Government’s National Performance Framework, in particular:
- We value, enjoy, protect and enhance our environment
Further information on Scotland’s National Performance Framework is available on the Scottish Government website.
National Surveys
The Office for National Statistics Sustainable Tourism Employment statistics will be used to monitor impact of the Operational Programme. Whilst the source data in the Operational Programme has come from the Office of National Statistics the Managing Authority actually use the Scottish Government statistics which include Sustainable Tourism and has a breakdown by local authority area. These outline the definition of ‘Sustainable Tourism’ and the associated SIC codes.
There are a number of other Scotland-wide surveys which NatureScot will use as part of the assessment of the impact of the Natural and Cultural Heritage Strategic Intervention. These include for example:
- Scottish Household Survey
- Scotland’s People & Nature Survey (SPANS)
- Scotland’s Visitor Survey (Visit Scotland)
NatureScot will be commissioning research to independently gather evidence of the contribution the NCHF has made to support tourism in remote and rural areas across the Highlands and Islands so as to quantify the return on investment across the region.
Why undertake Monitoring and Evaluation?
Through the NCHF investment we are making we want to improve visitor perceptions and create or sustain jobs in remote and rural areas.
The purpose of monitoring and evaluation is to provide evidence of the extent to which we have achieved this. It also allows us to track the management of the funded Projects, the inputs, outputs and results, and the impact that these make both individually and cumulatively.
As the Lead Partner delivering the Strategic Intervention, NatureScot is expected by the EU and the Scottish Government to oversee a programme of monitoring and evaluation that:
- Evidences delivery of the Natural & Cultural Heritage Strategic Intervention in an efficient manner;
- Assesses whether the Natural & Cultural Heritage Strategic Intervention has produced the desired results and what its impact has been; and
- Informs the Scottish Government of the contribution made by the Natural & Cultural Heritage Strategic Intervention towards meeting their National Indicators.
How to plan for Monitoring and Evaluation
All grantees are required to report against a selection of the measures and indicators noted in this guidance. Those that are most appropriate to what the project will deliver should be chosen; it is not necessary to report against all of them. Of course, grantees can design their own additional measures over and above those in this guidance and this is encouraged.
All the measures to be used must be included in the Monitoring, Evaluation and Reporting Framework, to be prepared by all projects which are awarded funding prior to a signed contract being issued by us. The final list of measures is agreed with NatureScot as part of that Framework.
The Monitoring Framework
- Results Indicators – to be reported on by NatureScot using information collected from national surveys and from Grantees.
- Outcome Measures – to be reported on by Grantees for their projects. NatureScot collates the information from all projects in order to report on the outcomes achieved by the Strategic Intervention as a whole.
- Process Measures – to be reported on by NatureScot using information collected from Grantees.
Further detail on each of the indicators is provided below and in the measures definitions in Annexes 2-4.
Result Indicators (reported on by NatureScot)
Results are the overall changes we want to see from the Natural and Cultural Heritage Fund Strategic Intervention. In particular, we want to see a 5% increase in jobs in sustainable tourism across the Highlands & Islands area.
A Result Indicator for this has been agreed with the European Commission (see Table 1) for the Strategic Intervention as a whole. This will be reported by NatureScot, so no action is required from grantees.
Indicator Name | Description | Outcome sought |
---|---|---|
Increase in employment in Sustainable Tourism |
5% increase in baseline value of 26,200 jobs equivalent to a further 1,310 Full Time Equivalent roles.
Source data is ONS business Register and Employment Survey (BRES) |
27,510 jobs in sustainable tourism recorded in the Highlands & Islands by 2023 |
Outcome Measures (reported on by Grantees)
A number of measures have been identified which will help us to monitor and evaluate the intended results (outcomes) for the Natural and Cultural Heritage Fund Strategic Intervention. These are shown in table 2.
No. | Measure Name |
---|---|
Measure 1 (Outcome 3) |
Employment generation - the number of jobs created in delivering your project and then sustained by it in the long term (i.e. not just for the construction or build of the project). This is to be measured by the number of full time equivalent jobs resulting from your project whether through direct employment or in sustaining jobs elsewhere in the community. . |
Measure 2 (Outcome 2) |
Visitor experiences and perceptions are positive - measure of the number of people who have participated in a natural or cultural heritage experience as a result of your project and how they rated their experience. |
Measure 3 (Outcome 01) |
Increase in attendance at heritage events or places of culture or nature - measured by the number of adults who have attended or visited a heritage event or place as a result of your project. |
Measure 4 (Outcome 03) |
Increases in length of tourist season - the extent to which your project helps to extend the tourist season, expand markets, increase footfall or length of stay to one or more remote and rural area(s). |
Measure 5 (Outcome 3) |
New products and services - the extent to which your project offers new products or increases the availability of services to meet customer needs, demands or expectations. |
Measure 6 (Outcome 4) |
Increases in opportunities to spend, see and stay - the extent to which your project provides increased opportunity to spend, see and stay in remote and rural areas contributing to economic growth and social sustainability. This can be measured using visitor survey information on length of stay in the area and estimates of spend. |
Measure 7 (Outcome 3) |
Improved perceptions of local people - benefits perceived by local people who live in your project’s area such as: the percentage of adults who rate that it is a very good place to live and/or has been improved by your project and the extent to which they have been able to contribute to local decisions. |
A description of these outcomes and how they should be monitored and reported on is contained in Annex 3.
Not all of these apply to all projects. The outcome measures which are relevant to each project should be set out in the Monitoring & Evaluation Framework agreed between the grantee and NatureScot. Information and data for each agreed measure will be collected by grantees for their project and reported to NatureScot through the quarterly and final Progress Reports.
The frequency of reporting for each measure will be agreed as part of the Monitoring & Evaluation Framework – some measures require to be reported on each quarter, while others may only require to be reported on by exception or in the final report.
Grantees may, of course, use other measures over and above those we have suggested to monitor progress and evaluate the impact of their project. Alternatively, grantees may use their own existing measures (as well as, or instead of, the menu measures), if they tell a strong story related to the outcomes the Natural and Cultural Heritage Fund Strategic Intervention wishes to achieve. Where grantees propose to use outcome measures other than those defined in Annex 3, then a definition for each additional measure must be completed in a similar format to that used in the annex, along with agreement on frequency and format of reporting. These should also be included in the agreed Monitoring & Evaluation Framework for the project.
Process measures (reported on by NatureScot)
Process measures are used to monitor progress in delivering projects and to report on these individually and collectively. NatureScot will collect information from grantees through quarterly and final Progress Reports (see below).
Lead Partner - Strategic Intervention Process Monitoring
NatureScot’s performance as Lead Partner for the Natural and Cultural Heritage Fund Intervention will be assessed by Scottish Government and the EU against measures such as:
- Application process - customer experience, quality of guidance
- Change Requests – number submitted and time taken to process
- Claims – submission on time and accuracy
- Transactions - compliance and failure rates
- Eligible spend percentage against overall budget
- Customer experience – feedback, complaints and compliments
- Communications activity – success in promoting the Strategic Intervention and compliance with EU and Scottish Government branding requirements
Grantee - Project Management Process Monitoring
Grantees’ performance will be assessed by NatureScot against the following measures, using data collected by NatureScot when processing claims.
- Progress reports submitted on time
- Claims submitted on time
- Claim Return %
- Claim Return rate
- Transaction failure rate
- Claim submission after completion
- Eligible Spend against Budget Forecast
Refer to Annex 4 for the process measure definitions.
We will also gather data from the checklist in the Procurement Aide Memoire, which will be required to be submitted with quarterly claim reports, including:
- Evidence of contract advertising
- Evidence of compliance with contract thresholds
- Evidence of compliant tender procedure
Qualitative Methods
The use of qualitative evidence in monitoring, evaluation and reporting provides a rich source of information to demonstrate the benefits of a project and the outcomes it has achieved. Qualitative evidence can include examples, case studies, surveys, workshop outputs, art pieces, stories, activity reports, first person pieces, digital film diaries, newsletters, plays, and so on. The options are broad ranging and innovation and creativity is encouraged.
The following principles should be considered when planning qualitative monitoring:
Plan ahead:
- Be clear what kind of evidence you want to collect at the planning stage and how it will be used in reporting
- Ensure there is sufficient budget for it and appropriately skilled people to undertake it
- Prepare an implementation plan and share it with participants, so they know what to expect
- Have a framework in place to secure approval from people to use images of them or information about them
Involve people:
- Where possible, get the target audience involved in planning the monitoring and reporting and get them involved in gathering evidence
- Get creative and make it fun – think about what will be compelling when we tell the story of the natural and cultural heritage fund
Reporting
Strategic Intervention - Reporting done by NatureScot
NatureScot is responsible for monitoring progress of all Projects individually and collectively towards delivering the Strategic Intervention’s outcomes and Horizontal Themes:
- Outcome 1: Heritage assets are more accessible and better promoted. Awareness of the distinctive heritage assets of the region is increased, making them more accessible and better understood in ways which are consistent with their sensitive management and sustainable use.
- Outcome 2: The quality of visitor experience to the heritage assets is enhanced. The quality of the experience and products on offer to visitors to the region are enhanced through the provision of good quality, accessible facilities and/or information relating to heritage assets, in ways which fill gaps in provision, disperse benefits and encourage or attract visitors to discover and explore responsibly.
- Outcome 3: New products, services and jobs based on heritage assets are sustained and/or created. New products or services based on the region’s natural and cultural assets are developed, creating and/or maintaining jobs, helping to sustain local populations and benefitting local communities. Projects should contribute to sustainable social and economic growth based on sustainable environmental management and productive economic use of natural and cultural heritage assets.
- Outcome 4: There is co-ordinated promotion and interpretation of heritage assets across the region. Aspects of the distinctive natural and/or cultural heritage of the region (such as Gaelic and the region’s music or textiles) are promoted through innovative digital interpretation projects and interpretative media. This should be done in ways which protect the natural and/or cultural heritage assets being promoted, improve accessibility and information for visitors and expand visitor markets.
- Horizontal Theme 1 - Sustainable development
- Horizontal Theme 2 - Equal opportunities and non-discrimination
- Horizontal Theme 3 - Equality between Men and Women
We will evaluate whether the Strategic Intervention is being delivered on time and on budget. We will also upload quarterly monitoring reports submitted with claims, including nil returns, to EUMIS for each of the Projects.
NatureScot will provide the Managing Authority with an Annual Report on progress with delivering the Strategic Intervention and progress towards meeting targets. This report will also contain a narrative on results under each of the Outcomes and Horizontal Themes and provide evidence on compliance, process management and communications.
Project Reporting - Reporting done by Grantees
Grantees are required to report on all of the chosen measures at appropriate frequencies (see below), as agreed in the Monitoring & Evaluation Framework for their project. For some outputs and results, grantees will be asked to produce qualitative evidence to allow NatureScot to produce a narrative on why and how the Natural & Cultural Heritage Strategic Intervention has worked.
Milestones for the delivery of projects will be identified and agreed between the grantee, NatureScot and Managing Authority. The completion of milestones will be linked to payment claims. Grantees will be required to report the actual progress of implementation of each project against the planned forecast on a quarterly basis as part of completing a Progress Report (whether or not submitting a quarterly claim).
Following the final claim, annual reporting of results is expected by grantees until 2023.
The following table illustrates reporting frequencies:
Report Type |
Frequency |
---|---|
Progress Reports (Output/Result & Delivery Measures) |
Quarterly |
Final Report |
1 month after Project completion |
Annual Reporting of Results |
Following final claim, until 2023 |
Auditable data |
Retain until 2030 |
Quarterly Reporting - Progress Report
Quarterly Progress Reports are required throughout the delivery period for the project. These must be provided on the template provided by NatureScot. These should include a report on progress against the measures agreed in the project’s Monitoring & Evaluation Framework.
Final Report
Grantees will be required to provide a Final Report at the completion of the Project. A template for this will be provided by NatureScot (following a similar format to the Quarterly Progress Reports).
Within 1 month of completion, the following should be provided to NatureScot:
- A final Project report
- A one page ‘case study’ highlight report
- A short digital film for use online and at presentations showcasing the Project: capturing the Project from start to finish – aims, challenges, existing situation, what was done, the end result, people’s perceptions
Annual Monitoring Reports
Grantees are required to provide annual reports starting 1 year after submission of the Final Report through until the end of the monitoring period in 2023. A template for this will be provided by NatureScot.
Auditable Data
Further evidence on the project may be requested up to the end of the EU auditable period (2030).
Use of Reported Information and Format
The data and information collected as part of monitoring progress against the measures may be used by the Lead Partner (NatureScot) and/or Managing Authority (Scottish Government) in reports, case studies and publicity material. Therefore, it is important that grantees ensure all participants and staff that feature in the reporting are aware of this and have given the appropriate consent for their details to be shared. The Scottish Government has created a consent form which Projects can download and use for this purpose (see page 20).
Some of the measures require information in the form of GIS data, photographs and digital film clips. Grantees are required to submit data in these formats to the specifications set out in Annex 1.
Annex 1 - Specifications for GIS data, photographs and digital film
GIS data (applies to Natural and Cultural Heritage Fund grantees where mapping is required)
All GIS data submitted by grantees should be complete with metadata captured to the latest UK GEMINI standard (currently (December 2015) UK GEMINI 2.2). Guidance on the UK GEMINI standard can be found on the website of the Association for Geographic Information, who oversee the standard.
Photographic specification
All photographs commissioned or submitted should be in a digital format (jpg file). Images should be the maximum size that can be achieved by the camera. If we require smaller versions NatureScot can repurpose the file. Each image should have the following metadata (information):
- Image ID
- Title
- Photographer (can be the organisation)
- Short description
- Date taken
- National Grid location
- Permissions
- Copyright
If the images/digital films are to be supplied by freelance professionals then the images should have the requested file metadata tagged to the IPTC field of each image file. If not, then a separate accompanying spread sheet with the metadata will be required.
Please note that there's no routine deleting of images, so once an image is uploaded it will be on the NatureScot Image Library as long as NatureScot support it.
Grantees must give NatureScot the right to use the photographs, transparencies or digital images, including digital film images they provide to us. Grantees must get any permissions, including copyright, needed for these images to be used, including the consent of any persons appearing in them where applicable, before being sent to us and before they are to be used.
Digital Film Specification
All submitted or commissioned digital film clips should be provided digitally as an uncompressed digital film. Digital film clips should be in a format capable of being uploaded to social media, for example through the NatureScot YouTube channel. There is no file size constraint for digital films but ideally they should be filmed at 1080p 25fps. If the digital films are uploaded to YouTube at that size they can be played back at lower resolutions.
As a last resort, where the large size of the digital film files makes it not feasible to email digital film clips, then hard copies will be required either as DVDs or Pen Drives. DVDs or Pen Drives should then be sent to the NCHF Admin Officer. Digital film clips should show the name and organisation (if relevant) of those talking on screen.
Each digital film clip should have the following metadata attached and be contained in a separate accompanying spreadsheet:
- Digital film ID
- Title
- Photographer (can be the organisation)
- Short description
- Date taken
- Permissions
- Copyright
Annex 2 - Result Indicator Definition
This is reported on by NatureScot using information collected from national surveys and from Grantees.
The source data in the OP has come from the Office of National Statistics the Managing Authority actually use the Scottish Government statistics which include Sustainable Tourism and has a breakdown by local authority area. These outline the definition of ‘Sustainable Tourism’ and the associated SIC codes.
Indicator Name | Description | Outcome sought |
---|---|---|
Increase in employment in Sustainable Tourism |
5% increase in baseline value of 26,200 jobs equivalent to a further 1,310 Full Time Equivalent roles.
Source data is ONS business Register and Employment Survey (BRES) |
27,510 jobs in sustainable tourism recorded in the Highlands & Islands by 2023 |
Indicator Name |
INDICATOR A: Increase in employment in Sustainable Tourism |
---|---|
Description |
A record of the number of jobs equivalent to a further 1,310 Full Time Equivalent roles. |
Outcome sought |
Create New or Sustain Existing number of jobs |
Data collector |
Source data is ONS business Register and Employment Survey (BRES) |
Scope |
Funded Projects within the Natural and Cultural Heritage Fund Strategic Intervention |
Frequency of data collection |
Whenever new Projects are agreed |
Data items |
Number of jobs created as a result of NCHF agreed Projects in transition area (Highlands & Islands). |
Frequency of report |
2020, 2023 |
Notes |
“Agreed” Projects mean the contract is let. Target is a further 1,310 Full Time Equivalent roles in HIE areas by 2023 Grantees are not required to report this indicator |
Annex 3 - Outcome Measure Definitions
Outcome Measures – to be reported on by Grantees for their projects. NatureScot collates the information from all projects in order to report on the outcomes achieved by the Strategic Intervention as a whole.
Measure Name |
1: Employment generation |
---|---|
Description |
This relates to the number of jobs created in delivering your project and then sustained by it in the long term. To be measured by the number of full time equivalent jobs resulting from your project whether through direct employment or in sustaining jobs elsewhere in the community. |
Contribution to Outcomes |
New products, services and jobs based on heritage assets are sustained and/or created (Outcome 3) |
Data collector |
Source data is ONS business Register and Employment Survey (BRES) The source data in the OP has come from the Office of National Statistics the Managing Authority actually use the Scottish Government statistics which include Sustainable Tourism and has a breakdown by local authority area. These outline the definition of ‘Sustainable Tourism’ and the associated SIC codes. |
Scope |
This measure includes a record of the number of jobs equivalent to full time equivalent roles. It can identify jobs that your project has contributed to supporting including sustainable tourism roles and other types of jobs across a range of industries. |
Frequency of data collection |
To be agreed with the Lead Partner |
Data items |
Planned and actual number of new or sustained jobs within remote and rural areas. |
Presentation Format |
Using GIS, Grantees should estimate the impact of the Project on job creation. The different types of jobs and the geographical proximity of where these are. |
Frequency of report |
To be agreed with the Lead Partner |
Measure Name |
2: Visitor experiences and perceptions are positive |
---|---|
Description |
This relates to the number of people who have participated in a natural or cultural heritage experience as a result of your project, their perception and how they rated their experience. |
Contribution to Outcomes |
Heritage assets are more accessible and better promoted The quality of visitor experience to the heritage assets is enhanced There is co-ordinated promotion and interpretation of heritage assets across the region (Outcomes 1, 2 and 3) |
Data collector |
Grantee (via onsite or online survey) |
Scope |
This measurement includes visitor perception. The Grantee must demonstrate that the visitor awareness of the distinctive heritage assets of the region is increased and better understood. Assets should be more accessible and encourage or attract visitors to discover and explore responsibly. |
Frequency of data collection |
To be agreed with the Lead Partner |
Data items |
Number of visitors with an improved perception of the quality of provision. Number of people by month or year. Customer rating or visitor perception scores. Awareness and understanding of heritage assets. Accessibility numbers and number of outputs that have been added to increase accessibility. |
Presentation Format |
Evidence that the visitor perception of their experience is positive. Evidence that the site accessibility has been improved. Evidence of the quality of the site before the start of works may include photographs that illustrate the quality of the site before and after the works. Evidence that the visitor perception of the visitor provision is improved in terms of quality and accessibility Evidence that visitor awareness and understanding of the heritage assets are improved. |
Frequency of report |
To be agreed with the Lead Partner |
Measure Name |
3: Increase in attendance at cultural or natural heritage events or places of culture and nature |
---|---|
Description |
This relates to an increase in the number of adults who have attended or visited a heritage event or place as a result of your project. |
Contribution to Outcomes |
Heritage assets are more accessible and better promoted (Outcome 1) |
Data collector |
Grantee (via onsite counter or online tickets) |
Scope |
The measurement includes demonstration of an increase in participation or attendance. |
Frequency of data collection |
To be agreed with the Lead Partner |
Data items |
Evidence of participation or attendance |
Presentation Format |
For the final report, a pdf A4 map should be provided, showing the Project boundary, the opportunity created or improved and the asset that has been made more accessible. |
Frequency of report |
To be agreed with the Lead Partner |
Measure Name |
4: Increases in length of tourist season |
---|---|
Description |
This relates to the extent to which your project helps to extend the tourist season, expand markets, increase footfall or length of stay to one or more remote and rural area(s). |
Outcome sought |
New products, services and jobs based on heritage assets are sustained and/or created (Outcomes 3) |
Data collector |
Grantee |
Scope |
This measurement unit includes the contribution your project makes to extend the tourist season, expand markets, increase footfall or length of stay to one or more remote and rural area(s). |
Frequency of data collection |
To be agreed with the Lead Partner |
Data items |
Number of visitors to one or more remote and rural area(s). Length of stay to one or more remote and rural area(s). Number of businesses supported by the contribution your project. Evidence of the contribution your project has made to extend the tourist season or expand markets. |
Presentation Format |
- specify the number of visitors to one or more remote and rural area(s). - specify the increase in the length of visitor stay -specify the extent to which your project has contributed to extending the tourist season or expanding markets |
Frequency of report |
To be agreed with the Lead Partner |
Measure Name |
5: New products and services based on heritage assets |
---|---|
Description |
This measure relates to the extent to which your project offer new products or increase the availability of services to meet customer needs, demands or expectations. |
Outcome sought |
New products, services and jobs based on heritage assets are sustained and/or created: New products or services based on the region’s natural and cultural assets are developed, creating and/or maintaining jobs, helping to sustain local populations and benefitting local communities. Projects should contribute to sustainable social and economic growth based on sustainable environmental management and productive economic use of natural and cultural heritage assets. (Outcome 3) |
Data collector |
Grantee |
Scope |
The measurement unit includes the new products or services based on the region’s natural and cultural assets. It includes the opportunities your project creates to help sustain local populations and benefit local communities. The measurement unit includes the provision of good quality, accessible facilities and/or information relating to heritage assets and how your project is contributing to sustainable social and economic growth based on sustainable environmental management and productive economic use of natural and cultural heritage assets. This may include:
The data should be collected to enable the protected characteristics relevant to the community to be monitored, including:
|
Frequency of data collection |
To be agreed with Lead Partner |
Data items |
Number of new products or increased availability of services to meet customer needs, demands or expectations. Number of visitors engaged through events/activities and/or volunteering opportunities. |
Presentation Format |
For reporting, grantees should describe the method they plan to use for providing evidence of a new product or an increase in availability of a service. For example to demonstrate increase in the availability of new services indicate participation records, headcounts, registration sheets, number of hits on website, certificates issued. Grantee may consider reporting on the following:
Grantees may also wish to provide a photograph storyboard for key events and activities. |
Frequency of report |
Quarterly |
Measure Name |
6: Increases in opportunities to spend, see and stay |
---|---|
Description |
This relates to the extent to which your project provides increased opportunity to spend, see and stay in remote and rural areas contributing to economic growth and social sustainability. This can be measured using visitor survey information on length of stay in the area and estimates of spend. |
Outcome sought |
Heritage assets are more accessible and better promoted : Awareness of the distinctive heritage assets of the region is increased, making them more accessible and better understood in ways (Outcome 1 ) |
Data collector |
Grantee (via Local authority open space audit, strategy or similar) |
Scope |
This measure includes demonstration of an increased opportunities to spend, see and stay in remote and rural areas |
Frequency of data collection |
To be agreed with the Lead Partner |
Data items |
This can be measured using visitor survey information on length of stay in the area and estimates of spend. |
Presentation Format |
Evidence of visitor information on footfall, length of stay and spend. |
Frequency of report |
To be agreed with the Lead Partner |
Measure Name |
7: Improved perceptions of local people - |
---|---|
Description |
This relates to the quality of the experience and products on offer to visitors and how people living close to the area of the Project perceive their local neighbourhood. It relates to the benefits perceived by local people who live in your project’s area such as the percentage of adults who rate that it is a very good place to live and/or improved by your project and the extent to which they have been able to contribute to local decisions. |
Outcome sought |
The quality of visitor experience to the heritage assets is enhanced: The quality of the experience and products on offer to visitors to the region are enhanced through the provision of good quality, accessible facilities and/or information relating to heritage assets, in ways which fill gaps in provision, disperse benefits and encourage or attract visitors to discover and explore responsibly. New products, services and jobs based on heritage assets are sustained and/or created: New products or services based on the region’s natural and cultural assets are developed, creating and/or maintaining jobs, helping to sustain local populations and benefitting local communities. Projects should contribute to sustainable social and economic growth based on sustainable environmental management and productive economic use of natural and cultural heritage assets. Outcome 2 & 3 |
Data collector |
|
Scope |
This measurement unit includes the contribution your project makes to extend the tourist season, expand markets, increase footfall or length of stay to one or more remote and rural area(s). |
Frequency of data collection |
To be agreed with the Lead Partner |
Data items |
Percentage of people living within 300m of the Project who state they are either satisfied or fairly satisfied with the quality of the visitor provision, visitor experience and products on offer to visitors and how people living close to the area of the Project perceive their local neighbourhood.
Percentage of people living within 300m of the Project who state they have been able to contribute to local decisions. |
Presentation Format |
Information from people involved in and benefitting from the heritage projects may be collected through: door to door surveys; feedback from community organisations; personal case studies etc. |
Frequency of report |
To be agreed with the Lead Partner |
Annex 4 - Process Measure Definitions
NatureScot as Lead Partner will collate the data outlined in this annex from the Progress Reports and Annual Reports submitted by Grantees.
Measure Name |
1: Progress reports on time |
---|---|
Description |
The % of progress reports by grantee, submitted by deadline. |
Outcome sought |
Progress Reports to be submitted from the first relevant quarter end by each Project whether expenditure has occurred or not and on time to avoid delay submitting batched claims to the Scottish Government by the Lead Partner. |
Data collector |
Lead Partner |
Scope |
Relates to all approved Project Progress Reports. |
Frequency of data collection |
Quarterly |
Data items |
Count of progress reports; date submitted; due date; calculation comparing due date with date submitted |
Presentation Format |
Bar chart |
Frequency of report |
Quarterly |
Measure Name |
2: Claims submitted on time |
---|---|
Description |
The % of eligible claims submitted on time to Lead Partner. |
Outcome sought |
Grantees submit claims per the agreed budget and per the agreed timeline. |
Data collector |
Lead Partner |
Scope |
All approved Project claims. |
Frequency of data collection |
Quarterly |
Data items |
Date claim submitted; due date; grantee name; project name; claim id; reason for non-submission of claim |
Presentation Format |
Bar chart |
Frequency of report |
Quarterly |
Measure Name |
3: Claim return % |
---|---|
Description |
The % of claims that have to be returned to the grantee by the Lead Partner. |
Outcome sought |
No claims returned by Lead Partner. |
Data collector |
Lead Partner |
Scope |
All approved Project claims. |
Frequency of data collection |
Quarterly |
Data items |
Claims received; Grantee name; Project name; date submitted; date returned; reason for return |
Presentation Format |
Bar chart |
Frequency of report |
Quarterly |
Measure Name |
4: Claim return rate |
---|---|
Description |
The number of times any one claim has to be returned to the grantee by the Lead Partner for correction. |
Outcome sought |
No claim returns. |
Data collector |
Lead Partner |
Scope |
All approved Project claims. |
Frequency of data collection |
Quarterly |
Data items |
Claim ID; date claim made; date returned; reason for return; Grantee name; Project name |
Presentation Format |
Bar chart |
Frequency of report |
Quarterly |
Measure Name |
5: Transaction audit check failure rate |
---|---|
Description |
The number of transactions that fail the Lead Partner audit and compliance check. |
Outcome sought |
100% compliance with no failure rate. |
Data collector |
Lead Partner |
Scope |
All approved Project claims. |
Frequency of data collection |
Quarterly |
Data items |
Claim Id; grantee name; project name; claim date submitted; pass/fail; date of pass/fail; reason for fail |
Presentation Format |
Bar chart |
Frequency of report |
Quarterly |
Measure Name |
6: Claim submission after completion |
---|---|
Description |
The % of claims left outstanding more than 6 months after the Project is complete. |
Outcome sought |
No claims submitted after completion. |
Data collector |
Lead Partner |
Scope |
Relates to all approved Project claims. |
Frequency of data collection |
Quarterly |
Data items |
Total number of claims; Grantee name; Project name; date submitted; end date of Project |
Presentation Format |
Bar chart |
Frequency of report |
Quarterly |
Measure Name |
7: Expenditure profile |
---|---|
Description |
Actual spend against budget forecast (Qtr, Year, Phase). |
Outcome sought |
Actual defrayed expenditure is in line with budget. |
Data collector |
Lead Partner |
Scope |
Managing material variances against budget - Progress Reports and Re-Forecasting. |
Frequency of data collection |
Quarterly |
Data items |
Grantee name; project name; claim amount; claim date; current budget; forecast budget; quarter end date; year end date (date of report being made in those two cases); phase name |
Presentation Format |
Bar Chart |
Frequency of report |
Quarterly |
Contact
Disclaimer: Scottish Natural Heritage (SNH) has changed its name to NatureScot as of the 24th August 2020.
At the time of publishing, this document may still refer to Scottish Natural Heritage (SNH) and include the original branding. It may also contain broken links to the old domain.
If you have any issues accessing this document please contact us via our feedback form.