Strategy monitoring plan 2014-15
Jump to navigation
Jump to search
 |
Strategy |
| Strategy
Operational | |
Measures and targets table
In this operational table, each of the measures listed defines a Key Performance Indicator (KPI) for the charity, and will be tracked and reported on quarterly. All KPIs that can realistically have numerical targets should have them. Some KPIs can be measured numerically but not realistically targeted, while yet others are amenable only to a best-judgement evaluation (that we call an 'eval score') or are qualitatively assessed using a narrative. Narratives are useful in addition to hard numbers as they enable us to 'tell the story' of our impact.
The various KPIs for each Outcome, when taken together, can give us a qualitative indication of what the charity's impact is against each Outcome.
See below for referenced definitions [n].
See Strategy monitoring plan/Outcomes 2014-15 for links to the quarterly published KPI reports in 2014-15 activity year.
| G1.1 The quantity of open knowledge continues to increase | Number of uploads | Measure to be tracked and reported, but no annual target since number could vary wildly. Dependent on people using the 'Supported by Wikimedia UK' category on Commons. Includes uploads from Wiki Loves Monuments. | |||
| Sum of positive edit size (1) | Measure to be tracked and reported, but no annual target since number could vary wildly | ||||
| G1.2 The quality of open knowledge continues to improve | Percentage of WMUK-related files (e.g. images) in mainspace use on a Wikimedia project (excluding Commons) | May be influenced by higher usage of Mass Upload tool. Use of images in articles is taken to indicate improvement to those articles and/or as an indicator of image quality. | |||
| Number of files (e.g. images) that have featured status on a Wikimedia project (including Commons) | |||||
| Number of files having quality image status on Commons | Reminder: image donations from institutions cannot be tagged as 'quality image'. Most of the images from 2013-14 came from Wiki Loves Monuments | ||||
| Number of files having valued image status on Commons | Reminder: can be content from institutions or individual volunteers | ||||
| Number of new articles started on a Wikimedia site (eg any of the encyclopedias), excluding Welsh Wicipedia | New articles can be taken as a sign of quality rather than quantity. In the longer term we are looking at a more sophisticated tool to track article quality. | ||||
| Number of new articles started on Welsh Wicipedia inspired by WMUK |
Includes Living Paths! and pages created as a result of content releases | ||||
| G1.3 We are perceived as the go-to organisation by UK GLAM, educational, and other organisations who need support or advice for the development of open knowledge. | Sum of reputation ratings (2) of organisations that we are working in partnership with, or were working with no more than two years ago | ||||
| Awareness score in annual national survey of public opinion (12) | Survey questions to be determined in 2014. New initiative - will identify baseline in 2014 | ||||
| G2a.1 We have a thriving community of WMUK volunteers. | Number of friends | We consider that increasing our active volunteer base, and our number of friends, to be more important than increasing the numbers who are formal members of the charity. | |||
| Number of volunteers (3) | |||||
| Number of leading volunteers (3a) | |||||
| Number of activity units (4) | |||||
| Number of leading activity units (5) | |||||
| Leading volunteer (3a) drop out rate (7) | |||||
| G2a.2 WMUK volunteers are highly diverse. | Proportion of activity units (4) attributable to women | ||||
| Proportion of leading activity units (5) attributable to women | |||||
| Activity units (4) in activities to encourage other diversity or minority engagement | |||||
| G2a.3 WMUK volunteers are skilled and capable. | Activity units (4) in training sessions and editathons (total count, including people being trained) | ||||
| Leading activity units (5) in training sessions and editathons (ie trainers only) | |||||
| Annual survey capability score (6) (self-identified) | To do: Questions and score measure to be devised | ||||
| G2b.1 We have effective and high quality governance and resource management processes, and are recognised for such within the Wikimedia movement and the UK charity sector. | Progress on targets in the Hudson and Chapman governance reviews | ||||
| Progress towards PQASSO 2 | |||||
| Level of external recognition | |||||
| G2b.2 We have a high level of openness and transparency, and are recognised for such within the Wikimedia movement and the UK charity sector. | Transparency score (9) as measured by annual survey | To do: Survey questions to be determined in 2014. New initiative - will identify baseline in 2014. | |||
| Transparency compliance (10) as determined by Govcom against published transparency commitments | |||||
| G2b.3 We have high quality systems to measure our impact as an organisation. | Progress towards full implementation of automated and manual tracking/measuring systems (8) | ||||
| G2b.4 We ensure a stable, sustainable and diverse funding stream. | Number of separate donors | ||||
| Funds received from sources other than WMF fundraiser or FDC | |||||
| Proportion of funds from sources other than WMF fundraiser or FDC | |||||
| Proportion of funds from direct debits | |||||
| G3.1 Access to Wikimedia projects is increasingly available to all, irrespective of personal characteristics, background or situation. | Total number of scans of QRpedia codes (11) | ||||
| Projects addressed at new readers (16) being enabled to access Wikimedia websites | It is often not possible to determine the number of people we enable to become readers of the Wikimedia projects, so instead we put a target on activities, for example the number of Kiwix installations. | ||||
| G3.2 There is increased awareness of the benefits of open knowledge. | Awareness score (12) in annual national survey of public opinion | Survey questions to be determined. New initiative - will identify baseline in 2014 | |||
| G3.3 Legislative and institutional changes favour the release of open knowledge. | Responses to EU and UK government policy consultations. | ||||
| Involvement in EU and UK advocacy activities; Involvement in advocating legislative change within GLAM, Education, and other organisations | |||||
| G4.1 There are robust and efficient tools readily available to enable the creation, curation and dissemination of open knowledge. | Number and availability of the project tools we host or support | ||||
| G4.2 There are robust and efficient tools readily available to allow WMUK - and related organisations - to support our own programmes and to enable us to effectively record impact measures. | Uses (15) of the internal or supporting tools we host or support | civiCRM, QRpedia stats, VLE stats | |||
| G5.1 A thriving set of other Wikimedia communities | Funding to support other chapters and Wikimedia groups | ||||
| Activities held for or jointly with other chapters and Wikimedia groups | |||||
| Total shared activity units (13) in shared activities (14) with other chapters and Wikimedia groups | |||||
| Number of UK based Wikimedia events other than WMUK events | Events that are known to us and which are noted on our 'Upcoming Events' list | ||||
| G5.2 An increased diversity of Wikimedia contributors | Activities specifically directed to supporting the diversity of other chapters and Wikimedia groups | 1 in 2013 (Diversity Conference) | |||
| G5.3 Wikimedia communities are skilled and capable. | Activities specifically directed to help train or to share knowledge with other chapters and Wikimedia groups | 1 in 2013 (Chapters Conference) | |||
| G5.4 Open knowledge communities with missions similar to our own are thriving. | Number of shared activities (14) hosted with groups or organisations having similar goals to WMUK | Any organisations having similar goals to Wikimedia UK. Organizations might include for example Mozilla, Open Rights Group, Open Knowledge Foundation, Open Street Map and so on. | |||
| Total shared activity units (13) in shared activities (14) hosted with groups or organisations having similar goals to WMUK |
Notes and Definitions
| Ref | Term | Definition | Notes | |
| (1) | Positive edit size | Sum of edit sizes in characters where text content has been added overall to the mainspace of a Wikimedia wiki. | We are here measuring quantity not quality of educational text content. We ignore all edits where content has been deleted overall, on the basis that deletions cannot generally be equated with the negative addition of content by that editor. We are aware that such an approach is relatively broad-brush, and will actively seek improved tools/measures in this area. | |
| (2) | Institution reputation rating | Our estimate of the external reputation of each GLAM, education organisation or learned society that we work with. | This information is solely to enable us to track our own charitable impact consistently, and we will not be publishing the values we use for individual organisations | |
| (3) | WMUK volunteer | WMUK activities and volunteers#WMUK volunteers | ||
| (3a) | Leading volunteer | WMUK activities and volunteers#WMUK leading volunteers | ||
| (4) | Activity unit | WMUK activities and volunteers#Activity units | ||
| (5) | Leading activity unit | WMUK activities and volunteers#Leading activity units | ||
| (6) | Annual survey capability score | To be defined | Questions to be written | Proposed survey to be repeated annually by WMUK |
| (7) | Leading volunteer drop out rate | The proportion of our leading volunteers volunteers that drop out (no longer remain actively engaged with us) annually | Determined for each volunteer one year after first activity, two years and so on. | |
| (8) | Tracking/measuring systems | The manual and automated systems by which WMUK tracks outputs/outcomes in accordance with the strategic plan | ||
| (9) | Transparency score | To be defined | Questions to be written | Proposed survey to be repeated annually by WMUK |
| (10) | Transparency compliance | As measured by Govcom against published transparency commitments | Commitments to be defined | |
| (11) | Scans of QRpedia codes | The number of times QRpedia codes are used to direct to a Wikipedia article | This a is a subset of (15) | |
| (12) | Awareness score | To be defined | Questions to be written | Proposed survey to be repeated annually by WMUK |
| (13) | Shared activity units | A count of the number of units contributed by volunteers (not necessarily WMUK volunteers) on shared activities (14) | With technology-based groups or organisations having similar goals to WMUK | |
| (14) | Shared activities | Activities that WMUK jointly lead with some other group | Does not include activities run by other groups that WMUK volunteers or staff simply attend or engage with. Depending on context, the other group could be Wikimedia-related (eg a chapter) or could be external to the Wikimedia movement (eg OpenStreetMaps) | |
| (15) | Uses of tools | The number of times in aggregate a WMUK tool is used. | ||
| (16) | Eval measure | A best-judgement evaluation on a scale of 1 to 5 (5=best) | Used in lieu of a objective metric where such a metric is impossible or currently impracticable to obtain | |
| (18) | WMUK activity | WMUK activities and volunteers#WMUK activity |