Digital health literacy evaluation starts by defining the skill or perception your community nursing research will examine. Distinguish reported confidence from observed task performance, then select a justified measure and document administration, scoring and missing responses.
Understanding Digital Health Literacy
Digital health literacy encompasses the skills and knowledge required to search for, understand, and use health information from digital sources. It is not merely about accessing information but involves critically evaluating the quality of that information and applying it in everyday health-related scenarios.
Operational Definitions of Digital Health Literacy
When discussing digital health literacy, it is crucial to have operational definitions in place. These definitions vary significantly based on context and demographic specifics. Key components often include technical skills, critical appraisal of information, and the ability to use digital tools efficiently to improve personal health.
Perceived Confidence versus Task Performance
One significant area of digital health literacy evaluation is the discrepancy between perceived confidence and actual task performance. For instance, a participant may express high confidence in navigating health websites but may struggle to identify credible sources. This divide can lead to overestimation of an individual’s capabilities, complicating efforts to assess true digital health literacy.
Selecting and Documenting an Instrument
When measuring digital health literacy, selecting the right instrument is imperative. Various tools exist, each offering a unique perspective on health literacy. Among these, the eHealth Literacy Scale (eHEALS) stands out as a widely used instrument, which assesses perceived skills.
Overview of eHEALS
Norman and Skinner (2006) describe eHEALS as an eight-item self-report measure of perceived eHealth skills. Their original study does not establish that a score measures observed performance in every community nursing population. If actual task completion is your question, justify a suitable performance approach rather than treating perceived skill as a substitute.
Limitations of eHEALS
eHEALS answers a question about perceived skills. Whether to combine it with another method depends on the research question, available evidence and approved design. A multimethod study is not automatically required. Any adaptation or new scoring approach needs an explicit rationale and should not be presented as the original validated instrument.
Check whether the selected score answers the literacy question
A respondent can interpret every questionnaire item as intended while still finding online information difficult to judge. Conversely, an unclear item can produce a low self-rating that reflects wording rather than the intended construct. Record these as different measurement questions. Evidence about item comprehension supports interpreting the response process; it does not supply an observed literacy score.
For a fictional community nursing study, specify whether the outcome is perceived confidence, performance on a defined information task, or both. If both are collected, report them separately before examining their relationship. Do not subtract an observed task total from a confidence score: the units and scales may differ. An apparent mismatch should become an interpretation question with stated limits, rather than a label that a participant overestimated their abilities.
Use the dedicated cognitive interviewing guide for interview planning and neutral probes. Here the decision is which construct the measure represents and whether that interpretation fits the dissertation question.
Approved Accessible Administration
Plan accessible administration through the appropriate project arrangements. Record language, format and assistance offered, and explain how any change may affect interpretation or comparability. Accessibility support should not silently change what the measure is intended to examine.
Strategies for Accessibility
- Simplified Language: Using clear, concise language in surveys can help participants better understand the questions.
- Translation Services: Providing translated materials ensures non-English speakers can participate effectively.
- Digital Tools: Utilizing assistive technologies can facilitate participation for individuals with disabilities.
Documentation of Accessibility Measures
When designing a research study, it is essential to document how accessibility has been considered and implemented. This not only aids in reproducibility but helps to demonstrate commitment to inclusivity.
Missingness in Data Collection
Missing data can significantly impact the integrity of research findings. It is crucial to anticipate and plan for potential missingness in digital health literacy assessments.
Common Reasons for Missing Data
- Participant Drop-Out: Participants may feel overwhelmed or disinterested.
- Technical Issues: Challenges with digital tools may prevent completion.
- Misinterpretation of Questions: Misunderstandings can lead to non-responses.
Transparent Scoring and Reporting
Clarity in scoring methods and reporting results is essential for research credibility. Researchers should aim for transparency in how scores are calculated and what they represent.
Best Practices for Scoring
- Standardised Scoring Systems: Implementing standard methods for scoring responses can enhance consistency.
- Clear Reporting Guidelines: Researchers should outline scoring methods in publications to allow for peer verification.
Sample Reporting Table
| Approach | What it examines | Important limit |
|---|---|---|
| eHEALS | Self-reported perceived eHealth skills | Not direct observation of task performance |
| Cognitive interviewing | How participants interpret questions and response options | Not automatically a performance test |
| Defined task observation | Performance on the specified task under recorded conditions | Not proof of ability across every digital task |
Worked Example 1: Evaluating Wound Care Instruction Online
Consider a fictional scenario where a nurse researcher devises a study to assess how adults use online resources for wound care. One participant, Alex, confidently claims proficiency in navigating websites for health information. However, upon questioning, it becomes apparent that Alex cannot distinguish between commercial claims and official health advice. This highlights a significant gap between perceived digital health literacy and actual abilities.
Conversely, another participant, Jamie, feels uncertain about navigating online resources but exhibits exceptional skills by critically evaluating sources before accepting them as valid. This illustrates how different constructs can provide a fuller picture of digital health literacy.
Worked Example 2: Assessing Information for Chronic Conditions
In a further fictitious study, a researcher explores digital health literacy among individuals managing chronic conditions. One participant may express confidence in using apps to track medications yet misinterpret a user tutorial, leading to ineffective use. Meanwhile, another participant demonstrates hesitance with digital tools but compensates with thorough research, actively seeking reliable information about their condition.
These examples highlight the importance of not solely relying on self-reported confidence but considering an individual’s demonstrated skills and behaviours.
Checklist for Evaluating Digital Health Literacy
When planning a study on digital health literacy, the following checklist can be helpful:
- Define your operational definitions: Clarify what digital health literacy entails for your research.
- Select instruments carefully: Choose measures justified by the construct and approved study design.
- Pilot your instruments: Conduct a trial run to assess the clarity and effectiveness of your methodologies.
- Ensure accessibility: Adapt materials for diverse participant needs.
- Implement cognitive interviews: Consider this method when item interpretation is an unresolved measurement question.
- Plan for missing data: Anticipate potential issues and document strategies to mitigate them.
- Establish transparent scoring: Decide on the scoring method before data collection begins.
- Document your procedures: Keep thorough records of your methodologies for future reference.
Digital health literacy: build a measurement decision record
Begin with a one-sentence decision that the study needs to inform. For example, you might want to understand whether adults feel able to judge online wound-care information. That is different from testing whether they can operate a particular appointment system. Write the decision beside the research objective before choosing a questionnaire. Then list what evidence would actually answer it. A confidence score, a description of searching behaviour and an observed navigation task offer different kinds of information. None becomes the correct measure simply because it produces a convenient numerical result.
Next, create a short decision record for the instrument. Include the construct, population, language, mode of administration, scoring instructions and intended interpretation. Record where each decision comes from. If you cannot locate the relevant documentation, label the issue unresolved rather than reconstruct a scoring rule from a secondary blog. This record helps a supervisor understand why the tool fits the question. It also makes later changes visible. Keep the original instrument and the version actually administered clearly separated so that a reader can identify what participants encountered.
Keep digital health literacy tasks separate from clinical judgement
A task-based exercise needs a defined boundary. You might ask a fictional participant to locate the publication date on a demonstration webpage or identify who produced it. You should not ask them to make a treatment decision merely to produce a research score. Use materials and procedures approved for the project, and decide how to respond if a task raises an actual concern. This is a study-planning distinction: the purpose is to examine interaction with information, while clinical care remains subject to the service’s usual responsibilities and professional processes.
For each proposed task, write what counts as completion and what assistance is permitted. Consider whether the task tests the construct you intended. Someone who cannot read a small screen may need an accessibility adjustment rather than a low appraisal score. Another person might navigate rapidly but fail to notice the source. Therefore, keep navigation, understanding and evaluation visible in your notes. If you combine them into one total, explain the rationale and the limits. A home-made total should not be presented as a validated diagnostic category.
Worked example: two different interpretations of the same answer
Fictional planning example: a participant agrees with the statement that they know where to find useful online health information. During an approved comprehension discussion, they explain that a relative usually sends them a link. Their answer may reflect confidence in obtaining help, rather than independent searching. The response is not automatically dishonest or incorrect. The important question is whether the instrument and your research objective use the same meaning. Preserve the explanation and consider how the role of assistance should be described.
Now imagine a second person who disagrees with the same statement because they worry about recognising misleading information. They can identify an official organisation, check the date and explain why a commercial page may require caution. Their modest self-rating does not establish poor performance. In the dissertation, the appropriate response is to discuss the distinction between perceived ability and the task observed. Do not change their questionnaire answer to match your judgement. If both data sources are collected, retain their separate records and explain how the comparison addresses the question.
Plan administration before comparing groups
Mode differences deserve attention before analysis. Reading an item aloud, translating it informally, explaining a technical term or letting a supporter answer can change the conditions under which a response is obtained. That does not mean support must be withheld. Instead, plan accessible administration through the approved process and document what happened. Make clear whether a participant chose their own response, received navigation assistance or had someone respond on their behalf. These are different arrangements and should not be hidden under a single label such as “help provided”.
A comparison between two groups also needs a reason grounded in the objective. Do not add every demographic variable simply because the dataset contains it. Ask whether the measure has a defensible interpretation in each group and whether the sample supports the proposed comparison. Small categories may create unstable summaries or identification concerns. An appropriate report might describe the pattern and its limitations without making a population-wide claim. The analysis plan should explain these boundaries before a striking result encourages a stronger conclusion than the design permits.
Handle incomplete responses without inventing meaning
A blank item can have several explanations. A person may not understand the wording, may not use the relevant resource, may prefer not to answer or may experience an interruption. Record what is known and avoid treating an unrecorded reason as a fact. Keep “not applicable”, “do not know”, refusal and technical failure distinct where the approved data structure allows it. Follow the instrument’s documented missing-item instructions. Do not automatically replace a missing response with the midpoint or calculate a total that its scoring rules do not support.
In a planning document, include an example of an incomplete response and show the intended handling decision. Explain who will check the rule and where the decision will be recorded. If the project is literature-based, extract the original study’s handling of missing data instead of pretending to reanalyse unavailable records. Ask whether omissions could affect the interpretation of the reported scores. This gives the limitation a concrete meaning: it identifies which participants or experiences may be less visible, rather than merely stating that “missing data were a limitation”.
Write a defensible digital health literacy results paragraph
A useful reporting paragraph identifies the instrument or task, the relevant sample, the summary and the interpretation boundary. For example, describe a questionnaire as measuring perceived ability where that is its purpose. Explain the administration mode and any departures from the planned procedure. Keep observed task descriptions separate from self-reported confidence. If the two sources differ, state the difference neutrally. The finding may support a question for discussion; it does not justify labelling a person incapable or assuming they cannot participate in their own care.
Finally, connect the interpretation to the original objective. If the project concerns judging information sources, do not conclude that the nursing service needs a different booking platform. That is a separate service-design question. Recommendations should follow the actual evidence and remain proportionate to what the study can establish. Use the broader digital-exclusion guide for access context. For feedback on your own measurement rationale, use community nursing dissertation support and follow your university’s rules on external assistance.
Frequently asked questions
Does eHEALS measure actual task performance?
It measures perceived eHealth skills through self-report. A high score should not be described as proof that someone can complete a particular online task. If performance is the question, justify an appropriate task-based method and explain what assistance was available.
Can confidence and performance disagree?
Yes. A fictional participant might feel confident while struggling with one task, or complete it successfully while reporting little confidence. Preserve that distinction in the results. Do not use a mismatch to label the person incapable or to infer a clinical outcome.
Can I change questionnaire wording?
Any change needs a rationale and a clear description. Modified wording or response options may change interpretation, so do not automatically claim the original measurement properties. Follow instrument requirements and your project’s approved arrangements.
How should missing answers be reported?
Describe the number and pattern of missing responses and apply a justified scoring approach. Do not assume that a missing answer represents low ability. Distinguish a skipped item, administration difficulty and an incomplete task where the information allows.
What should my dissertation report?
Report the construct, population, instrument or task, administration, assistance, scoring and limitations. Explain whether findings concern perceived confidence, observed performance or both. The level of detail should let readers understand what was actually measured and what remains uncertain.
Review your measurement argument
Your measurement chapter should leave the reader able to name the construct and distinguish it from a neighbouring construct. Check whether the result you describe is a perception, an interpretation of wording or performance on a defined task. Then check whether the discussion preserves that distinction. If it changes from confidence to competence without additional evidence, narrow the claim. The fictional examples above illustrate reasoning rather than findings about real participants. Take your instrument choice, scoring plan and unresolved interpretation questions to your supervisor before the project proceeds.
For the wider topic, read How to Analyse Digital Exclusion in a Community Nursing Dissertation. Explore the nursing dissertation resource hub for related guidance, or compare the available dissertation support services with your learning needs.
Students seeking help with community nursing research design can review our community and public health nursing dissertation support. Use the contact page to ask about educational feedback within your university’s rules. Support does not replace your own analysis, confer project approval or guarantee a grade.
References
Norman, C.D. and Skinner, H.A. (2006) ‘eHEALS: The eHealth Literacy Scale’, Journal of Medical Internet Research, 8(4), e27. Available at: doi:10.2196/jmir.8.4.e27 (Accessed: 16 October 2026).
