Evidence-Based Practice and Critical Appraisal in Healthcare HS3022

Assessment Type

Written Assignment

Description

In this assessment, you are required to critique a systematic literature review using short answer questions adapted from the JBI Checklist for Systematic Reviews and Research Syntheses (JBI 2020). You will also use GenAI to generate an initial critique of the systematic review, which you will then evaluate for accuracy.

Your task is to critique the systematic review using the adapted questions from the JBI checklist and provide a review of the GenAI-generated critique. Whether GenAIs responses contain errors or not, you must demonstrate a clear understanding of the systematic review and provide evidence-based answers to the questions that are supported by further reading (references).

Steps for Completing the Assessment:

Step 1: Read the Provided Systematic Review

Access the Article:Download the systematic review article provided on the Canvas site under "Assignments

Familiarise yourself:Carefully read and understand the article, focusing on key elements such as the research question, inclusion criteria, search strategy, sources of information, critical appraisal, data extraction, methods, publication bias and recommendations.

You will need a strong understanding of the review publication to critique it thoroughly using the questions adapted from the JBI Checklist.

Step 2: Understand the questions adapted from the JBI Checklist:

Download the Assessment Template: Access and download the assessment template provided on Canvas. Review the short answer questions that you will need to answer.

Review the JBI Checklist:If there are any questions from the template that you do not understand, refer to the explanations provided in the JBI Checklist for Systematic Reviews and Research Syntheses (JBI 2020; provided below in CANVAS). This will help you interpret and apply the checklist questions accurately to the systematic review.

Step 3: Use GenAI to Generate an Initial Critique

Access GenAI:Log into the GenAI platform and upload your chosen systematic review.

Ask GenAI to Answer the JBI Questions:Use specific prompts to ask GenAI to generate responses to each question from the JBI Checklist. For example, you can ask:

o"Critique the research question in this systematic review ."

o"Evaluate the inclusion criteria ."

o"Does this review assess publication bias?"

Save the Output:Copy and paste the GenAI-generated responses for each question into the assessment template word document (found below) for Step 1. These will form the first part of your submission.

Step 4: Critique the Systematic Review Based on JBI Short Answer Questions

For each short answer question adapted from the JBI Checklist, critically assess the systematic review GenAI. This step will form the core of your assignment, demonstrating your understanding of the review and the JBI framework.

Your responses should address the 12 questions adapted from the JBI Checklist listed below:

1.Review Question and Objectives

oIs the review question clearly and explicitly stated?

oWhat is the purpose, objective, and/or question of the systematic review?

2.Inclusion Criteria

oWhat is the inclusion criteria for this review?

oIs the inclusion criteria appropriate for the review question? Explain why or why not.

3.Search Strategy

oIs a clear search strategy provided?

oIs the search strategy appropriate? Explain why or why not.

4.Sources and Resources for Article Search

oWhat sources and resources were used to search for articles?

oAre the sources and resources adequate? Explain why or why not.

5.Criteria for Appraising Studies

oWhat was the criteria for appraising studies?

oWas this criteria appropriate? Provide a rationale for your answer.

6.Independent Critical Appraisal

oWas critical appraisal conducted by two or more reviewers independently?

oExplain why it is important to have two or more reviewers.

7.Data Extraction Methods

oHow was the data extracted?

oWhat methods were used to minimize errors in data extraction? Are these methods appropriate? Explain.

8.Methods for Combining Studies

oWere the methods used to combine studies appropriate? Provide a rationale for your answer.

9.Assessment of Publication Bias

oWas the likelihood of publication bias assessed?

oProvide a rationale for your answer.

10.Support for Recommendations

oWere recommendations for policy and/or practice supported by the reported data?

oExplain how the data supports the recommendations.

11.Directives for New Research

oWere specific directives for new research identified?

oAre these appropriate? Provide a rationale for your answer.

12.Application of Findings to Clinical Practice

oBased on your appraisal of this review, would you apply the findings to your clinical practice?

oExplain why or why not.

Step 5: Compare and Report Findings:Finally, compare GenAI's critique to your own. Identify any differences, errors, inaccuracies, or irregularities between the two critiques, noting specific points where GenAIs response may have missed details, misunderstood context, or provided inaccurate assessments based on the checklist criteria.

For each question:

If GenAI provides incorrect or incomplete responses:Identify the errors, explain why they are incorrect, and provide the correct information based on the systematic review.

If GenAIs answers are correct:Provide a justification explaining why the response is accurate, supported by evidence from the review.

Submission:

Use theassessment template(word doc) provided on Canvas to provide your responses. Your submission should include the following:

1.GenAI Output:

oPaste the full, unedited critique generated by GenAI in response to each of the JBI checklist questions.

2.Your Critique

For each JBI checklist question, provide your detailed review and critique along with page numbers from the publication.

3.Compare and Report FindingsIf errors were found: Identify the errors, explain why they are incorrect, and provide the corrected information with evidence from the systematic review.

If no errors were found: Justify why GenAI's response is accurate,Support Your Analysis with Evidence:Each of your short answer responses must be backed by evidence from the systematic review.

4. References

Cite and reference the systematic review and any other sources usingAPA 7th edition

*The assessment template should be used to complete this assessment and is found below.

Weighting

35%

Compulsory Requirements

Submit assessment item - Must submit this assessment to pass the course.

Length

1500 words (+/- 10% for allowance).