Skip to main content
Download PDF

Reporting quality of sham needles used as controls in acupuncture trials: a methodological evaluation

Chinese Medicine volume 17, Article number: 64 (2022) Cite this article

Abstract

Objective

The description of controls is important in acupuncture clinical trials to interpret its effectiveness without fallacy. This paper aims to evaluate the reporting quality of acupuncture studies on the characteristics of sham needles.

Study design and setting

Using a checklist developed from previously published reporting guidelines, the distribution of reported items and changes of reporting rates over time were investigated. Two-way ANOVA and linear regression were conducted.

Results

Original articles of RCTs of any design involving sham needles as controls were eligible for assessment. 117 trials from three 2-year time periods between 2009 and 2018 were included. Seven items out of 25 were reported in more than 50% of the studies. While significant differences of reporting scores among categories were observed, there were no significant differences among time periods; no significant improvement was observed over time.

Conclusions

Low reporting qualities of sham needles used in acupuncture studies may influence how researchers understand the effectiveness of acupuncture. This study evaluated previous publications from 2009 to 2018 and found that reporting qualities on sham needles did not improve over time. Further studies are required to validate the items used in this study to endorse better reporting of controls in acupuncture trials.

Introduction

Acupuncture is an intervention used for therapeutic purposes performed by “inserting one or more needles into specific sites on the body surface for therapeutic purposes” [1]. The characteristics of acupuncture needles need to be considered in the overall design of clinical trials, in specific, in the selection of controls, to interpret the effect of acupuncture needles without fallacy. Placebo controls must be hard to distinguish from real acupuncture needles without producing any physiological therapeutic effect [2]. In this regard, non-penetrating placebo needles have been used as placebo controls to verify the efficacy of acupuncture in clinical trials [3, 4]. Sham needles exist in several forms including the Streitberger, the Park, and the Takakura needles, and have been employed in acupuncture trials for decades.

Despite the development and application of sham needles, however, the assumption that components of sham needles are inactive or inert can be misleading. A number of trials reported conflicting results regarding the effectiveness of acupuncture [5]. Several studies have shown that the effectiveness of sham needles is similar to that of real acupuncture needles [6,7,8], and the validity of sham needles as controls in acupuncture research has been argued for several years [9, 10]. Some of the recent works imply unintended physiological effects of placebo needles that may not always be accounted for when calculating the specific effects of acupuncture needles [2, 10, 11]. While reviews have been published to address this contradictory results in acupuncture trials [5, 9], the focus of these reviews was mostly on the choice of placebo devices in terms of credibility in blinding and effectiveness as controls.

A recent study implied that characteristics of the placebo device may influence the apparent effectiveness of the active intervention, and that adequate description of placebo device may be the solution to this problem [12]. Guidelines related to acupuncture trials that are previously published and in use include “CONsolidated Standards Of Reporting Trials” (CONSORT) statements [13, 14], the “STandards for Reporting Interventions in Controlled Trials of Acupuncture” (STRICTA) guidelines as extensions of CONSORT [15, 16], and the “Template for Intervention Description and Replication” (TIDieR) checklist as another extension of CONSORT item 5 (“Intervention” in the “Methods” section) [17]. Previous studies investigating the reporting qualities of the clinical trials before and after the publication of guidelines showed that the development of CONSORT [18, 19] and STRICTA [20, 21] led to improvements of the overall reporting qualities. Cross-sectional investigations on the quality of intervention reporting of clinical trials based on TIDieR checklist [22,23,24,25] showed that while average completion of the checklist items did not show significant changes, the evaluations allowed further understanding of the description of interventions in clinical trials. However, the description of sham needles used in acupuncture trials have been partially addressed, suggesting that controls be described in a similar manner to active intervention. STRICTA, for instance, suggests in a single item that the rationale and description of the controls be described, and details to be provided if sham needle is used in the trial [15, 16].

To date, there has been no formal systematic evaluation of whether sham needles are reported without missing information in clinical trials. Without adequate description of sham needles, the clinical effectiveness of acupuncture needles reported in clinical trials are open to miscalculation and misinterpretation. A process of assessment by the authors of the CONSORT and STRICTA have been proposed and published [18, 20, 21]. By adopting a similar process of evaluation for sham needles used in randomized clinical trials (RCTs), this study aimed to systematically analyze the reporting quality of the sham needles in acupuncture trials.

Methods

Study design

A methodological evaluation of the reporting qualities of placebo needles in acupuncture trials was conducted in this study. The methodological basis was a systematic review adjusted to allow focus on reporting quality of the controls in published articles. Methodologies in previous studies investigating the reporting quality of acupuncture trials before and after the publication of STRICTA were partially adopted to provide a basis of comparison between the overall reporting quality of acupuncture trials and quality of reporting sham needles from the same time periods [20, 21].

Time periods and eligibility criteria

To track changes over time, three distinct two-year time periods were selected. As a baseline, time period 2009–2010 was selected to evaluate the reporting quality around the publication date of the revised version of STRICTA and CONSORT [13, 15]. Two of the time periods, or period 2009–2010 and 2014–2015 were matched with previous studies [20, 21] to allow direct comparison of the overall reporting qualities of published acupuncture trials. The last time period 2017–2018 was selected to reflect the recent reporting qualities of published articles.

The eligibility criteria included original articles of RCTs of any design involving sham needles as controls on humans, in English language between the above date ranges. Since this review aimed to evaluate the reporting quality of trials using sham needles, we excluded trials using interventions such as electroacupuncture, laser acupuncture, pharmacopuncture, transcutaneous electrical nerve stimulation (TENS), acupressure, and trials which use acupuncture needles but do not use sham needles as controls. Abstracts in conference proceedings and protocols without results from the trials were also excluded. PubMed (https://pubmed.ncbi.nlm.nih.gov/) was searched for this study.

Development of the evaluation checklist

A reporting quality assessment checklist was developed for this study involving 25 items for trials incorporating acupuncture control group using sham needles (Table 1). Items were based on STRICTA, CONSORT and TIDieR, which were closely worded to the original recommendations. Six categories of the checklist include: (I) Type of placebo needle, (II) Details of sham needling, (III) Location of sham needling, (IV) Treatment regimen, (V) Practitioner, and (VI) Protocol and settings. In addition, new items were added based on the updates on the placebo effects of sham needles investigated in previous studies. The newly added items focused on the interactions between the practitioner and patient, and therefore are found in categories (V) Practitioner and (VI) Protocol and settings. Examples of these items include whether practitioner and patient had discussions prior to or during the treatment [2, 26,27,28,29], introduction of the treatments and instructions given to patients [30,31,32,33,34], and method of blinding [35,36,37,38]. All of the items were phrased as a series of questions to which the answer could be given logistically as a “yes” or “no,” and each item was scored based on the evaluated answers.

Table 1 Items used in this study for systematic evaluation
Full size table

Data selection and screening process

After manual removal of duplicates from the records initially searched through PubMed, articles were screened based on the eligibility criteria described above. Prior to the assessment of the trials, three assessors (MK1, MK2, YSL) discussed the meaning of each item in detail, and went through a pilot assessment using an article that was not included in the final review. When the meaning of an item was understood differently among the assessors, the wording of the criteria was revised to reach a consensus. For the final review, two reviewers (MK1 and MK2), both experienced researchers in acupuncture, assessed each article independently. A third reviewer (YSL) compared the two evaluations and checked the differently evaluated items. Reviewers MK1 and MK2 returned to the evaluations and discussed the differently marked items until they reached an agreement. Meanwhile, the third reviewer (YSL) assessed the studies independently. Once the evaluations agreed between the first two reviewers (MK1 and MK2) were completed, the third reviewer (YSL) compared the evaluations again and checked the differently evaluated items. The final agreed evaluations among the three reviewers were selected as the final mark of each item.

Primary outcomes

Outcome measures for this study were the item scores using the checklist described above. After the evaluation was completed, the scores of each item were summarized using logistic criteria. All items were given equal weight such that each item contributed a score of 0 or 1.

Statistical analysis

The mean of the percentage of reported items were analyzed by categories and in total. Data were summarized for each time period. Two-way analysis of variance (ANOVA) comparing time periods and categories was conducted to observe significantly different scores. To investigate which group means are different, post hoc comparisons were analyzed between different time periods by categories using Tukey’s honestly significant difference (HSD) test. Furthermore, linear regression analysis was conducted between the published date of the individual studies and overall item scores to observe the trend of the reporting quality of sham needles over time. All statistical analyses were conducted using R (version 4.0.4, The R Foundation for Statistical Computing).

Results

Study characteristics

From the initial search through PubMed, a total of 2953 studies were identified (Fig. 1). After manual removal of duplicates, 2412 articles were screened based on title. Non-English articles, review articles, and protocol articles were removed from the record. After title screening and full-text obtaining, total of 144 articles were randomly selected from three time periods for full-text reading. 27 articles were removed upon abstract screening and full-text reading for using interventions outside the scope of this review (i.e., laser acupuncture, pharmacopuncture, TENS or electrostimulation, and acupressure). As a result, a total of 117 articles were included (Fig. 1).

Fig. 1
figure 1

PRISMA (preferred reporting items for systematic reviews and meta-analyses) flowchart showing the flow of articles through the study

Full size image

Types of reported sham controls

Among the 117 papers evaluated in this study, a total of 50 studies (43%) mentioned the type of sham needles. Among these 50 papers which reported the specific type of sham needles, the most commonly reported sham needle was Streitberger placebo needle (14 studies), followed by Park sham needle (8 studies). A number of papers described sham needles in a general expression such as “blunt tip needle” or “non-penetrating needle” (8 studies), and a few studies used needle handles (2 studies). Shallow needling or minimal insertion was reported in 6 studies, and real needle on non-acupoints was reported in 3 studies. Takakura needle and sham laser device were reported in 2 studies, respectively. Other types of reported sham devices were specific devices developed by the authors and Kim sham needle.

Differences in reporting quality among categories

Overall, a total of 7 items out of 25 were reported in more than 50% of the studies throughout all time periods: number of placebo needling, depths of insertion (including non-penetration), placebo needle retention, location of placebo needling, number of treatment sessions, total trial period, and blinding. Observing by categories, only the items in “treatment regimen” category were reported in more than 50% of the studies throughout all time periods. On the other hand, items in “practitioner” category and “protocol and settings” category were seldom reported and the frequency percentage was estimated to be far below 50% (Fig. 2A). Two-way ANOVA showed significant difference of reporting scores among categories [F(5, 57) = 5.992, p-value < 0.001]; however, no significant difference in reporting scores among time periods [F(2, 57) = 0.291, p-value = 0.749], and there was no significant interaction between the effects of time period and categories [F(10, 57) = 0.109, p-value = 1.000]. Post-hoc comparisons using Tukey HSD test indicated that the mean reporting score of the category “details of sham needle” was significantly higher than “practitioner” (mean difference = − 0.31, adjusted p-value = 0.022) and “protocol and settings” (mean difference = − 0.28, adjusted p-value = 0.004). Likewise, the mean reporting score of the category “treatment regimen” was significantly higher than “practitioner” (mean difference = − 0.40, adjusted p-value = 0.007) and “protocol and settings” (mean difference = − 0.37, adjusted p-value = 0.002) (Fig. 2B).

Fig. 2
figure 2

A Heatmap showing the distribution of reporting rates in each time period by each item. Items in “treatment regimen” category were reported in more than 50% of the studies throughout all time periods, and items in “practitioner” category and “protocol and settings” category were reported in less than 50% of the studies. B Bar graph showing the overall reporting scores by categories. The most reported category was “treatment regimen”, and the least reported category was “practitioner.” *p-value < 0.05. **p-value < 0.01

Full size image

Changes of reporting quality over time

Regression analysis between the overall scores of the papers and time showed that there was no statistically significant change of overall item scores (β = 0.008, p-value = 0.358). Average score of the studies published in period 2009–2010 was 10.03, 9.45 in period 2014–2015, and 10.71 in period 2017–2018 (Fig. 3). Observing by items, a constantly increasing trend over time were observed in items including “number of sham needling”, “location of sham needling”, “number of treatment sessions”, “frequency and duration of treatment”, “total trial period”, and “blinding”.

Fig. 3
figure 3

Distribution of the overall reporting scores over time. The red line shows the linear regression value between published date and reporting scores (β = 0.008, p-value = 0.358). The reporting qualities on sham needles did not improve over time

Full size image

Discussion

This study evaluated the reporting quality of sham needles in acupuncture trials, in three time periods between the year 2009 and 2018, using systematic methodology adopted and modified from previous studies [18, 20, 21]. For this systematic evaluation, a checklist was developed based on CONSORT, STRICTA, TIDieR, and previous literature investigating placebo effects in acupuncture treatments. While significant differences of reporting scores among categories were observed, there were no significant differences among time periods; similarly, no significant improvement of reporting scores was observed over time. To our knowledge, this is the first paper to systematically analyze the reporting quality of sham needles used in acupuncture trials.

The results showed that overall, a total of 7 items out of 25 were reported in more than 50% of the studies throughout all time periods. These items include: “number of sham needling”, “depths of insertion (including non-penetration)”, “sham needle retention”, “location of sham needling”, “number of treatment sessions”, “total trial period”, and “blinding”. Only the “treatment regimen” category was reported in more than 50% of the studies throughout all time periods. Items which showed a constantly increasing trend over time and were above 50% reporting rate were: “number of sham needling”, “location of sham needling”, “number of treatment sessions”, “frequency and duration of treatment”, “total trial period”, and “blinding”, implying a continuously increasing trend of reporting the above information in published literature. On the other hand, items which showed a constantly decreasing trend over time and were below 50% reporting rate were: “response sought for sham needle (e.g., de qi, muscle twitch)”, “whether the practitioner and the patient have any interaction during the trial”, “whether there was any discussion regarding the symptoms”, and “information include the term ‘placebo’ or ‘sham’.”

Modified items from STRICTA such as “type of sham needle” were not reported in more than 50% of the studies throughout all time periods, while a previous study found significantly increased reporting of the “specific style of acupuncture,” the corresponding item in STRICTA, over time since the publication of the checklist [21]. Moreover, modified items from TIDieR such as “modification of the needling procedure” was one of the least reported items. Previous studies on the impact of STRICTA and CONSORT on reporting qualities of acupuncture trials showed an increased quality of reporting since the publication of STRICTA in 2010 [18, 20, 21]; in contrast, the results from this study illustrated that reporting quality of sham needles did not improve over time.

Furthermore, items that were not listed in either STRICTA, CONSORT or TIDieR but nonetheless discussed in recent studies to have substantial impact on the placebo effect by sham needles, were reported in very few studies. These items include discussions between practitioner and patients before and during the treatments, information given to patients, and confirmation of whether the information given to patients included the term “sham” or “placebo.” Previous studies discussed the importance of the doctor-patient relationship in placebo effects [26,27,28,29]; recent studies also point out that acupuncture treatment, with its long duration of time for the application of the needles and the communication involved, consequently builds a stronger doctor-patient relationship which may lead to stronger placebo effects [2, 39]. While it would be nonsensical to report all types of communications during the trial, the scope of communications between the practitioner and the patient, i.e., whether the conversation was carried out beyond the scope of the experiment, and whether any kind of interaction to build a trusting relationship between the practitioner and the patient was allowed, would enable the readers to understand the potential non-specific effects involved in the process of the treatment.

On the other hand, literature discuss that the extent of disclosure of information may influence the level of placebo effect on patients [30, 32,33,34]. One study showed that the placebo responses caused by information disclosure modifies the drug response [31]. Lastly, blinding is an important aspect of controlled trials [36, 38]. It is also found to be extremely difficult to achieve in acupuncture trials [35, 37], which requires caution in both the experiment design and the reporting of the experiment.

The findings in this study showing low rates of reporting information about sham needle and its treatment protocol would most likely lead to a gap of reporting qualities between that of acupuncture in general and that of sham needles. Previous studies presented that reporting qualities of acupuncture RCTs improved overall since the publication of STRICTA and CONSORT [18, 20]. One study showed that the best-reported item was adhered to in over 90% while poorest reporting value was 51.1% [18, 20, 21]. In contrast, this study showed that only seven items out of 25 were reported in more than 50% of the studies. Similarly, the overall trend of reporting qualities based on STRICTA was shown to constantly improve in the previous studies [20, 21], while the reporting qualities of sham needles reviewed in this study did not show significant improvement over time.

Low reporting qualities of the controls used in acupuncture trials compared to reporting qualities of the intervention in general puts at risk the accurate analysis of specific effect of acupuncture; and this may require a reappraisal of the current understanding of the effectiveness of acupuncture. As with other types of medical interventions investigated in RCTs, the specific effects of acupuncture have often been analyzed through contrast of the reported effectiveness of the treatment to that of control. Therefore, the data presented in this study might potentially imply that the specific effects of acupuncture might have been misinterpreted due to missing information regarding controls. Furthermore, research such as meta-analyses and systematic reviews based on literature, might have even higher chance of misunderstanding of the effectiveness of acupuncture, simply due to the accumulation of fallacies over time. It may not be pure coincidence that placebos in acupuncture trials have been subject to strong effectiveness, sometimes as effective as verum acupuncture, by a number of researchers for decades [6, 39,40,41,42,43], and might be due to the lack of elaboration on controls used in acupuncture trials.

The limitations of this study include that the scoring system based on the checklist to evaluate reporting qualities. STRICTA, CONSORT and TIDieR were never intended to be employed as rating scales [21, 44, 45], and the items in the checklist used in this study were mostly adopted from these guidelines. It is important to emphasize that the score of each paper does not reflect the quality of the research itself. Furthermore, the items in this study were equally weighted based on previous researches [20, 21, 45], which may be subject to further discussion. However, despite these limitations, this study allowed a systematic evaluation of the reporting qualities of the previous researches using sham needles, and allowed a comparison of the results with the reporting qualities of acupuncture trials investigated in previous studies by adopting the time span as well as the items. The systematic methodology used in this study allowed for an objective evaluation of the studies by multiple reviews and discussions.

In conclusion, we found that the reporting qualities on sham needles did not improve over time. Many of the items were reported in less than 50% of the evaluated studies. In contrast to the reporting quality of acupuncture trials in general as reported in previous studies, low reporting qualities regarding controls may influence how researchers understand the effectiveness of acupuncture. Further studies are required to validate the items used in this study to endorse better reporting of sham needles used as controls in acupuncture trials.

Conclusions

This study evaluated the reporting quality of sham needles in acupuncture trials. Evaluation of previous publications from 2009 to 2018 showed that reporting qualities on sham needles did not improve over time. Significant differences of reporting scores among categories were observed, while no significant differences were found among time periods. Low reporting qualities of sham needles used in acupuncture studies may influence the understanding of the effectiveness of acupuncture. Further studies are required to validate the items used in this study to endorse better reporting of controls in acupuncture trials.

Availability of data and materials

The data and the related materials are available upon request to the first author.

Abbreviations

CONSORT:

CONsolidated Standards Of Reporting Trials

STRICTA:

STandards for Reporting Interventions in Controlled Trials of Acupuncture

TIDieR:

Template for Intervention Description and Replication

RCTs:

Randomized Clinical Trials

TENS:

Transcutaneous Electrical Nerve Stimulation

ANOVA:

Analysis of variance

HSD:

Honestly Significant Difference

PRISMA:

Preferred Reporting Items for Systematic reviews and Meta-Analyses

References

  1. Liu T. Acupuncture: what underlies needle administration? Evid Based Complement Alternat Med. 2009;6(2):185–93.

    Article  PubMed  Google Scholar 

  2. Chae Y, Lee YS, Enck P. How placebo needles differ from placebo pills? Front Psychiatry. 2018;9:243.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Dincer F, Linde K. Sham interventions in randomized clinical trials of acupuncture—a review. Complement Ther Med. 2003;11(4):235–42.

    Article  CAS  PubMed  Google Scholar 

  4. Hu B, Bai F, Xiong L, Wang Q. The endocannabinoid system, a novel and key participant in acupuncture’s multiple beneficial effects. Neurosci Biobehav Rev. 2017;77:340–57.

    Article  CAS  PubMed  Google Scholar 

  5. Zhu D, Gao Y, Chang J, Kong J. Placebo acupuncture devices: considerations for acupuncture research. Evid Based Complement Alternat Med. 2013;2013:628907.

    PubMed  PubMed Central  Google Scholar 

  6. Madsen MV, Gotzsche PC, Hrobjartsson A. Acupuncture treatment for pain: systematic review of randomised clinical trials with acupuncture, placebo acupuncture, and no acupuncture groups. BMJ. 2009;338:a3115.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Cherkin DC, Sherman KJ, Avins AL, Erro JH, Ichikawa L, Barlow WE, et al. A randomized trial comparing acupuncture, simulated acupuncture, and usual care for chronic low back pain. Arch Intern Med. 2009;169(9):858–66.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Schneider A, Enck P, Streitberger K, Weiland C, Bagheri S, Witte S, et al. Acupuncture treatment in irritable bowel syndrome. Gut. 2006;55(5):649–54.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Zhang CS, Tan HY, Zhang GS, Zhang AL, Xue CC, Xie YM. Placebo devices as effective control methods in acupuncture clinical trials: a systematic review. PLoS ONE. 2015;10(11):e0140825.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  10. Chae Y. The dilemma of placebo needles in acupuncture research. Acupunct Med. 2017;35(5):382–3.

    Article  PubMed  Google Scholar 

  11. Lundeberg T, Lund I, Sing A, Naslund J. Is placebo acupuncture what it is intended to be? Evid Based Complement Alternat Med. 2011;2011:932407.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Howick J, Hoffmann T. How placebo characteristics can influence estimates of intervention effects in trials. CMAJ. 2018;190(30):E908-E11.

    Article  Google Scholar 

  13. Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, et al. CONSORT for reporting randomised trials in journal and conference abstracts. Lancet. 2008;371(9609):281–3.

    Article  PubMed  Google Scholar 

  15. MacPherson H, Altman DG, Hammerschlag R, Youping L, Taixiang W, White A, et al. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. PLoS Med. 2010;7(6):e1000261.

    Article  PubMed  PubMed Central  Google Scholar 

  16. MacPherson H, White A, Cummings M, Jobst K, Rose K, Niemtzow R. Standards for reporting interventions in controlled trials of acupuncture: the STRICTA recommendations. Complement Ther Med. 2001;9(4):246–9.

    Article  CAS  PubMed  Google Scholar 

  17. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.

    Article  PubMed  Google Scholar 

  18. Moher D, Jones A, Lepage L, Group C. Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001;285(15):1992–5.

    Article  CAS  PubMed  Google Scholar 

  19. Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 2014;383(9913):267–76.

    Article  PubMed  Google Scholar 

  20. Prady SL, Richmond SJ, Morton VM, Macpherson H. A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS ONE. 2008;3(2):e1577.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  21. Svenkerud S, MacPherson H. The impact of STRICTA and CONSORT on reporting of randomised control trials of acupuncture: a systematic methodological evaluation. Acupunct Med. 2018;36(6):349–57.

    Article  PubMed  Google Scholar 

  22. Vassar M, Page MJ, Glasbey J, Cooper C, Jorski A, Sosio J, et al. Evaluation of the completeness of intervention reporting in cochrane surgical systematic reviews using the TIDieR-SR checklist: a cross-sectional study. BMJ Evid Based Med. 2020. https://doi.org/10.1136/bmjebm-2020-111417.

    Article  PubMed  Google Scholar 

  23. Wayant C, Bindernagel R, Vassar M. TIDieR checklist evaluation of clinical trial intervention reporting for recent FDA-approved anticancer medications. BMJ Evid Based Med. 2020;25(3):97–101.

    Article  PubMed  Google Scholar 

  24. Palmer W, Okonya O, Jellison S, Horn J, Harter Z, Wilkett M, et al. Intervention reporting of clinical trials published in high-impact cardiology journals: effect of the TIDieR checklist and guide. BMJ Evid Based Med. 2020. https://doi.org/10.1136/bmjebm-2019-111309.

    Article  PubMed  Google Scholar 

  25. Vassar M, Pollard J, Rorah D, Jellison S, Harter ZJ, Brasseux S. Assessment of the completeness of intervention reporting of randomized clinical trials for alcohol use disorders: effect of the TIDieR checklist and guide. Drug Alcohol Depend. 2020;208:107824.

    Article  PubMed  Google Scholar 

  26. Benedetti F. Placebo and the new physiology of the doctor-patient relationship. Physiol Rev. 2013;93(3):1207–46.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Adler HM, Hammett VB. The doctor-patient relationship revisited. An analysis of the placebo effect. Ann Intern Med. 1973;78(4):595–8.

    Article  CAS  PubMed  Google Scholar 

  28. Laskin DM, Greene CS. Influence of the doctor-patient relationship on placebo therapy for patients with myofascial pain-dysfunction (MPD) syndrome. J Am Dent Assoc. 1972;85(4):892–4.

    Article  CAS  PubMed  Google Scholar 

  29. Teixeira MZ. Psiconeurophysiologic bases of the placebo-nocebo phenomenon: scientific evidences that value the humanization of the doctor-patient relationship. Rev Assoc Med Bras. 2009;55(1):13–8.

    Article  PubMed  Google Scholar 

  30. Cheon S, Park HJ, Chae Y, Lee H. Does different information disclosure on placebo control affect blinding and trial outcomes? A case study of participant information leaflets of randomized placebo-controlled trials of acupuncture. BMC Med Res Methodol. 2018;18(1):13.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Flaten MA, Simonsen T, Olsen H. Drug-related information generates placebo and nocebo responses that modify the drug response. Psychosom Med. 1999;61(2):250–5.

    Article  CAS  PubMed  Google Scholar 

  32. Bishop FL, Adams AE, Kaptchuk TJ, Lewith GT. Informed consent and placebo effects: a content analysis of information leaflets to identify what clinical trial participants are told about placebos. PLoS ONE. 2012;7(6):e39661.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  33. O’Donoghue AC, Sullivan HW, Aikin KJ. Randomized study of placebo and framing information in direct-to-consumer print advertisements for prescription drugs. Ann Behav Med. 2014;48(3):311–22.

    Article  PubMed  Google Scholar 

  34. Sullivan HW, O’Donoghue AC, Aikin KJ. Presenting quantitative information about placebo rates to patients. JAMA Intern Med. 2013;173(21):2006–7.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Takakura N, Takayama M, Nasu M, Nishiwaki M, Kawase A, Yajima H. Patient blinding with blunt tip placebo acupuncture needles: comparison between 1mm and 2mm skin press. J Integr Med. 2018;16(3):164–71.

    Article  PubMed  Google Scholar 

  36. Ehrlich GE. Blinding in placebo-controlled trials. Ann Intern Med. 2001;134(12):1150–1.

    Article  CAS  PubMed  Google Scholar 

  37. Zhang GS, Zhang CS, Tan HY, Wang Y, DaCosta C, Zhang AL, et al. Systematic review of acupuncture placebo devices with a focus on the credibility of blinding of healthy participants and/or acupuncturists. Acupunct Med. 2018;36(4):204–14.

    Article  PubMed  Google Scholar 

  38. Moscucci M, Byrne L, Weintraub M, Cox C. Blinding, unblinding, and the placebo effect: an analysis of patients’ guesses of treatment assignment in a double-blind clinical trial. Clin Pharmacol Ther. 1987;41(3):259–65.

    Article  CAS  PubMed  Google Scholar 

  39. Kaptchuk TJ. Placebo effects in acupuncture. Med Acupunct. 2020;32(6):352–6.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Colquhoun D, Novella SP. Acupuncture is theatrical placebo. Anesth Analg. 2013;116(6):1360–3.

    Article  PubMed  Google Scholar 

  41. Ernst E. Acupuncture—a critical analysis. J Intern Med. 2006;259(2):125–37.

    Article  CAS  PubMed  Google Scholar 

  42. Deng S, Zhao X, Du R, He SI, Wen Y, Huang L, et al. Is acupuncture no more than a placebo? Extensive discussion required about possible bias. Exp Ther Med. 2015;10(4):1247–52.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Wechsler ME, Kelley JM, Boyd IO, Dutile S, Marigowda G, Kirsch I, et al. Active albuterol or placebo, sham acupuncture, or no intervention in asthma. N Engl J Med. 2011;365(2):119–26.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. MacPherson H, Jobst KA. Improving the reporting of interventions in clinical trials of acupuncture: the updated and revised STRICTA. J Altern Complement Med. 2010;16(9):929–30.

    Article  PubMed  Google Scholar 

  45. Hammerschlag R, Milley R, Colbert A, Weih J, Yohalem-Ilsley B, Mist S, et al. Randomized controlled trials of acupuncture (1997–2000): an assessment of reporting quality with a CONSORT- and STRICTA-based instrument. Evid Based Complement Alternat Med. 2011. https://doi.org/10.1155/2011/183910.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

This research was supported by the Korea Institute of Oriental Medicine (KIOM, Grant No. KSN2013210 and No. KSN2021210) and by the National Research Foundation of Korea (NRF) Grant funded by the Korea government (MSIT) (No. 2019R1G1A1100815).

Funding

This research was supported by the Korea Institute of Oriental Medicine (KIOM, Grant No. KSN2013210 and No. KSN2021210) and by the National Research Foundation of Korea (NRF) Grant funded by the Korea government (MSIT) (No. 2019R1G1A1100815). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

  1. Jaseng Spine and Joint Research Institute, Jaseng Medical Foundation, Seoul, Republic of Korea

    Ye-Seul Lee

  2. Department of Anatomy and Acupoint, College of Korean Medicine, Gachon University, Seongnam, Republic of Korea

    Song-Yi Kim & Minseo Kim

  3. Department of Internal Medicine, Korean Medicine Hospital of Pusan National University, Yangsan, South Korea

    Mariah Kim

  4. KM Science Research Division, Korea Institute of Oriental Medicine, Daejeon, South Korea

    Jiyoon Won & Myeong Soo Lee

  5. Department of Science in Korean Medicine, College of Korean Medicine, Graduate School, Kyung Hee University, Seoul, South Korea

    Hyangsook Lee

  6. Acupuncture and Meridian Science Research Center, College of Korean Medicine, Kyung Hee University, 1 Hoegi-dong, Dongdaemun-gu, Seoul, Republic of Korea

    Younbyoung Chae

Authors
  1. Ye-Seul Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Song-Yi Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mariah Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Minseo Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jiyoon Won
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hyangsook Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Myeong Soo Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Younbyoung Chae
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

YSL: drafted the original manuscript, designed the study, conducted the initial analysis. SYK: drafted the manuscript, conducted additional data analyses. MK1: conducted the study and collected data. MK2: conducted the study and collected data. JW: revised the manuscript and visualized the data. HL: designed the study and revised the manuscript. MSL: designed the study, provided funding to the study and revised the manuscript. YC: designed the study, reviewed the results, revised the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Younbyoung Chae.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

All of the authors provided consent to publish the study.

Competing interests

The authors declare that no competing interests exist.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lee, YS., Kim, SY., Kim, M. et al. Reporting quality of sham needles used as controls in acupuncture trials: a methodological evaluation. Chin Med 17, 64 (2022). https://doi.org/10.1186/s13020-022-00608-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13020-022-00608-5

Keywords

  • Placebos
  • Acupuncture
  • Control
  • STRICTA
  • CONSORT
  • TIDieR

Chinese Medicine

ISSN: 1749-8546

Contact us