Open Access

Developing a diagnostic checklist of traditional Chinese medicine symptoms and signs for psoriasis: a Delphi study

  • Xuesong Yang1,
  • Virasakdi Chongsuvivatwong2,
  • Edward McNeil2,
  • Jianzhou Ye1,
  • Xiaoyong Ouyang1,
  • Enpin Yang1 and
  • Hutcha Sriplung2Email author
Chinese Medicine20138:10

DOI: 10.1186/1749-8546-8-10

Received: 20 September 2012

Accepted: 10 May 2013

Published: 12 May 2013

Abstract

Background

Psoriasis is a chronic inflammatory skin disease with a genetic basis. Its ill-defined causes make it difficult to diagnose. This study aims to develop a diagnostic checklist for psoriasis classification in the context of traditional Chinese medicine.

Methods

A Delphi study was conducted with three rounds by a panel of 16 dermatology experts to develop a checklist for traditional Chinese medicine symptoms and signs of psoriasis. Dermatology experts in psoriasis research, nine in Yunnan and seven in Beijing, were selected as the expert panel. The initial list of symptoms and signs in psoriasis was developed by reviewing the literature retrieved from Chinese and English journals. Experts rated each item of the list on a 5-point Likert scale. The list was revised and re-evaluated in the same manner for a total of 3 rounds before it was finalized.

Results

One hundred and thirty items were extracted from the literature review. After three rounds of expert ratings, 96 items were retained with eight domains: color, type and shape of skin lesion, physical expression, tongue and coating, pulse, associated factors, and living environment. Intraclass correlation coefficient and Kappa statistics indicated an inter-rater agreement in the final checklist.

Conclusion

A checklist containing 96 items in 8 domains was developed for psoriasis diagnosis using traditional Chinese medicine symptoms and signs.

Background

Psoriasis is a chronic, inflammatory, hyper-proliferative and immunologically mediated skin disease with a genetic basis [1]. It is characterized by erythema, defined as scaly plaques with itching and bleeding [2]. Psoriasis prevalence ranges from 0.6% to 4.8% in all age groups worldwide [3, 4] and psoriatic arthritis (PsA) affects 6–39% of all psoriasis patients [57]. The variation in psoriasis prevalence with geographical and ethnic factors suggests an influence of the physical environment (e.g., climate) patterns or other exposures in the development of psoriasis [810].

In Western medicine, psoriasis treatments can be any one or a combination of the three main modalities: topical treatments with steroids or other agents, UV therapy with or without light-sensitizing medication and systemic medications, such as retinoids, and cytotoxic drugs [11, 12]. Some psoriatic patients (51%) may also opt to use alternative therapies, such as herbal remedies, vitamin supplements, and dietary manipulation [13], and traditional Chinese medicine (TCM) [14].

According to TCM diagnosis [15], psoriasis (白疕, bai bi or white mange) [16] is considered to be due to (1) the invasion of pathogenic wind that incubates in the yin and blood; or (2) the accumulation and stagnation of qi (vital energy) and blood caused by emotional upset. It may also be caused by impairment or disharmony in the functioning of other organs and energy pathway channels [17]. In general, topical treatment, oral medication, and advice on lifestyle and environment are prescribed to relieve the lesions and the impairment or disharmony of the body.

TCM treatment is based on Zheng composition rather than disease definition [18, 19]. For the same disease, there are varieties of syndromes related to different climates and geographical factors [20].

Developing a consensual checklist of TCM symptoms and signs to aid identifying and classifying psoriasis would be useful for TCM clinical practice and scientific research. The Delphi method is a consensus methodology that attempts to assess the extent of agreement (consensus measurement) and to resolve disagreement (consensus development) in medical and health service research [21, 22]. The Delphi technique can be performed in 3 stages. First, the opinions of a group of experts are sought based on an anonymous self-administered questionnaire to eliminate the influence of peer pressure. Second, a feedback system is used to allow the respondents to compare their opinion against a statistical summary of the whole group. Finally, this process is repeated until the opinions are stable [23, 24]. Thus, using the Delphi method, experts can participate without geographic limitations, offer their opinions independently and confidentially without face-to-face meetings and change their opinion based on the systematic feedback from the results of the previous rounds in consecutive stages of the process [25].

This study aims to develop a consensual checklist using the Delphi method for psoriasis classification by TCM symptoms and signs.

Methods

Selection criteria

The study was conducted in the dermatology departments of TCM hospitals in Beijing and the Yunnan province of China. The departments in Dongzhimen Hospital and Yunnan Provincial Hospital of TCM, have collaborated for more than 10 years. Beijing was selected as a representative for northern China where much research on psoriasis has been carried out. Yunnan Provincial Hospital of TCM is the only psoriasis research center in Yunnan and was selected to represent southern China. TCM experts were recruited from five major TCM hospitals in Beijing and one in Yunnan. The hospitals in Beijing were Guang’anmen Hospital, China Academy of Chinese Medical Sciences, China-Japan Friendship Hospital, Dongzhimen Hospital Affiliated to Beijing University of Traditional Chinese Medicine, Dongfang Hospital Affiliated to Beijing University of Traditional Chinese Medicine, and Beijing Hospital of Traditional Chinese Medicine. Yunnan Provincial Hospital of TCM was the selected one in Yunnan.

All participating experts were engaged in psoriasis research for at least ten years, and had each published at least ten research articles on psoriasis. Their academic position was associate professor or higher. Twenty dermatology experts were recommended by the steering committee on a videoconference based on their experience in psoriasis research and four were later excluded, as they did not have sufficient research publications. Finally, seven and nine experts were recruited from Beijing and Yunnan, respectively.

The selection committee was formed by key members of the TCM Dermatology Association (two from Beijing and two from Yunnan) in psoriasis research, which formulated the panel and item selection criteria. These four professors were the most respected leaders in research and administrative authorities in China. They had a mean working experience in psoriasis of 20 years with at least 15 publications. Two of them were the current and ex-chairmen and two were the present vice chairmen in the dermatology branch of the China Association of Chinese Medicine.

Literature review

A literature review was performed to define the initial list of symptoms and signs of psoriasis. The keywords were ‘psoriasis in TCM’, ‘screening and diagnosis of psoriasis in TCM’, ‘different research/schools of psoriasis in TCM in China’. PubMed (http://www.ncbi.nlm.nih.gov/PubMed/) was the source of international publication retrieval. China National Knowledge Infrastructure (CNKI, http://www.cnki.net/), Wanfang data and VIP knowledge communities databases (http://www.wanfangdata.com.cn/) were the sources of articles published in Chinese. Articles were included if they were published between 1970 and 2010. Case reports and articles based on subjective experience and treatment were not excluded since the aim of the review was to identify symptoms, signs, and Zhengs associated with psoriasis.

Checklist design

The initial checklist was derived from the literature review. The experts rated each item in the checklist with one of the following scores: (1) strongly disagree; (2) disagree; (3) neutral; (4) agree; and (5) strongly agree. The items covered 8 domains, including color, characteristic, and shape of the skin lesions, associated factors, physical expression, tongue and its coating, pulse, and living environment.

Seeking expert consensus

The survey was conducted in three rounds from July to September 2010. Individual face-to-face interviews were held in the first round. The objective of the study, content of the questionnaire, and scoring method were explained to the experts. The experts scored each item in the checklist and wrote down their comments. They could also add more items if they thought it appropriate. The mean ± standard deviation (SD) of each item from the first round was computed. Items with a mean score below three were removed from the list used for the following round.

In the second round, the selected items and their first round mean ± SD values as well as the newly added items were compiled and sent confidentially to each expert by email. The expert was asked to re-rate the items with a full awareness of their previous rating and mean score of the items rated by all experts. New items added by any of the experts from round 1 were rated in round 2.

The new mean scores of items were computed, and items with a mean score less than three were removed. The remaining items together with their means ± SD from round 2 were sent by email to all experts. Items with a mean score of more than three in the third round were retained to form the final checklist.

Statistical analysis

Descriptive statistics of all items were summarized. Intraclass correlation coefficient (ICC) was used to assess the agreement and consistency among the experts across the three rounds. Fleiss-Cohen (quadratic) weighted Kappa statistics, in which the weight score was calculated based on a quadratic (square) loss function, were also used to explore inter- and intra-rater agreement [26]. Agreement was considered “very good” if Kappa reached 0.81 or higher, “good” if between 0.61 and 0.80, “moderate” if between 0.41 and 0.60, “fair” if between 0.21 and 0.40 and “poor” if equal to or less than 0.20. The effects of variation of both rounds and experts on the scores were examined with analysis of variance (ANOVA) using R software version 2.12.1 (Vienna, Austria). Hierarchical cluster analysis was performed to examine closeness among various experts’ ratings, and was expressed as a dendrogram. The province name was used to label each branch of the dendrogram to see whether the opinion was clustered by province. All statistical analyses were carried out using R software version 2.12.1, a free open source software environment for statistical computing and graphics available from R-project.org website [27], the Epicalc package was downloaded from the CRAN website (cran.r-project.org) [28] for Kappa statistics, and the psy package was also freely available at the CRAN website for ICC [29].

Results

Sixteen experts were recruited, seven from Beijing and nine from Yunnan provinces. The rating expectative panel of dermatologists in Beijing consisted of four males and three females, while in Yunnan it comprised five males and four females. Two experts were professors and five were associate professors in Beijing while seven experts were associate professors and two were professors in Yunnan province. The total age (mean ± SD) of the experts was 47.7 ± 4.9 years; 46.6 ± 4.8 years for those in Beijing, and 48.6 ± 5.2 years for those in Yunnan province.

Among 102 reports located in the literature, none was excluded since all mentioned symptoms, signs and Zhengs related to psoriasis. One hundred and thirty items were extracted and grouped into one of the following 8 domains: (1) skin lesion color; (2) type of skin lesion; (3) shape of skin lesion; (4) associated factors; (5) physical expression; (6) tongue and its coating; (7) pulse; and (8) living environment. All domains except the last were present in the initial checklist of the first round of the Delphi study, the 8th domain was added on expert suggestion in the second round.

Checklist

Table 1 summarizes the number of items of symptoms and signs in each round. One hundred and thirty items were rated in the first round by the experts. Eighty six items with a mean score greater than three remained after the first round and 24 new items were added by the experts. A total of 110 items were rated in the second round. A total of 105 items remained at the start of the third round. Ninety six items with mean score greater than or equal to three were retained in the final list (Table 2).
Table 1

Number of items at the end of each round

Domain

First round

Second round*

Third round *

Final

 

Initial

Removed

Added

Remaining

Removed

Remaining

Removed

1. Color of skin lesion

5

5

5

5

2. Type of skin lesion

11

5

6

6

6

3. Shape of skin lesion

21

5

16

16

16

4. Associated factors

9

1

4

12

12

2

10

5. Physical expression

56

28

16

44

4

40

7

33

-Diet indulgence and stool

10

5

5

5

5

-Mental irritation

9

7

2

2

2

-Itching

6

6

6

6

-Fever and chills

7

5

2

2

2

-Urine feature

5

4

1

1

1

-Joint and muscle pain

6

4

2

2

2

-Mouth

5

5

5

5

-Sleep

4

1

3

1

2

2

-Complexion

4

2

2

2

1

1

-Throat

5

5

2

3

3

-Menstruation

9

9

1

8

5

3

-Nail

2

2

2

1

1

6. Tongue and its coating

16

1

15

15

15

7. Pulse

12

4

8

1

7

7

8. Living environment

4

4

4

4

Total

130

44

24

110

5

105

 

96

* No additional item.

Table 2

List of items in the final round

Domain

Symptoms and signs

Skin lesion color

Full red, red, garnet, pink, darker skinned

Type of skin lesion

Papule, scaling, crust, pustule, cracking, erythema

Shape of skin lesion

Scattered, guttate, ostaceous, plaque, map shape, generalized lesion, annular, thickness, hyperpigmentation, depigmentation, rough surface, infiltration, thin scale, thick scale, easy scaly exfoliation, dry scale

Associated factors

Trigger factors: overexertion, depression, stirring

Aggravating factors: smoking, drinking alcohol, hot water, stimulating medicine, infection, during menstruation, postpartum

predilection diet: heavy and greasy, pungent, cold and raw

Stool: less stool, constipation

Mental irritation: sense of distress in the chest, anxiety and irritability

Itching degree: severe, mild, slight, absent

Itching frequency: continuous, intermittent

Fever: fever, hot palms, soles and heart

Urine: scanty dark urine

Muscle and joint: muscles and joint pain, stiffness with bending limitation

Mouth: dry mouth and thirsty, dry mouth and not thirsty, bitter taste, fetid breath, sticky taste

Sleep: insomnia, frequent dreams

Complexion: flushed

Nail manifestation: nails not lustrous

Menstruation: scanty menstruation, crimson color, blood clot

Throat: sore throat, redness of pharyngeal portion, tonsil suppuration

Tongue and its coating

Substance: pale, red, maroon, dark purple tongue or tongue with petechiae, thin delicate, enlarged tongue fissured

Coating: white, yellow, greasy, glossy, rough, less, peeling, sublingual varicose veins and bluish purple

Pulse

Moderate, slippery, rapid, string, deep, thread, hesitant

Living environment

Humid, dry, hot, cold

Agreement of experts in the three rounds

Table 3 summarizes the analysis of intra- and inter-rater agreements. The mean weighted kappa statistics for the scores of all items rated by the same expert in the first and the two executive rounds showed moderate agreement (0.34 and 0.42, respectively) whereas agreement between the second and third rounds was almost perfect (0.96). Inter-rater agreements (last column) were poor (0.12 to 0.18) in all three rounds. Intra-class correlation coefficients were between 0.23 and 0.29, indicating that the level of agreement among experts was low.
Table 3

Agreement between rounds within the same raters and between different pairs of raters in the three rounds

Agreement status

Same rater, different round (mean ± SD)

Pairs of raters (mean ± SD)

 

First round

Second round

Third round

 

Kappa1 statistics

    

First round

1.0

0.12 ± 0.12

Second round

0.34 ± 0.20

1.0

0.16 ± 0.13

Third round

0.42 ± 0.19

0.96 ± 0.06

1.0

0.18 ± 0.12

Intraclass correlation

    

coefficient (ICC)

    

Agreement

0.23

0.26

0.26

Consistency

0.27

0.29

0.29

1 Quadratic weighted kappa statistics.

SD, standard deviation; ICC, intraclass correlation coefficient.

Table 4 summarizes the analysis of variance of scores rated by experts in different rounds. ANOVA shows the magnitude of the variance of the scores determined by expert and round. We observed a high F-value that produced a low P value of 0.000003 (highly significant) for the effect of experts, whereas the effect of round within the same individual expert on the variance of scores was low and non-significant (P = 0.95). This suggested that each expert had different opinions from their peers but had a consistent opinion within themselves.
Table 4

ANOVA analysis of scores among experts and rounds of the Delphi process

 

Df

Sum square

Mean square

F-value

P (> F)

Expert

15

27282.3

1818.8

7.020

0.000003

Round

2

24.7

12.3

0.048

0.95

Residuals

30

7772.7

259.1

  

Df: degree of freedom.

F-value is the division of mean square of expert or round by the residual mean square.

P(>F) is the P value that the effect of expert panel or round on the mean scores can be rejected against the null hypothesis.

Figure 1 shows a dendrogram from hierarchical cluster analysis of experts based on their score in the final set of items. The ratings of the experts from Yunnan and Beijing were not significantly different.
Figure 1

Dendrogram showing clusters among raters.

Discussion

From the literature and Delphi method, 96 items of TCM symptoms and signs were selected for psoriasis classification. Although the level of agreement among the experts was not perfect, a final checklist was developed.

Type, color and shape of the skin lesion were rated with the highest scores among the 8 domains. This was consistent with the Psoriasis Area Severity Index (PASI), which places strong weight on skin-related items [30].

Smoking and drinking are generally referred to as external pathogenic factors. Both past and current smokers have a higher risk of developing psoriasis and the risk increases with duration, intensity and pack-years of smoking [31]. These factors were included by the experts in our study.

Physical expression items contributed to as many as 30% of all items. Two viscera contributed seven items: Spleen-related items linked to gastrointestinal symptoms [32], and Liver-related items linked to mental health [33]. The Spleen group was not as strong as the Liver group in psoriasis symptoms based on TCM.

Itching is an important symptom in psoriasis that correlates with the severity of disease and is experienced by almost 85% of patients [34, 35]. It causes anxiety, distress and worsens the patients’ mental health [36]. In the final round, the number of itching items was the highest among physical expression items.

Only two orthopedic items, joint and muscle pain and stiffness with bending limitations, were included by the experts. This may be because arthritic complications of psoriasis are often treated by rheumatologists rather than dermatologists [37]. Symptoms of PsA may closely resemble other diseases including rheumatoid arthritis.

Tongue and its coating are often examined in TCM. Up to 8.2% of fissured tongue and 5.6% of geographical tongue were observed in psoriatic patients in Iran [38]. Tongue coating is associated with the depth of skin involvement. Tongue substance reflects excess or deficiency of qi, blood and viscera[39]. The manifestations vary over the long-term course of psoriasis. Seven tongue substances and 8 tongue coatings were included in the final checklist.

Pulse palpation is an important method to classify the syndrome of psoriasis. Slippery or rapid pulse reflects blood heat. Hesitant and deep pulse reflects blood stasis [40]. Seven types of pulse and its manifest frequency were included for psoriatic patients.

Certain types of symptoms and signs retained by the experts in the final checklist coincided with various known psoriasis risk factors, e.g., streptococcal infection, sore throat and female hormones [41, 42].

Environmental factors can influence psoriasis, e.g., coldness and low humidity. Psoriatic patients can recover more quickly in a hot or humid environment [43]. The presence of these four major environmental factors are related to external etiology factors, and are manifest in the symptoms and signs of psoriatic patients.

There was no obvious evidence of clustering of opinions by geographic setting of the experts. However, a strong conclusion of the similarity of their opinions could not be made since there were a limited number of expert informants. This standardized checklist was approved by psoriasis experts in two different regions of China and might be used throughout the whole of China.

The mean weighted Kappa statistics for the same rater in different rounds showed that raters agreed with themselves in the consecutive rounds. For example, a Kappa value of 0.34 between the first and the second rounds and 0.42 between the second and third rounds (Table 3). When the third round was reached, agreement with the second round was very high and stopping the Delphi process was justified since it was unlikely there would be further changes in the experts’ opinion even though it may have differed from that of the others. The low Kappa statistics in the last column of Table 3 and the low ICC values confirmed that experts did not agree with each other for many items. This implies that experts were unlikely to have achieved a high consensus in opinion even if more rounds had been performed [44]. Recommendations have previously been made for the number of rounds of the Delphi technique [45]. Four Delphi rounds were suggested by Sumsion [46]. However, two to three rounds are currently used, to avoid fatigue of the respondents [47]. Our findings confirm that more than three Delphi rounds would probably not be of further benefit. Table 4 shows the non-significant effect of round number on experts’ opinions, and demonstrates that participants did change their ideas a little when they saw the results in the first round but did not change their ideas in the subsequent rounds and overall agreement could not be better as rounds increased.

Even though Delphi is a good study design for achieving consensus among experts, a true consensus might not be met since it is a manipulated consensus based on a compromised position [48]. Even though they had the freedom to make comments, experts were unavoidably forced to follow the structural domains we proposed in the first round. It was also suggested that experts should be selected from a wide spectrum of vested interest [49]. However, we selected only those from Beijing and Yunnan on the basis of convenience and budget constraint. However, the dendrogram (Figure 1) shows that experts’ ideas were independent of their geographical working location. Even though some Delphi studies have recruited very large numbers of participants for the panel, some authorities suggest a panel of 7 to 12 and some suggest up to 10 to 50 at most [45, 50]. As mentioned above, fixation of experts’ idea was reached at the third round, and having too many informants in a panel may not be a good strategy to improve agreement among them.

The development of a checklist from a consensus of well-recognized experts in psoriasis in China, allows further research studies and clinical practice to be standardized. Furthermore, based on a standard list of symptoms and signs, diagnosis and treatment of psoriatic patients may be unified and variations in clinical practice among TCM doctors can be minimized.

Conclusion

A checklist containing 96 items of 8 domains was developed for classifying psoriasis with traditional Chinese medicine symptoms and signs.

Declarations

Acknowledgements

We are grateful to all the experts who contributed to this checklist. The authors wish to thank Alan Geater for the English revision of this manuscript.

Authors’ Affiliations

(1)
Dermatology Department, Yunnan Provincial Hospital of Traditional Chinese Medicine
(2)
Epidemiology Unit, Faculty of Medicine, Prince of Songkla University

References

  1. Rook A, Savin JA, Wilkinson DS: The Prevalence, Incidence and Ecology of Diseases of The Skin. Textbook of Dermatology. Edited by: Rook A, Wtlkinson DS, Ebling FJG. 1986, Palo Alto: Blackwell Scientific Publications, 39-53. 4Google Scholar
  2. Stern RS, Nijsten T, Feldman SR: Psoriasis is common, carries a substantial burdeneven when not extensive, and is associated with widespread treatment dissatisfaction. J Investig Dermatol Symp Proc. 2004, 9: 136-139. 10.1046/j.1087-0024.2003.09102.x.View ArticlePubMedGoogle Scholar
  3. Naldi L: Epidemiology of psoriasis. Curr Drug Targets Imflamm Allergy. 2004, 3: 121-128. 10.2174/1568010043343958.View ArticleGoogle Scholar
  4. Raychaudhuri SP, Farber EM: The prevalence of psoriasis in the world. J Eur Acad Dermatol Venereol. 2001, 15: 16-17.View ArticlePubMedGoogle Scholar
  5. Shbeeb M, Uramoto KM, Gibson LE, O'Fallon WM, Gabriel SE: The epidemiology of psoriatic arthritis in Olmsted County, Minnesota, USA, 1982–1991. J Rheumatol. 2000, 27: 1247-1250.PubMedGoogle Scholar
  6. Gladman DD: Psoriatic arthritis. Dermatol Ther. 2004, 17: 350-363. 10.1111/j.1396-0296.2004.04038.x.View ArticlePubMedGoogle Scholar
  7. Taylor WJ: Epidemiology of psoriatic arthritis. Curr Opin Rheumatol. 2002, 14: 98-103. 10.1097/00002281-200203000-00004.View ArticlePubMedGoogle Scholar
  8. Raychaudhuri S, Farber E: The prevalence of psoriasis in the world. J Eur Acad Dermatol Venereol. 2008, 15 (1): 16-17.View ArticleGoogle Scholar
  9. Chandran V, Raychaudhuri SP: Geoepidemiology and environmental factors of psoriasis and psoriatic arthritis. J Autoimmun. 2010, 34 (3): 314-321. 10.1016/j.jaut.2009.12.001.View ArticleGoogle Scholar
  10. Gudjonsson JE, Elder JT: Psoriasis: epidemiology. Clin Dermatol. 2007, 25 (6): 535-546. 10.1016/j.clindermatol.2007.08.007.View ArticlePubMedGoogle Scholar
  11. Gudjonsson Koo J: Systemic sequential therapy of psoriasis: a new paradigm for Improved therapeutic results. J Am Acad Dermatol. 1999, 41 (3): S25-S28. 10.1016/S0190-9622(99)70363-4.View ArticleGoogle Scholar
  12. Koo J: Current consensus and update on psoriasis therapy: a perspective from the US. J Dermatol. 1999, 26 (11): 723-733.View ArticlePubMedGoogle Scholar
  13. Fleischer AB, Feldman SR, Rapp SR, Reboussin DM, Exum ML, Clark AR: Alternative therapies commonly used within a population of patients with psoriasis. Cutis. 1996, 58: 216-220.PubMedGoogle Scholar
  14. Koo J, Desai R: Traditional Chinese medicine in dermatology. Dermatol Ther. 2003, 16: 98-105. 10.1046/j.1529-8019.2003.01617.x.View ArticlePubMedGoogle Scholar
  15. Jiang M, Zhang C, Zheng G, Guo H, Li L, Yang J, Lu C, Jia W, Lu A: Traditional Chinese Medicine Zheng in the Era of Evidence-Based Medicine: A Literature Analysis. Evid Based Complement Alternat Med. 2012, 2012: 409568-PubMed CentralPubMedGoogle Scholar
  16. Cao YF: Zhu Bing Yuan Hou Lun. 1982, Beijing: People's Medical Publishing House, [In Chinese]Google Scholar
  17. Surgery of Traditional Chinese Medicine. Edited by: Lu DM. 1997, Shanghai: Shanghai Science &Technique Press, 2Google Scholar
  18. Lu AP, Jia HW, Xiao C: Theory of traditional Chinese medicine and therapeutic method of diseases [In Chinese]. World J Gastroenterol. 2004, 10: 1854-1856.PubMed CentralView ArticlePubMedGoogle Scholar
  19. Xu JX, Jiao AQ: The Conception and Syndromes of Traditional Chinese Medicine Standardization Research Chinese. Zhong Guo Zhong Yi Ji Chu Yi Xue (Chin J Basic Med TCM). 2005, 11: 261-265.Google Scholar
  20. Jiang YQ: The Influence of Geographic Difference of Syndromes Differentiation between Southern and Northern in China. Zhong Yi Za Zhi (J Trad Chin Med). 1991, 2: 49-51.Google Scholar
  21. Linstone H, Turoff M: The Delphi method: techniques and applications. 2002, Newark: New Jersey Institute of TechnologyGoogle Scholar
  22. Jones J, Hunter D: Consensus methods for medical and health services research. BMJ. 1995, 311: 376-380. 10.1136/bmj.311.7001.376.PubMed CentralView ArticlePubMedGoogle Scholar
  23. Andrews CG, Allen JM: Utilization of Technology-Enhanced Delphi Techniques. Workforce Education Forum. 2002, 29: 1-15. URL: http://digital.library.unt.edu/ark:/67531/metadc31077/m2/1/high_res_d/Allen-2002-Utilization_of_Technology-Enhanced_Delphi.pdfGoogle Scholar
  24. Linstone HA, Turoff M: The Delphi method: Techniques and applications. 1975, London: Addison- Wesley Publishing Company, Advanced Book ProgramGoogle Scholar
  25. Roth RM, Wood WC: A Delphi approach to acquiring knowledge from single and multiple experts. 1990, Orlando: Association for Computing MachineryView ArticleGoogle Scholar
  26. Fleiss JL, Cohen J: The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973, 33: 613-619. 10.1177/001316447303300309.View ArticleGoogle Scholar
  27. R Development Core Team. R: A language and environment for statistical computing. 2012, Vienna: R Foundation for Statistical Computing, URL: http://cran.r-project.org/ISBN 3-900051-07-0Google Scholar
  28. Chongsuvivatwong V: Epicalc: Epidemiological calculator. R package version 2.12.2.3. 2011, Vienna: CRAN, URL: http://cran.r-project.org/web/packages/epicalc/index.htmlGoogle Scholar
  29. Falissard B: Psy: Various procedures used in psychometry. R package version 1.0. 2009, Vienna: CRAN, URL: http://CRAN.R-project.org/package=psyGoogle Scholar
  30. Robinson A, Kardos M, Kimball AB: Physician Global Assessment (PGA) and Psoriasis Area and Severity Index (PASI): Why do both? A systematic analysis of randomized controlled trials of biologic agents for moderate to severe plaque psoriasis. J Am Acad Dermatol. 2011, 66: 369-375.View ArticlePubMedGoogle Scholar
  31. Setty AR, Curhan G, Choi HK: Smoking and the risk of psoriasis in women: Nurses' Health Study II. Am J Med. 2007, 120: 953-959. 10.1016/j.amjmed.2007.06.020.PubMed CentralView ArticlePubMedGoogle Scholar
  32. Gao XJ: Explore Relationship of Spleen and Stomach theory between Gastric-Intestinal and Pancreatic Endocrine System. Zhong Guo Zhong Xi Yi Jie He Za Zhi (Chin J IntegTrad West Med). 1984, 4: 186-188.Google Scholar
  33. Shang X, Zeng C, Zhang YZ: Dispersing and Discharging Function of The Liver Associated with Gynecological Emotion Diseases. Hunan Zhong Yi Za Zhi (Hunan J Trad Chin Med). 2005, 21: 90-91.Google Scholar
  34. Prignano F, Ricceri F, Pescitelli L, Lotti T: Itch in psoriasis: epidemiology, clinical aspects and treatment options. Clin Cosmet Investig Dermatol. 2009, 2: 9-13.PubMed CentralView ArticlePubMedGoogle Scholar
  35. Van de Kerkhof P, De Hoop D, De Korte J, Cobelens S, Kuipers M: Patient compliance and disease management in the treatment of psoriasis in the Netherlands. Dermatol. 2000, 200: 292-298. 10.1159/000018390.View ArticleGoogle Scholar
  36. Kurd SK, Troxel AB, Crits-Christoph P, Gelfand JM: The risk of depression, anxiety and suicidality in patients with psoriasis: A population-based cohort study. Arch Dermatol. 2010, 146: 891-895. 10.1001/archdermatol.2010.186.PubMed CentralPubMedGoogle Scholar
  37. Li WF, Wang P: Clinical Analysis of 47 Patients with Psoriasis Arthropathy Treated by Traditional Chinese Medicine Syndrome Differentiation and Integrative Medicine. Zhong Guo Zhong Xi Yi Jie He Za Zhi (Chin J Integ Trad West Med). 2008, 28: 928-931.Google Scholar
  38. Zargari O: The prevalence and significance of fissured tongue and geographical tongue in psoriatic patients. Clin Experiment Dermatol. 2006, 31: 192-195. 10.1111/j.1365-2230.2005.02028.x.View ArticleGoogle Scholar
  39. Gan HF, Cai DH: Tongue Research Situation on Psoriatic Patient. Zhong GuoZhong Xi Yi Jie He Pi Fu Xing Bing Xue Za Zhi (Chin J Dermatol Venereol Integ Trad West Med). 2010, 9: 327-329.Google Scholar
  40. Zhang GZ, Wang P, Wang JS, Jiang CY, Deng BX, Li P, Zhao YM, Liu WL, Qu X, Chen WW, Zeng L, Zhou DM, Sun LY, Li RY: Study on the Distribution and Development Rules of TCM Syndromes of 2651 Psoriasis Vulgaris Cases [In Chinese]. Zhong Yi Za Zhi (J Trad Chin Med). 2008, 49 (10): 894-896.Google Scholar
  41. Gudjonsson J, Thorarinsson A, Sigurgeirsson B, Kristinsson K, Valdimarsson H: Streptococcal throat infections and exacerbation of chronic plaque psoriasis: a prospective study. Br J Dermatol. 2003, 149: 530-534. 10.1046/j.1365-2133.2003.05552.x.View ArticlePubMedGoogle Scholar
  42. Mowad CM, Margolis DJ, Halpern AC, Suri B, Synnestvedt M, Guzzo CA: Hormonal influences on women with psoriasis. Cutis. 1998, 61 (5): 257-260.PubMedGoogle Scholar
  43. Dika E, Bardazzia F, Balestria R, Maibach HI: Environmental factors and psoriasis. In Environmental factors in skin diseases. Curr Probl Dermatol. 2007, 35: 118-135.View ArticlePubMedGoogle Scholar
  44. Scheibe M, Skutsch M, Schofer J: Experiments in Delphi methodology. The Delphi Method: Techniques and Applications. Edited by: Linstone HA, Turoff M. 1975, London: Addison-Wesley Publishing Company, Reading, MA, 262-287.Google Scholar
  45. Mullen PM: Delphi: myths and reality. J Health Organ Manag. 2003, 17 (1): 37-52. 10.1108/14777260310469319.View ArticlePubMedGoogle Scholar
  46. Sumsion T: The Delphi technique: an adaptive research tool. Br J Occup Ther. 1998, 61 (4): 153-156.View ArticleGoogle Scholar
  47. Walker AM, Selfe J: The Delphi method: a useful tool for the allied health researcher. Br J Ther Rehabilitation. 1996, 3 (12): 677-680.View ArticleGoogle Scholar
  48. Mitroff II, Turoff M: Philosophical and methodological foundations of Delphi. The Delphi method: Techniques and applications. Edited by: Linstone HA, Turoff M. 1975, Reading MA: Addison-Wesley Publishing CoGoogle Scholar
  49. Wild C, Torgersen H: Foresight in medicine: lessons from three European Delphi studies. Eur J Public Health. 2000, 10 (2): 114-119. 10.1093/eurpub/10.2.114.View ArticleGoogle Scholar
  50. Turoff M: The design of a policy Delphi. Technol Forecast Soc Change. 1970, 1 (2): 149-171.Google Scholar

Copyright

© Yang et al.; licensee BioMed Central Ltd. 2013

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Advertisement