A Note from the author of Dissociative Identity Disorder in a Nutshell:
Below is a very interesting scientific paper I found that is from the European Journal of Psychotramatology. It is a little hard to read, but the information it contains is fascinating.
The paper is written about research done to determine if there is a reliable way to test people who exhibit the symptoms of DID and if so how to plan for a treatment. If they can find definitive, consistent and helpful methods for therapists to use in DID treatment, we can end the debate as to its validity once and for all. It is good to know that this type of research is being carried out.
Please don’t be intimidated by these types of papers, they really aren’t as bad as they look at first. One way to help yourself, if you have little or no knowledge of reading scientific papers, is to read the abstract, the objective, the discussion and the conclusion. That way you get the gist of what the author’s are saying. Then if you wish, you can go back and read the rest.
I’ve highlighted the headings for the parts I listed above so you can find them easier.
For formatting purposes, the tables have been moved to the end.
Read it slowly, and try to grasp what they are saying about trauma. Shirley
ISSN: 2000-8198 (Print) 2000-8066 (Online) Journal homepage: http://www.tandfonline.com/loi/zept20
Assessing therapeutic change in patients with severe dissociative disorders: the progress in treatment questionnaire, therapist and patient measures.
Hugo Schielke, Bethany Brand & Angelika Marsic
To cite this article: Hugo Schielke, Bethany Brand & Angelika Marsic (2017) Assessing therapeutic change in patients with severe dissociative disorders: the progress in treatment questionnaire, therapist and patient measures, European Journal of Psychotraumatology, 8:1, 1380471, DOI: 10.1080/20008198.2017.1380471
To link to this article: http://dx.doi.org/10.1080/20008198.2017.1380471
© 2017 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group.
Published online: 13 Oct 2017.
Background: Treatment research for dissociative identity disorder (DID) and closely related severe dissociative disorders (DD) is rare, and has been made more difficult by the lack of a reliable, valid measure for assessing treatment progress in these populations.
This paper presents psychometric data for therapist and patient report measures developed to evaluate therapeutic progress and outcomes for individuals with DID and other the Progress in Treatment Questionnaire – Therapist (PITQ-t; a therapist report measure) and the Progress in Treatment Questionnaire – Patient (PITQ-p; a patient self-report measure). Method: We examined the data of 177 patient–therapist pairs (total N = 354) participating in the TOP DD Network Study, an online psychoeducation programme aimed at helping patients with DD establish safety, regulate emotions, and manage dissociative and posttraumatic symptoms.
The PITQ-t and PITQ-p demonstrated good internal consistency and evidence of moderate convergent validity in relation to established measures of emotional dysregulation, dissociation, posttraumatic stress disorder, and psychological quality of life, which are character-istic difficulties for DD patients. The measures also demonstrated significant relationships in the hypothesized directions with positive emotions, social relations, and self-harm and dangerous behaviours. The patient-completed PITQ-p, which may be used as an ongoing assessment measure to guide treatment planning, demonstrated evidence of stronger relationships with established symptom measures than the PITQ-t.
The PITQ-t and PITQ-p merit use, additional research, and refinement in relation to the assessment of therapeutic progress with patients with DD.
Epidemiological studies suggest that dissociative identity disorder (DID) occurs in approximately 1.5% of the general U.S. population (American Psychiatric Association [APA], 2013; Johnson, Cohena, Kasena, & Brook, 2006) and 1% of all avail-able community samples internationally, and that prevalence increases with level of care (median out-patient prevalence rate: 2.5%, median inpatient pre-valence rate: 5%; Foote, 2016). Dissociative disorder not otherwise specified (DDNOS), the DSM-IV-TR diagnosis assigned to patients with symptoms similar to DID (Spiegel et al., 2011), is more than twice as prevalent in the U.S. (4.4%; Johnson et al., 2006). These severe dissociative disorder (DD) patients fre-quently present with myriad difficulties, including emotion dysregulation, intrusions of traumatic experiences and other symptoms of posttraumatic stress disorder (PTSD), dissociation, self-harm, sui-cidality, attachment and relationship difficulties (including mistrust of therapists), and poor quality of life (Brand, Classen, Lanius et al., 2009; Foote, Smolin, Kaplan, Legatt, & Lipschitz, 2006; Johnson et al., 2006; Liotti, 1992; Mueller-Pfeiffer et al., 2012; Pasquini, Liotti, Mazzotti, Fassone, & Picardi, 2002). Treatment research for DD patients is scarce, how-ever (Brand, Classen, McNary, & Zaveri, 2009), and is made more difficult by the lack of a reliable, validated measure for assessing DD treatment progress. To address this need, this paper presents psychometric data for two brief measures for assessing DD treat-ment progress and outcomes: the Progress in Treatment Questionnaire – Therapist (PITQ-t; a therapist report instrument), and the Progress in Treatment Questionnaire – Patient (PITQ-p; a patient self-report instrument). These measures represent new versions of the Progress in Treatment Questionnaire (PITQ; Brand, Classen, Lanius et al., 2009), a therapist report measure designed to assess patient capacities targeted in the treatment of adult DID patients.
1.1. The Progress in Treatment Questionnaire
The Progress in Treatment Questionnaire (PITQ) was developed for the naturalistic Treatment of Patients with Dissociative Disorders (TOP DD) study (Brand, Classen, Lanius et al., 2009, Brand et al., 2013). The TOP DD study was a 30-month naturalistic study of DD patients’ progress in individual therapy. Prior to this study, only one DID-specific progress/outcome measure had been developed: the Dimensions of Therapeutic Movement Instrument (DTMI; Kluft, 1994). The DTMI is com-pleted by clinicians who rate their DD patients in 12 areas, including the therapeutic relationship, self-regula-tion, need for external support, phenomena related to dissociative self-states (DSS),1 interpersonal functioning, and sense of well-being. The DTMI offers promise as a therapist-completed assessment measure, but has not been systematically assessed for reliability or validity (Choe & Kluft, 1995; Kluft, 1994) and is sufficiently complex that it was deemed too difficult to use in online research such as the TOP DD study.
For these reasons, the TOP DD investigators devel-oped the PITQ. As described in Brand, Classen, Lanius et al. (2009), the DD treatment experts involved in the study designed the therapist-completed PITQ by con-sensus to assess DD patients’ ability to safely and effec-tively manage their emotions, symptoms, and relationships; these are adaptive capacities developed across the three stages of treatment described in the International Society for the Study of Trauma & Dissociation’s (ISSTD) Guidelines for Treating Dissociative Identity Disorder in Adults (2005, 2011). PITQ item development was informed by the ISSTD Treatment Guidelines, the items in the DTMI, and the TOP DD team’s extensive clinical experience. PITQ items most closely linked with the first stage of treatment, establishing patient safety and stabilization (Brand et al., 2012; ISSTD, 2011), query patients’ ability to maintain safety (i.e. not engage in behaviours that put their life or health at risk, including non-suicidal self-injury, suicid-ality, and other dangerous behaviours); effectively collaborate with their therapist; understand and manage DD- and PTSD-related symptoms; manage self-care/ daily living; view themselves and others in realistic ways that are free from trauma-based distortions; maintain healthy personal and professional relationships; tolerate, regulate, and identify affect; and develop cooperation with DSS. PITQ items most closely linked with the second phase of treatment, processing trauma, query patients’ ability to process trauma and identify and understand the roles of DSS. PITQ items most closely linked with the third phase of treatment, reconnection, query patients’ ability to resolve (Kluft, 1993; Kluft & Loewenstein, 2007) the conflicts between and/or inte-grate DSS and find ways to make life feel meaningful and rewarding. An item also queries patients’ ability to pleasurably experience sexual intimacy, which can be difficult for individuals with DDs. The PITQ’s 29 items ask therapists to indicate what percentage of the time their patient has demonstrated the queried abilities over the prior six months. Each item offers 11 response options ranging from 0% (never) to 100% (always) in 10% intervals (i.e. 0%, 10%, 20%, etc.).
1.1.1. Psychometric properties of the PITQ
18.104.22.168. Reliability. The PITQ has demonstrated evi-dence of internal consistency (i.e. internal reliability) (Brand, Classen, Lanius et al., 2009, Brand et al., 2013; Marsic, Brand, Schielke, & Putnam, 2013) and test-retest reliability (Marsic et al., 2013) in studies with DD patients. In a 30-month prospective, naturalistic study of the treatment of DD patients, the PITQ demonstrated Cronbach’s coefficients ranging from .94 to .95 (see Brand, Classen, Lanius et al., 2009, and Brand et al., 2013 for methodology details). In an IRB-approved study aimed at assessing the test-retest reliability of the PITQ, we invited therapists who had participated in the naturalistic study to complete the PITQ at two time points (two weeks apart) for a single adult outpatient diagnosed DID or DDNOS by DSM-IV-TR criteria (Marsic et al., 2013). To increase generalizability, we did not exclude patients based on psychiatric comorbid-ity. No patient-identifying information was collected, and therapist participants’ data was de-identified. Participation was excluded for therapists without access to the internet or unable to read English. A total of 117 therapists consented to participate in the study; 74 (53 females and 21 males) completed the PITQ at both Time 1 and Time 2 (retention rate: 63%). Responses were matched by participant code numbers. Analysis of parti-cipants’ test responses revealed a strong Pearson’s pro-duct moment correlation (.87, p > .01) between the two administrations, suggesting good test-retest reliability and temporal stability over a two-week period (M = 16.6 days). The probability of these findings occur-ring in the same population by chance was found to be <1% [t(73) = −2.72, p = .008], and a Pittman-Morgan test of homogeneity of variance indicated that there was no significant difference in variance between the two sam-ples [t(72) = .61, p = .54] (SD Time 1 = 16.09, SD Time 2 = 14.99). The PITQ demonstrated good internal con-sistency at both time points (Cronbach’s alpha: .95 and .94, respectively).
22.214.171.124. Validity. Abilities assessed by the PITQ corre-spond with DD treatment experts’ endorsed intervention targets (see Table 1). As a measure intended to assess patients’ development of adaptive capacities in managing safety, emotion, symptoms, and relationships, PITQ scores should be higher in patients in later stages of treatment. Consistent with this theory, in cross-sectional comparisons, mean PITQ scores were significantly higher in patients in the ‘processing trauma’ and ‘recon-nection’ stages than in patients in stage 1 (p < .01; Hedge’s g, ‘processing’ vs. ‘establishing safety’: 1.73; Hedge’s g, ‘reconnection’ vs. ‘establishing safety’: 2.90; Brand et al., 2009). Similarly, in longitudinal analyses of TOP DD participants over 30 months, PITQ scores increased over time (Brand et al., 2013); these increases in PITQ scores coincided with reductions in symptoms of dissociation, depression, general distress, and PTSD, as well as with reductions in substance use and danger-ous behaviour.
1.2. Development of the PITQ-p and PITQ-t
1.2.1. PITQ-t development
The therapist-completed PITQ-t is a modestly updated version of the original PITQ. To explore use of the PITQ-t with patients that do not report DSS, we reor-ganized the measure such that DSS-related items are presented last, preceded by instructions to only rate DSS functioning if a patient experiences DSS. In response to suggestions that we clarify three PITQ items related to patient difficulties, we re-phrased and reverse-scored these items (Table 5, items 1–3). The remaining 26 items, response options, and targeted time frame are unchanged from the original PITQ.
1.2.2. PITQ-p development
Recent research underscores the value of querying patients’ views about their treatment. A meta-analysis of six studies comprising over 6000 treatments (Shimokawa, Lambert, & Smart, 2010) found that regu-larly assessing and reviewing patient treatment progress feedback with the OQ patient feedback system (e.g. Lambert, 2015) resulted in improved outcomes for patients demonstrating difficulties in making or sustain-ing treatment gains. A meta-analysis of 201 therapeutic alliance studies comprising over 14,000 treatments (Horvath, Del Re, Flückiger, & Symonds, 2011) found that patient-reported alliance data were generally more strongly predictive of therapeutic outcome than thera-pist-reported data. These findings prompted the first and second authors to develop a patient version of the PITQ. We believed that a patient version of the PITQ could afford additional insight into patients’ therapeutic pro-gress and inform treatment planning while also offering patients opportunities to reflect on how they are doing in relation to DD treatment targets. Informed by the ther-apeutic alliance meta-analysis, we also anticipated that such a measure would demonstrate a stronger relation-ship with variables indicative of therapeutic progress than the therapist-completed PITQ-t.
In the 32-item PITQ-p, DSS items are presented last, preceded by instructions to complete these items only if relevant. Two PITQ prompts related to fusion and inte-gration of DSS were not included because of the potential for some patients to perceive these as suggesting DSS ‘loss’ or ‘death’ (Kluft, 1993). We rephrased the remain-ing 27 of the PITQ’s 29 items in patient-appropriate language, and added five items (items 3, 4, 12, 28, and 31 in Table 7) in the interest of raising patient awareness of (and tracking progress related to) these adaptive capa-cities. To increase the PITQ-p’s potential usefulness as a routinely-administered measure, we also changed the targeted time frame to ‘in the last week’.
We examined the internal consistency and convergent validity of the PITQ-t and PITQ-p in use with DD patients at baseline in a prospective longitudinal study. We hypothesized that higher PITQ-t and PITQ-p scores would be negatively correlated with concurrent validated measures indicating difficulties with emotional dysregulation, PTSD, and dissociation symp-toms. We also hypothesized that PITQ-t and PITQ-p scores would be negatively correlated with self-harm and dangerous and impulsive actions, and positively correlated with positive emotions and quality of life.
Participants consisted of 177 patient–therapist pairs (total N = 354 individuals) who consented to participate in the TOP DD Network study, an IRB-approved study examining the effectiveness of an online psychoeduca-tional programme aimed at helping early-stage DD patients learn skills to help them regulate emotion, man-age DD and PTSD symptoms, and establish safety from behaviours that put their life or health at risk, including non-suicidal self-injury, suicidality, and other dangerous behaviours. We solicited participants through flyers and announcements at trauma and dissociation-focused con-ferences, email invitations to trauma- and dissociation-related mailing lists, and emails to therapists who had taken part in the naturalistic TOP DD study. Therapists were asked to invite a patient to participate who met diagnostic criteria for Dissociative Identity Disorder (DID; DSM-IV-TR, DSM-5), Dissociative Disorder Not Otherwise Specified (DDNOS; DSM-IV-TR), or Other Specified Dissociative Disorder (OSDD; DSM-5); had been in treatment with them for at least three months; was 18 years or older; had reliable high-speed internet access; was able to read English at the eighth grade level; could tolerate non-detailed references to trauma, safety struggles, dissociation, and brief mentions of ‘parts of collaborate with their therapist; understand and manage DD- and PTSD-related symptoms; manage self-care/ daily living; view themselves and others in realistic ways that are free from trauma-based distortions; maintain healthy personal and professional relationships; tolerate, regulate, and identify affect; and develop cooperation with DSS. PITQ items most closely linked with the second phase of treatment, processing trauma, query patients’ ability to process trauma and identify and understand the roles of DSS. PITQ items most closely linked with the third phase of treatment, reconnection, query patients’ ability to resolve (Kluft, 1993; Kluft & Loewenstein, 2007) the conflicts between and/or inte-grate DSS and find ways to make life feel meaningful and rewarding. An item also queries patients’ ability to pleasurably experience sexual intimacy, which can be difficult for individuals with DDs. The PITQ’s 29 items ask therapists to indicate what percentage of the time their patient has demonstrated the queried abilities over the prior six months. Each item offers 11 response options ranging from 0% (never) to 100% (always) in 10% intervals (i.e. 0%, 10%, 20%, etc.).
2.2.1. Progress in Treatment Questionnaire, therapist version (PITQ-t)
The PITQ-t (available at TOPDDStudy.com/PITQ-t) is a therapist-completed 29-item measure of dissocia-tive patients’ ability to manage their emotions, symp-toms, relationships, safety, and well-being. The instrument prompts therapists to assess the percentage of time their patients demonstrate expert-identified treatment-related behaviours over the prior six months, and includes six items completed only for patients with DSS (items 24–29). Response options range from 0% (never) to 100% (always); the first three items are reverse-scored. Higher scores indicate better adaptive functioning.
2.2.2. Progress in Treatment Questionnaire, patient version (PITQ-p)
The PITQ-p (available at TOPDDStudy.com/PITQ-p) is a patient self-report measure that assesses DD patients’ ability to manage their emotions, symptoms, relationships, safety, and well-being. The PITQ-p con-sists of 32 expert-identified items; items 27–32 are only completed by patients who report experiencing DSS. Patients are instructed to report what percentage of time they demonstrated a behaviour during the prior week, ranging from 0% (never) to 100% (always). Higher scores indicate better adaptive functioning.
2.2.3. Difficulties in emotion regulation scale (DERS; Gratz & Roemer, 2004)
The DERS is a 36-item self-report measure that assesses six domains associated with emotion regulation: emo-tional acceptance; emotional awareness; ability to iden-tify and understand emotions; access to effective self-regulation strategies; ability to control impulses; and ability to engage in goal directed behaviour when upset. Response options range from 1 (almost never; 0–10%) to 5 (almost always; 91–100%); higher scores indicate greater difficulty with emotion dysregulation and poorer psychological functioning. The DERS has high internal consistency (α = .93), good overall test-retest reliability (ρI = .88, p < .01) and adequate subscale test-retest reliability (ρIs ranging from .68 to .89, all ps <.01) over 4–8-weeks, and adequate construct and predictive validity (Gratz & Roemer, 2004). Cronbach’s alpha was .84 in the current sample.
2.2.4. Dissociative experiences scale II (DES II; Bernstein & Putnam, 1986)
The DES is a 28-item self-report measure of dissocia-tion-related symptoms. Responses range from 0% (never) to 100% (always). Higher average scores indicate greater dissociation. A meta-analysis (van IJzendoorn & Schuengel, 1996) revealed that the mea-sure has demonstrated high internal consistency (α = 0.93; 16 studies) and test-retest reliability (ranging from 0.78 to 0.93; six studies), as well as strong con-vergent validity (r = 0.67; 26 studies). Cronbach’s alpha was .96 in this sample.
2.2.5. Posttraumatic stress checklist – civilian (PCL-C; Weathers, Litz, Huska, & Keane, 1994)
The PCL-C is a 17-item self-report measure that assesses DSM-IV-TR PTSD symptoms (APA, 2000). Patients rate the frequency of experiencing each symptom over the past month from 1 (not at all) to 5 (extremely). Higher scores indicate greater PTSD symptoms (Weathers & Ford, 1996). The measure has high overall diagnostic efficiency (0.90; Blanchard, Jones-Alexander, Buckely, & Forneris, 1996) and strong test-rest reliability (.96 with 2–3 day interval; Weathers et al., 1994). In this sample, Cronbach’s alpha was .88.
2.2.6. World Health Organization Quality of Life– BREF (WHOQOL-BREF; Skevington, Lotfy, & O’Connell, 2004): psychological and social relationships domains
The WHOQOL-BREF is a 26-item measure consist-ing of a subset of items from the WHOQOL-100 that assesses quality of life in four domains; this study focused on the psychological and social domains. Individuals rate their quality-of-life using 5-point Likert scale response options. Responses are transformed to a scale ranging from 0–100 to enable comparisons across domains; higher domain scores indicate higher quality of life. The WHOQOL-BREF has demonstrated signif-icant discriminant validity in the majority of the countries studied, as well as acceptable internal consistency (Cronbach’s alpha >.7) with respect to the psychological (.81) domain, and borderline internal consistency (.68) with respect to the social domain (Skevington, Lotfy, & O’Connell, 2004). In this study, Cronbach’s alpha was .79 for the psy-chological domain and .57 for the social domain. See Table 4 for descriptive statistics.
2.2.7. Other functioning-related variables
Data indicating self-harm, dangerous actions, and impulsive actions, as well as positive emotions, were collected and analysed; see Table 4 for items’ wording and descriptive statistics.
The study was approved by the Institutional Review Board at Towson University. Survey data were col-lected using secured, password-protected websites. All participants completed informed consent forms prior to participating. Participants were not compen-sated for participation.
2.3.1. Analysis strategy
All analyses were performed on baseline data (i.e. data collected prior to participants engaging with the Network psychoeducational programme). To evalu-ate PITQ-t and PITQ-p internal consistency, we calculated Cronbach’s alphas and examined item-total statistics to assess whether internal reliability would be meaningfully improved by item deletion. To examine convergent validity, we assessed correla-tions between the PITQ-t and PITQ-p and the DERS, DES II, and PCL-C, as well as with patient reported self-harm, dangerous and impulsive actions, positive emotions, and psychological and social quality of life. Since higher scores for the DERS, DES II, and PCL-C are associated with greater psychological difficulty (in contrast to the PITQ-t and PITQ-p), we hypothesized that we would find negative correlations between concurrent administrations of these measures and the PITQ-t and PITQ-p. We also hypothesized that PITQ-t and PITQ-p scores would be negatively correlated with patient self-harm and dangerous and impulsive actions, and positively related to positive emotions and psychological and social quality of life. Informed by Hittner, May, and Silver (2003), we used Williams’ (1959) standard t to assess the significance of differences between the PITQ-t and PITQ-p’s correlations with other measures and variables. Analyses were performed in SPSS version 23; William’s standard t was calculated using syntax developed by Weaver and Wuensch (2013).
3.1. PITQ-t item-total correlation of .09; and Item 22, ‘Able to experience sexual intimacy without difficulties such as intense shame, flashbacks or dissociation and with some pleasure’ demonstrated a corrected item-total correlation of .23. Examination of item-total statistics indicated that Cronbach’s alpha would be unchanged by deleting items 2 or 22, and would become .92 if Item 3 were deleted. Given the clinical salience of these items for DD patients, and that their deletion would have little impact on internal consistency, we retained them.
3.1.2. Convergent validity
Correlations between the PITQ-t and the DERS, DES II, and PCL-C were significant at the .01 level (2-tailed) in the hypothesized negative direction: higher scores on the PITQ-t were associated with lower scores on the DERS (r = -.35), DES II (r = -.29), and PCL-C (r = -.41) (see Table 6). Correlations between the PITQ-t and unsafe behaviour in the last 30 days were also signifi-cant (p < .01) in the expected negative direction: self-harm (r = -.37), dangerous behaviour (r = -.31), and impulsive behaviours (r = -.23). Finally, the PITQ-t demonstrated the expected positive correla-tions (p < .01) with psychological (r = .45) and social (r = .22) quality of life, and positive emotions (r = .21) (see Table 6).
3.2.1. Internal consistency
The PITQ-p also demonstrated good internal consis-tency (α = .92). Corrected item-total correlations (see Table 7) generally ranged from .36 to .64, with two exceptions: Item 1 (‘I have been diagnosed with a dis-sociative disorder and agree that this diagnosis is cor-rect’) demonstrated a corrected item-total correlation of .17 and Item 25 (‘I am able to experience sexual inti-macy without intense shame, flashbacks, or dissocia-tion, and with some pleasure’) demonstrated a corrected item-total correlation of .27. Examination of item-total statistics for these items indicated that relia-bility would not be improved by deleting either item.
3.2.2. Convergent validity
As predicted, higher scores on the PITQ-p were asso-ciated with lower scores on the DERS (r = -.67), DES II (r = -.42), and PCL-C (r = -.47), self-harm (r = -.34), self-danger (r = -.20), and impulsive actions (r = -.21) (see Table 6; p < .01 level, 2-tailed). As hypothesized, the PITQ-p was positively correlated (p < .01) with psychological (r = .64) and social (r = .28) quality of life, as well as positive emotions (r = .31).
3.3. Comparative strength of relationships between PITQ-t and PITQ-p and outcomes
Results of Williams’ standard t (see Table 6) indicated that the differences between the PITQ-t and PITQ-p’s correlations with outcomes were significant only in relation to the DERS (t174 = 5.51, p < .001) and WHOQOL-BREF Psychological Domain (t174 = −3.21, p < .001). The PITQ-p demonstrated evidence of sig-nificantly stronger correlations than the PITQ-t with each of these measures.
Treatment outcome research for DD patients is scarce. The lack of a reliable, validated measure for assessing progress towards resolving the myriad difficulties faced by DD patients contributes to the paucity of treatment research. To address this gap, we developed therapist (PITQ-t) and patient (PITQ-p) measures of the adaptive capacities expected to develop in DD patients over the course of trauma- and dissociation-focused treatment and examined their internal consis-tency and construct validity.
The PITQ-t and PITQ-p demonstrated evidence of good internal consistency, and significant, generally moderate concurrent relationships with established measures of adaptive emotion-related functioning, PTSD symptoms, dissociation, and psychological and social quality of life. Higher PITQ-t and PITQ-p scores were also related to lower levels of self-harm, danger-ous behaviours, and impulsivity, as well as higher positive emotions. This suggests that higher scores on the PITQ-t and PITQ-p are associated with better functioning in each of these domains, lending support to the use of the PITQ-t and PITQ-p in evaluating DD patients’ ability to manage their emotions, symptoms, relationships, safety, and well-being.
Consistent with our rationale for developing the PITQ-p, we found that the patient-completed mea-sure demonstrated stronger relationships with estab-lished symptom measures than the therapist-completed PITQ-t. Specifically, the correlations between the PITQ-p and measures of dissociation, PTSD, and emotion dysregulation were greater than those between these measures and the PITQ-t. The PITQ-p also demonstrated statistically stronger rela-tionships with measures of emotional dysregulation and psychological quality of life than the PITQ-t. These findings are consistent with research indicating a stronger relationship between patients’ reports (vs. therapist reports) of alliance and treatment outcome (Horvath et al., 2011), and underscore the salience of querying patients’ perceptions about their progress in treatment.
Chronic, complex DD have been conceptualized as disorders of affect regulation related to trauma and attachment difficulties (Brand & Lanius, 2014), and difficulties in affect regulation and posttraumatic stress have been found to predict increased dissociation (Briere, Hodges, & Godbout, 2010). Our findings add to the literature indicating the importance of assessing these areas of functioning in DD patients. The PITQ-p and PITQ-t assess adaptive capacities related to these difficulties, and the TOP DD naturalistic study demon-strated that these capacities develop over time in DD treatment (Brand, Classen, Lanius et al., 2009, 2013).
4.1. Limitations and areas for future study
This self-selected sample population consisted pre-dominantly of female Caucasian patients that pre-sented with DSS seeing primarily female therapists.
Future studies should strive to increase representa-tion of groups under-represented here, examine the validity and utility of the measures with patients who do not demonstrate or endorse DSS, and further examine the PITQ-t and PITQ-p’s consis-tency and validity in terms of replication and extension. This includes examining the measures’ temporal stability, discriminant validity, and utility with DD patients as well as with other populations that experience dissociation, including patients with the dissociative subtype of PTSD (DSM-5; Lanius, Brand, Vermetten, Frewen, & Spiegel, 2012; Stein et al., 2013; Wolf et al., 2012) and/or those report-ing complex trauma histories (Cook et al., 2005; Courtois, 2004; Ford & Courtois, 2009). Given that the measures studied in relation to the patient self-report version of the PITQ were each self-report measures, it is possible that shared method variance may be meaningfully contributing to the PITQ-p’s stronger relationships with these mea-sures. Future studies could include additional observational and/or collateral outcome measures as well as measures of divergent constructs and examine this question through the multi-trait, multi-method matrix approach (Campbell & Fiske, 1959). The measures’ relationships with other instruments and variables of interest should also be examined over multiple time-points within a longitudinal study, a process that is currently underway. Future studies could also examine if completing the PITQ-p during the course of ther-apy helps patients acquire awareness of the links between adaptive abilities and improved psycholo-gical quality of life more rapidly than those that do not complete the measure, and could examine whether regular use of the PITQ-p improves ther-apeutic progress and/or outcomes. Finally, in the present study, patients completed single-item vari-ables that assessed self-harm and impulsive and dangerous behaviours over the prior 30 days. Future studies should match the time frame for patient-reported outcomes with the seven-day time frame used by the PITQ-p.
Our findings suggest that the PITQ-t and PITQ-p are promising measures of adaptive functioning in DD patients and merit use and additional research in rela-tion to the assessment of therapeutic progress with patients with DD. These measures seem to capture important aspects of DD patients’ development of adaptive capacities in managing safety, emotion, symptoms, and relationships, and offer researchers and clinicians a means of tracking progress and study-ing the process of therapeutic change with this under-studied population. They are also promising tools for evaluating patients’ relative strengths and areas of difficulty, information that can guide treatment plan-ning (Lambert, Gregersen, & Burlingame, 2004; Pinsof Chambers, 2009) and facilitate treatment respon-siveness (Stiles, Honos-Webb, & Surko, 1998).
Therapists have informed us that these measures have been useful in treatment planning and in dis-cussing treatment progress with patients. The PITQ-p may be useful in facilitating treatment responsiveness by helping clinicians efficiently evaluate multiple areas of their DD patients’ functioning. Asking patients to periodically complete a PITQ-p enables therapists to rapidly assess the relative presence or absence of a range of expert-identified abilities to be targeted in treatment, allowing therapists to quickly assess areas of functioning that are frequently chal-lenging for DD patients and providing important information that can facilitate treatment planning.
Completing the PITQ-p also encourages patients to reflect on their progress towards treatment goals, which may, in turn, encourage increased use of the skills assessed within the measure.
Dissociative self-states are sometimes referred to as dissociative identities, personalities, alters, or ‘parts’.
No potential conflict of interest was reported by the authors.
Hugo Schielke http://orcid.org/0000-0002-4786-8080
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev). Washington, DC: Author.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
Blanchard, E. B., Jones-Alexander, J., Buckely, T. C., & Forneris, C. A. (1996). Psychometric properties of the PTSD checklist (PCL). Behaviour Research and Therapy, 34, 669–673. doi:10.1016/0005-7967(96)00033-2
Brand, B. L., Classen, C. C., Lanius, R., Loewenstein, R. J., McNary, S. W., Pain, C., & Putnam, F. W. (2009). A naturalistic study of dissociative identity disorder and dissociative disorder not otherwise specified patients treated by community clinicians. Psychological Trauma: Theory, Research, Practice, & Policy, 1(2), 153–171. doi:10.1037/a0016210
Brand, B. L., Classen, C. C., McNary, S. W., & Zaveri, P. (2009). A review of dissociative disorders treatment stu-dies. The Journal of Nervous and Mental Disease, 197, 646–654. doi:10.1097/NMD.0b013e3181b3afaa
Brand, B. L., & Lanius, R. A. (2014). Chronic complex dissociative disorders and borderline personality disor-der: Disorders of emotion dysregulation? Borderline Personality Disorder and Emotion Dysregulation. Retrieved from http://www.bpded.com/content/1/1/13
Brand, B. L., McNary, S. W., Myrick, A. C., Classen, C. C., Lanius, R., Loewenstein, R. J., . . . Putnam, F. W. (2013). A longitudinal naturalistic study of patients with disso-ciative disorders treated by community clinicians. Psychological Trauma: Theory, Research, Practice, and Policy, 5, 301–308. doi:10.1037/a0027654
Brand, B. L., Myrick, A. C., Loewenstein, R. J., Classen, C. C., Lanius, R., McNary, S. W., . . . Putnam, F. W. (2012). A survey of practices and recommended treatment inter-ventions among expert therapists treating patients with dissociative identity disorder and dissociative disorder not otherwise specified. Psychological Trauma: Theory Research, Practice, and Policy, 4(5), 490–500. doi:10.1037/a0026487
Briere, J., Hodges, M., & Godbout, N. (2010). Traumatic stress, affect dysregulation, and dysfunctional avoidance: A structural equation model. Journal of Traumatic Stress, 23, 767–774. doi:10.1002/jts.20578
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.
Choe, B. M., & Kluft, R. P. (1995). The use of the DES in studying treatment outcome with dissociative identity disorder: A pilot study. Dissociation, 8, 160–164.
Foote, B. (2016, November 22). Dissociative identity disorder: Epidemiology, pathogenesis, clinical manifes-tations, course, assessment, and diagnosis. UpToDate. Retrieved from https://www.uptodate.com/contents/dis sociative-identity-disorder-epidemiology-pathogenesis-clinical-manifestations-course-assessment-and-diagnosis
Foote, J. B., Smolin, Y., Kaplan, M., Legatt, M. E., & Lipschitz, D. (2006). Prevalence of dissociative disorders in psychia-tric outpatients. American Journal of Psychiatry, 163, 623– 629. doi:10.1176/appi.ajp.163.12.2189
Ford, J. D., & Courtois, C. A. (2009). Defining and under-standing complex trauma and complex traumatic stress disorders. In C. A. Courtois & J. D. Ford (Eds.), Treating complex traumatic stress disorders: An evidence-based guide (pp. 13–30). New York, NY: Guilford Press.
Gratz, K. L., & Roemer, L. (2004). Multidimensional assess-ment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 26, 41–54. doi:10.1023/B:JOBA.0000007455.08539.94
Hittner, J. B., May, K., & Silver, N. C. (2003). A Monte Carlo evaluation of tests for com- paring dependent correlations. The Journal of General Psychology, 130, 149–168. doi:10.1080/00221300309601282
International Society for the Study of Dissociation. (2005). Guidelines for treating dissociative identity disorder in adults. Journal of Trauma & Dissociation, 6, 69–149.
International Society for the Study of Trauma and Dissociation. (2011). Guidelines for treating dissociative identity disorder in adults, third revision. Journal of Trauma & Dissociation, 12, 115–187. doi:10.1080/ 15299732.2011.537247
Johnson, J. G., Cohena, P., Kasena, K., & Brook, J. S. (2006). Dissociative disorders among adults in the com-munity, impaired functioning, and axis I and II comor-bidity. Journal of Psychiatric Research, 40, 131–140. doi:10.1016/j.jpsychires.2005.03.003
Kluft, R. P. (1993). Clinical approaches to the integration of personalities. In R. P. Kluft, C. G. Fine, R. P. Kluft, & C. G. Fine (Eds.), Clinical perspectives on multiple person-ality disorder (pp. 101–133). Arlington, VA: American Psychiatric Association.
Note from Shirley: The tables below help explain what you just read.
Table 1. Relationships between abilities assessed by PITQ-t, PITQ-p, and expert intervention targets.
|Interventions that experts endorse using||PITQ-t items assessing ability||PITQ-p items assessing ability|
|‘very often’ during at least one stage of treatmenta||targeted by interventionb||targeted by interventionc|
|Establishing safety||1, 2||12, 18, 19|
|Teaching/practicing grounding||8||7, 28|
|Educating about disorders/treatment||4||1|
|Diagnosing psychiatric illnesses||*||*|
|Developing healthy relationships||17||17|
|Affect tolerance and impulse control||11, 12||10,||11|
|Stabilizing from current stressors||6||4,||5|
|Ego strengthening activities||3, 20||22,||24|
|Acceptance of DD diagnosis||4||1|
|Processing when and why dissociation occurs||15, 16||15,||16|
|Assess response to medications||*||*|
|CBT focused on cognitions||3, 9, 13, 20, 21, 24||3, 8, 13, 22, 23, 24, 27, 28|
|Awareness of emotion||10||9|
|Processing patient’s reactions to therapy||5||2|
|Stabilizing following intrusions from alleged perpetrators||6||4,||5|
|Cooperation with/between parts||26, 27||29,||32|
|Teaching/discussing attachment||^ (17, 20, 21)||^ (17, 22, 23)|
|Identifying/working with parts||25||30|
|Discussing therapeutic relationship||5||2|
|Awareness of body sensation||10||9|
|Exposure to traumatic memories/abreaction||18, 23||20,||26|
Interventions endorsed by at least 45% of experts; Brand et al. (2012).
PITQ-t items 4–29 (see Table 5 for item content) are taken verbatim from PITQ items; PITQ-t items 1–3 rephrase the content of the remaining 3 PITQ items for clarity.
See Table 7 for PITQ-p item content.
* Not a patient-targeted ability.
^ PITQ family of measures does not explicitly query, but is very closely related to (items in parentheses).
Table 2. Therapist characteristics.
|Primary Therapist Orientation|
|Years in Practice||(177)||17.75||9.20||1||44|
|Years Treating DD||(177)||10.63||7.78||1||34|
|Years Treating Trauma||(177)||15.48||8.64||1||44|
Multiple settings could be indicated.
Table 3. Patient characteristics.
|Therapist-Reported Patient Abuse History|
|Was the patient neglected as a child?||67||(118)|
|Was the patient emotionally or psychologically abused as a child?||86||(153)|
|Was the patient physically abused as a child?||67||(116)|
|Did the patient witness domestic violence as a child?||41||(73)|
|Was the patient sexually abused as a child?||83||(147)|
|Therapist-Assigned DD Diagnosis|
|Dissociative Identity Disorder||75||(133)|
|Dissociative Disorder Not Otherwise Specified (DSM-IV-TR)||23||(41)|
|Other Specified DD (DSM 5)||2||(3)|
Table 4. Descriptive statistics.
|WHOQOL-BREF Psychological Domain||8.77||2.47||4.00||16.00|
|WHOQOL-BREF Social Domain||10.33||3.20||4.00||17.33|
|Dangerous behaviour b||1.03||3.03||0||30|
a ‘On how many of the past 30 days did you purposefully hurt yourself (for example, cut yourself)?’
‘How many times in the past 30 days have you done something that in retrospect was dangerous enough to kill you?’
‘On how many of the past 30 days did you do something very impulsive (spending sprees, lost your temper and really shouted at someone, threatened to or actually harmed someone else, driven far too fast, done anything against the law, etc.)?’
‘On how many of the past 30 days did you feel some good feelings even if it was for a brief period (e.g. happiness, contentment, joy)?’
Table 5. PITQ-t item-total statistics.
|Corrected Item-Total||Cronbach’s Alpha|
|1. (R) Engages in self-injurious behaviour (e.g. cutting, burning) or suicide attempts||.37||.91|
|2. (R) Engages in potentially self-damaging acts such as abusing substances, purging, shoplifting,||.24||.91|
|3. (R) Identity is strongly tied to being a victim of abuse||.09||.92|
|4. Understands that they have a dissociative disorder (DD) and generally acknowledges that this||.40||.91|
|diagnosis is accurate|
|5. Able to maintain a strong treatment alliance and, when there are disruptions to the alliance, able to||.46||.91|
|work productively to repair it|
|6. Knows and uses self-soothing strategies (e.g. any type of calming strategy that is not used explicitly||.56||.90|
|to contain PTSD symptoms or prevent dissociation) when they are needed|
|7. Knows and uses containment strategies (e.g. hypnotic or imagery techniques used to contain||.54||.90|
|intrusive PTSD symptoms) when they are needed|
|8. Knows and uses grounding techniques to prevent self from going numb, zoning out, having||.47||.91|
|amnestic lapses when they are needed (e.g. techniques such as muscle contractions, movement, or|
|touching an object to avoid dissociating)|
|9. Keeps oriented in the present (i.e. does NOT get confused about past and present)||.46||.91|
|10.||Shows good awareness of his/her emotions and feels his/her body sensations||.68||.90|
|11.||Shows good affect tolerance (can feel emotions without getting overwhelmed)||.69||.90|
|12.||Shows good impulse control (e.g. can feel angry or depressed without acting it out)||.50||.91|
|13.||Is aware that the trauma was not his/her fault||.50||.91|
|14.||Manages daily functioning well (e.g. managing hygiene, maintaining a home, paying bills)||.37||.91|
|15.||Has continuous awareness of behaviours, that is, the patient does not report time loss or other signs||.55||.90|
|of amnesia (e.g. no behaviours done out of their awareness, no possessions for which they can’t|
|recall how they obtained them, etc.)|
|16.||Able to deal with stressful situations without dissociating||.61||.90|
|17.||Able to maintain healthy personal and professional relationships with other people||.61||.90|
|18.||Able to experience grief stemming from trauma-related losses||.56||.90|
|19.||Has found ways to make life feel meaningful and rewarding||.66||.90|
|20.||Has a generally positive view of him/herself||.69||.90|
|21.||Has a generally positive view of other people||.56||.90|
|22.||Able to experience sexual intimacy without difficulties such as intense shame, flashbacks or||.23||.91|
|dissociation and with some pleasure|
|23.||Able to tolerate doing trauma focused abreactive work (i.e. able to express intense affect about past||.52||.91|
|trauma, talk in detail about traumatic events, as well as explore the meaning, impact, and conflicts|
|related to trauma)|
|24.||Has awareness that all dissociated self-states are part of himself/herself and share one body (i.e.||.41||.91|
|does not believe one alter can ‘kill’ another and survive the suicide)|
|25.||Knows parts and understands their functions (i.e. what purposes they serve, such as helping manage||.56||.90|
|feelings related to trauma)|
|26.||Shows good internal communication and cooperation among parts||.63||.90|
|27.||Has reliable co-consciousness with all parts||.58||.90|
|28.||Has integrated at least two parts/self-states||.33||.91|
|29.||Has integrated all parts and no longer experiences amnesia, voices, passive influence or other signs||.37||.91|
|of identity fragmentation|
(R) = reverse scored.
Table 6. PITQ-t and PITQ-p correlations with measures and variables of interest and significance of comparative strength of PITQ-t and PITQ-p correlations with measures and variables of interest.
a–d: See Table 4.
p < .05 (2-tailed), ** p < .01 (2-tailed), rtp = correlation between PITQ-t and PITQ-p.
Table 7. PITQ-p item-total statistics.
|Corrected Item-Total||Cronbach’s Alpha|
|1. I have been diagnosed with a dissociative disorder and agree that this diagnosis is correct||.17||.92|
|2. I collaborate well with my therapist and, when there are problems between us, I talk to my therapist||.36||.92|
|about them so that we can resolve them together|
|3. I am compassionate and fair with myself, that is, I respond to myself with as much empathy as I||.52||.92|
|would show someone else in the same situation|
|4. I’m aware of the thoughts, feelings, and body sensations that indicate I’m getting anxious or||.44||.92|
|5. I use relaxation techniques (such as relaxation exercises, safe place imagery, music) to safely help||.54||.92|
|myself relax and feel better when I begin to get anxious or overwhelmed|
|6. I manage intrusive memories and flashbacks using containment strategies (imagery techniques used||.50||.92|
|to contain and manage PTSD symptoms)|
|7. I use grounding techniques when I need to prevent myself from going numb, zoning out, or losing||.45||.92|
|time (Examples: focus on my surroundings, pay attention to my five senses, tense and relax my|
|8. If I begin to confuse the past with the present, I notice this and work to see differences between||.54||.92|
|how things are now versus how they were when I was being traumatized|
|9. I am aware of my emotions and body sensations||.58||.92|
|10.||I am able to feel my emotions without getting overwhelmed||.60||.92|
|11.||I am aware of, able to think about, and can control my impulses (Example: I can feel angry or||.52||.92|
|depressed without doing something unhealthy)|
|12.||I reach out to treatment providers if I have difficulty controlling severe unhealthy impulses despite||.41||.92|
|using recovery-focused coping skills (e.g. grounding, past vs. present, containment)|
|13.||I know that the traumas that I experienced were not my fault||.59||.92|
|14.||I manage everyday life well (Examples: I regularly eat, bathe, pay bills on time, etc.)||.58||.92|
|15.||I am able to account for all that I do that is, I don’t ‘lose time’ or find evidence of having done||.55||.92|
|something I do not remember|
|16.||I am able to deal with stressful situations without dissociating||.57||.92|
|17.||I am able to maintain healthy personal and professional relationships||.57||.92|
|18.||I value my physical well-being, and do not do things that hurt my body (Examples: I don’t cut or||.53||.92|
|burn my body or attempt suicide)|
|19.||I value my health and do not do things that put me at risk (Examples: I do not abuse drugs, throw||.48||.92|
|up after eating, drive unsafely, have unsafe sex, etc.)|
|20.||I am able to experience sadness and grieve the losses related to trauma||.62||.92|
|21.||Life feels meaningful and rewarding||.58||.92|
|22.||I have a generally positive view of myself||.64||.92|
|23.||I have a generally positive view of other people||.37||.92|
|24.||My sense of myself includes many important things beyond having been traumatized||.57||.92|
|25.||I am able to experience sexual intimacy without intense shame, flashbacks, or dissociation, and with||.27||.92|
|26.||I can explore the meaning and impact related to the traumas I experienced, I can feel and express||.59||.92|
|the emotions related to these traumas|
|27.||All parts of myself know that we are part of the same person and that we share one body||.42||.92|
|28.||All parts of myself are oriented to the present (know what day, month, and year it is)||.47||.92|
|29.||I pay attention to and am curious about what different parts of myself are feeling||.58||.92|
|30.||I’m aware of which parts of myself are contributing to my actions||.50||.92|
|31.||All parts of myself know and can independently use recovery-focused coping skills (e.g. grounding,||.42||.92|
|past vs. present, containment)|
|32.||All parts of myself communicate and cooperate well||.53||.92|
Items 3, 4, 12, 28, and 31 reflect capacity targets introduced in the PITQ-p.
Kluft, R. P. (1994). Clinical observations on the CSDS Dimensions of Therapeutic Movement Instrument (DTMI). Dissociation, 7, 272–283.
Kluft, R. P., & Loewenstein, R. J. (2007). Dissociative dis-orders and depersonalization. In G. O. Gabbard (Ed.), Gabbard’s treatment of psychiatric disorders (4th ed., pp. 547–572). Washington, DC: American Psychiatric Publishing.
Lambert, M. J., Gregersen, A. T., & Burlingame, G. M. (2004). The Outcome Questionnaire. In M. E. Maruish (Ed.), The use of psychological testing for treatment plan-ning and outcomes assessment (3rd ed., pp. 191–234). Mahwah, NJ: Erlbaum.
Lanius, R. A., Brand, B., Vermetten, E., Frewen, P. A., & Spiegel, D. (2012). The dissociative subtype of posttrau-matic stress disorder: Rationale, clinical and neurobiolo-gical evidence, and implications. Depression and Anxiety, 29, 701–708. doi:10.1002/da.21889
Liotti, G. (1992). Disorganized/disoriented attachment in the etiology of the dissociative disorders. Dissociation: Progress in the Dissociative Disorders, 5, 196–204.
Marsic, A., Brand, B., Schielke, H. J., & Putnam, F. W. (2013, November). Internal and test-retest reliability of the progress in treatment questionnaire (PITQ). In Brand, et al. (Eds.), New findings from the Treatment of Patients with Dissociative Disorders “TOP DD” Study. Panel presented at the 30th Annual Conference of the International Society for the Study of Trauma and Dissociation. Baltimore, MD: International Society for the Study of Trauma and Dissociation.
Mueller-Pfeiffer, C., Rufibach, K., Perron, N., Wyss, D., Kuenzler, C., Prezewowsky, C., . . . Rufer, M. (2012). Global functioning and disability in dissociative disor-ders. Psychiatry Research, 200, 475–481. doi:10.1016/j. psychres.2012.04.028
Pasquini, P., Liotti, G., Mazzotti, E., Fassone, G., & Picardi, A. (2002). Risk factors in the early family life of patients suffering from dissociative disorders. Acta Psychiatrica Scandinavica, 105, 110–116.
Pinsof, W. M., & Chambers, A. L. (2009). Empirically informed systemic psychotherapy: Tracking client change and therapist behavior during therapy. In J. H. Bray & M. Stanton (Eds.), The Wiley-Blackwell handbook of family psychology (pp. 431–446). West Sussex: Blackwell Publishing Ltd.
Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298– 311. doi:10.1037/a0019247
Skevington, S. M., Lotfy, M., & O’Connell, K. A. (2004). The World Health Organization’s WHOQOL-BREF quality of life assessment: Psychometric properties and results of the international field trial: A report from the WHOQOL group. Quality of Life Research, 13, 299–310.
Spiegel, D., Loewenstein, R. J., Lewis-Fernandez, R., Sar, V., Simeon, D., Vermetten, E., . . . Dell, P. F. (2011). Dissociative disorders in DSM-5. Depression and Anxiety, 28, 824–852. doi:10.1002/da.20874
Stein, D. J., Koenen, K. C., Friedman, M. J., Hill, E. M., McLaughlin, K. A., Petukhova, M., . . . Kessler, R. C. (2013). Dissociation in posttraumatic stress disorder:12 H. SCHIELKE ET AL. Evidence from the world mental health surveys. Biological Psychiatry, 73, 302–312. doi:10.1016/j. biopsych.2012.08.022
Stiles, . W. . B., Honos-Webb, L., & Surko, . M. (1998). Responsiveness in psychotherapy. Clinical Psychology: Science And Practice, 5, 439–458.
van IJzendoorn, M., & Schuengel, C. (1996). The measure-ment of dissociation in normal and clinical populations: Meta-analytic validation of the Dissociative Experiences Scale (DES). Clinical Psychology Review, 16, 365–382. doi:10.1016/0272-7358(96)00006-2
Weathers, F. W., & Ford, J. (1996). Psychometric review of PTSD checklist. In B. H. Stamm (Ed.), Measurement of stress, trauma, and adaptation (pp. 250–251). Lutherville, MD: Sidran Press.
Weathers, F. W., Litz, B. T., Huska, J. A., & Keane, T. M. (1994). The PTSD checklist—civilian version (PCL-C).
Boston: National Center for PTSD.
Williams, E. J. (1959). The comparison of regression variables.Journal of the Royal Statistical Society (Series B), 21, 396–399.
Wolf, E. J., Miller, M., Reardon, A. F., Ryabchenko, K. A., Castillo, D., & Freund, R. (2012). A latent class analysis of dissociation and posttraumatic stress dis-order: Evidence for a dissociative subtype. Archives of General Psychiatry, 69, 698–705. doi:10.1001/ archgenpsychiatry.2011.1574