-
Loading metrics
Open Access
Peer-reviewed
Research Article
- Charlotte E. Dean,
- Shazia Akhtar,
- Tim M. Gale,
- Karen Irvine,
- Dominique Grohmann,
- Keith R. Laws
x
- Published: May 4, 2022
- https://doi.org/10.1371/journal.pone.0267360
Abstract
Background
Research into paranormal beliefs and cognitive functioning has expanded considerably since the last review almost 30 years ago, prompting the need for a comprehensive review. The current systematic review aims to identify the reported associations between paranormal beliefs and cognitive functioning, and to assess study quality.
Method
We searched four databases (Scopus, ScienceDirect, SpringerLink, and OpenGrey) from inception until May 2021. Inclusion criteria comprised papers published in English that contained original data assessing paranormal beliefs and cognitive function in healthy adult samples. Study quality and risk of bias was assessed using the Appraisal tool for Cross-Sectional Studies (AXIS) and results were synthesised through narrative review. The review adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and was preregistered as part of a larger registration on the Open Science Framework (https://osf.io/uzm5v).
Results
From 475 identified studies, 71 (n = 20,993) met our inclusion criteria. Studies were subsequently divided into the following six categories: perceptual and cognitive biases (k = 19, n = 3,397), reasoning (k = 17, n = 9,661), intelligence, critical thinking, and academic ability (k = 12, n = 2,657), thinking style (k = 13, n = 4,100), executive function and memory (k = 6, n = 810), and other cognitive functions (k = 4, n = 368). Study quality was rated as good-to-strong for 75% of studies and appears to be improving across time. Nonetheless, we identified areas of methodological weakness including: the lack of preregistration, discussion of limitations, a-priori justification of sample size, assessment of nonrespondents, and the failure to adjust for multiple testing. Over 60% of studies have recruited undergraduates and 30% exclusively psychology undergraduates, which raises doubt about external validity. Our narrative synthesis indicates high heterogeneity of study findings. The most consistent associations emerge for paranormal beliefs with increased intuitive thinking and confirmatory bias, and reduced conditional reasoning ability and perception of randomness.
Conclusions
Although study quality is good, areas of methodological weakness exist. In addressing these methodological issues, we propose that authors engage with preregistration of data collection and analysis procedures. At a conceptual level, we argue poorer cognitive performance across seemingly disparate cognitive domains might reflect the influence of an over-arching executive dysfunction.
Citation: Dean CE, Akhtar S, Gale TM, Irvine K, Grohmann D, Laws KR (2022) Paranormal beliefs and cognitive function: A systematic review and assessment of study quality across four decades of research. PLoS ONE 17(5):
e0267360.
https://doi.org/10.1371/journal.pone.0267360
Editor: José C. Perales, Universidad de Granada, SPAIN
Received: October 12, 2021; Accepted: April 6, 2022; Published: May 4, 2022
Copyright: © 2022 Dean et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All data files relating to the quality assessment are available from the OSF repository (https://osf.io/7bthg/). Data relating to the 71 reviewed studies can be found within the paper’s Supporting Information files.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The term “paranormal” typically refers to phenomena, such as psychokinesis, hauntings, and clairvoyance, which contradict the basic limiting principles of current scientific understanding [1]. Surveys consistently indicate paranormal beliefs are prevalent within the general population. For example, a representative survey of British adults conducted by the market-research company BMG Research [2] found that a third of their sample believed in paranormal phenomena, and a further 21% were ‘unsure’. Of those who either believed in the paranormal or were unsure, 40% indicated they had seen or felt the presence of a supernatural entity. Similarly, Pechey and Halligan [3] found 30% of participants held at least one strong paranormal belief, and 79% held at least one paranormal belief at any strength (weak, moderate, or strong belief). Comparable levels of belief have been documented across various cultures over recent decades [4–7].
The most frequently used scales to measure paranormal beliefs include Tobacyk’s Paranormal Belief Scale in both original (PBS) [8] and revised form (RPBS) [9], and the Australian Sheep-Goat Scale (ASGS) [10]. Despite widespread use, some concerns exist about both the content and the factor structures of these measures [11–13]. Nonetheless, both the RPBS and ASGS have demonstrated excellent internal reliability, with Cronbach’s alpha values around .93 for the RPBS [14–16], and around .95 for the ASGS [17, 18].
Scores on paranormal belief measures have been linked to various personal and demographic characteristics. For example, higher belief scores have been noted for individuals high in extraversion and neuroticism [19–21], while lower belief scores have been seen for those with higher levels of education [22–24]. Paranormal belief levels also appear to vary across academic disciplines; with those engaged in hard (or natural) sciences, medicine, and psychology showing significantly lower paranormal belief scores than those in education, theology, or artistic disciplines [25, 26]. Higher levels of paranormal beliefs have been documented in women and younger individuals [27–32], though these sex and age effects are inconsistently reported [33] and have generated substantial debate [34–36].
Paranormal beliefs and cognitive function
The association between cognitive functioning and paranormal beliefs has been researched over several decades. Such functions include memory, attention, language, and executive function (the umbrella term used to describe set-shifting ability, inhibitory control, and working memory updating; for a full description of executive function, see Miyake et al.’s work [37]).
As important for cognitive function is an individual’s belief system. Religious and spiritual beliefs have been associated with slower cognitive decline in older adults [38, 39] but have also been shown to have an inverse relationship with memory performance [40] and intelligence [41, 42]. Similarly, so-called “epistemically unwarranted beliefs” [19], which includes belief in conspiracy theories, has been linked with lower educational attainment and reduced analytical thinking [43, 44]. Conspiracist beliefs are similarly associated with increased illusory pattern perception [45, 46], decreased need for cognition and cognitive reflection [47–49], biases against confirmatory and disconfirmatory evidence [50], and hindsight bias (for discussions on this topic see [51–53]).
The last published review to examine the relationships between paranormal beliefs and various aspects of cognition was conducted by Irwin in 1993 [53]. That non-systematic narrative review of 43 studies is now almost 30 years old and may have introduced bias by “…citing null results only when these form a substantial proportion of the available data on a given relationship” (p.6). At the time of his review, Irwin [53] concluded that, owing to the variable findings, support for the cognitive deficits hypothesis remained uncertain.
Research has grown considerably since Irwin’s [53] review and an updated and systematic review is timely. The current review has two key aims: first, to provide the first assessment of study quality [54] in this area and second, to systematically review and summarise key associations between paranormal beliefs and a range of cognitive functions.
Method
This review was conducted within the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [55] (see S2 Appendix for PRISMA checklist). The systematic review was preregistered at the Open Science Framework (OSF; https://osf.io/uzm5v) as part of a larger study (also assessing the relationships between paranormal beliefs and schizotypal personality traits). Data used for the descriptive and inferential analyses presented in the results section are available at the OSF preregistration. One author (CED) conducted the search strategy, article eligibility assessment, and data extraction.
Search strategy
A systematic literature review was chosen for this area owing to its strength as a method to synthesise relevant evidence from large bodies of research [56, 57]. Our searches included both peer-reviewed articles published in scholarly journals and “grey literature” (concerning unpublished works such as doctoral theses).
We searched the electronic databases Scopus, ScienceDirect, SpringerLink, and OpenGrey from inception to May 2021. Our search terms were: (1) “paranormal belief” AND cogni*, (2) “paranormal belief” AND thinking, and (3) “paranormal belief” AND (memory OR “executive function”). For databases that did not permit wildcard Boolean operators (ScienceDirect), one of the above search terms was amended and entered as: “paranormal belief” AND (cognition OR cognitive), to best replicate the effect of the Boolean operator. Following exclusion of duplicate articles across databases, titles and abstracts were assessed to identify studies relevant to the review. Full-text assessment of eligible studies was performed to determine final inclusion. Full-text copies were unavailable for five studies, which were subsequently sought for retrieval. Finally, we hand-searched reference lists for each included article to identify any additional relevant articles. The PRISMA flow diagram presented in Fig 1 illustrates the full screening and selection process. The PRISMA checklist for abstracts is presented in S1 Appendix, and the full PRISMA checklist is presented in S2 Appendix.
Inclusion/Exclusion criteria
Studies were eligible for inclusion if they were: published in the English language, conducted with a healthy adult sample (age 18 or over) and presented original data involving both a measure of paranormal belief and a measure of cognitive function. As cognitive functions have been shown to peak at different ages (for a detailed discussion on this topic, see [58]), we excluded samples that included children and adolescents under the age of 18 as some cognitive functions are still developing in these younger individuals.
Data extraction
We used a detailed data extraction form to collate the following information from included studies: sample sizes and demographic details (including sex, age and education), the measures of self-rated paranormal belief, the aspect of cognition assessed, the tests of cognitive functions used, and findings relating to the relationship between paranormal beliefs and cognitive function. We categorised eligible outcome measures broadly to include both global cognitive function and domain-specific cognitive functions. Any measure of cognitive function was eligible for inclusion (e.g., neuropsychological tests, self-report measures). Results for both paranormal beliefs and cognitive functioning could be reported as an overall test score that provides a composite measure, subscale scores that provide domain-specific measures, or a combination of the two. When multiple cognitive outcomes were investigated, we included all measures. To assess the strength of the relationships between paranormal beliefs and various cognitive functions, we calculated the number of positive, negative, or null findings reported by each study included in the review. Measures of paranormal belief were examined to determine the extent to which established questionnaires have been used.
In line with our preregistered protocol, we synthesised evidence narratively. Meta-analyses could not be undertaken because of the heterogeneity of study designs and outcome measures. We did, however, develop summary tables that include information relating to: sample size, gender composition, mean sample age, cognitive domain, outcome measure, and key findings. Given the range of outcome measures, we attempted to categorise the included studies by common cognitive domains. As the review took an explorative approach, and did not specify domains of interest, categorisation took place after full-text evaluation of included studies.
Results
Electronic and hand searches identified 902 papers, of which 475 were unique. Most articles (k = 391) were excluded from the review following title and abstract screening, leaving 84 eligible for full-text evaluation. We removed 13 studies that included participants under the age of 18 (see S1 Table for details of these studies). Seventy-one papers met our inclusion criteria (see Fig 1), which included 70 published between 1980 and 2020 and one unpublished doctoral thesis [59].
Assessment of study quality and risk of bias
The preregistration for this review specified using a bespoke series of questions to assess study quality, but we subsequently decided to use a more well-established and validated measure of study quality in the Appraisal tool for Cross-Sectional Studies (AXIS) tool [60]. Of the 20 AXIS items, seven assess reporting quality (items: 1, 4, 10, 11, 12, 16 and 18), seven relate to study design (items: 2, 3, 5, 8, 17, 19 and 20), and six to possible biases (items: 6, 7, 9, 13, 14 and 15). Two authors (DG and CED) independently rated each study, and these two sets of ratings had almost-perfect agreement (93%) with Kappa = .84.
Following previous research [61], we classified AXIS quality scores according to the number of “Yes” responses for the 20 items for each study—poor quality for scores <50%, fair quality for scores between 50 to 69%, good quality for scores of 70% to 79%, strong quality for scores of 80% and higher. Three in four studies were rated as either ‘strong’ (26/71: 37%) or ‘good’ (27/71: 39%). By contrast, 17/71 (24%) were rated as ‘fair’ and only 1/71 (1%) was rated as ‘poor’. The mean quality rating score across all 71 studies was in the ‘good’ range; however individual AXIS items are not weighted and so this total score provides a general, but limited, classification that should be interpreted with some caution. The number of papers meeting each AXIS criterion (‘Yes’) is presented in Table 1. The number of50%,a>