<?xml version = "1.0" encoding = "UTF-8" ?><revista><revista> Revista Española de Investigaciones Sociológicas</revista><abreviado>REIS. Rev. Esp. Investig. Sociol</abreviado>undefined<doi>https://doi.org/10.5477/cis/reis</doi><anio>2026</anio><issn>0210-5233</issn><eissn>1988-5903</eissn><organismo>Centro de Investigaciones Sociológicas</organismo><pais>España</pais><http>https://reis.cis.es</http><titulo>Influence of (Pre-interview) Notificationon Response Rates in Telephone Surveys</titulo><title>Influencia de las notificaciones (previas a la entrevista) en la tasa de respuesta en encuestas telefónicas</title><autor>Vidal Díaz de Rada and Ana Díaz de Rada</autor><texto> </texto><table><tbody><tr><td><p>Key wordsTelephone SurveyMeta-analysisPre-notificationCooperation RateResponse Rate</p></td><td><p>AbstractOne of the great challenges faced in a context of declining survey response rates is to increase the cooperation of the people selected to be surveyed. This research note focuses on the effectiveness of a pre-interview contact as a strategy to increase telephone survey cooperation rates. To this end, an exhaustive analysis was conducted of the research published in five databases that collect sociological works, the findings of which were examined using the meta-analysis technique. The results revealed that the use of notifications increases cooperation rates in telephone surveys with an effect size of 1.24, which increases in surveys carried out on mobile phones.</p></td></tr><tr><td><p>Palabras claveEncuesta telefónicaMetaanálisisNotificación previaTasa de cooperaciónTasa de respuesta</p></td><td><p>ResumenEn un contexto de descenso de las tasas de respuesta de las encuestas, aumentar la colaboración de las personas seleccionadas para ser encuestadas es uno de los grandes desafíos. Esta nota de investigación se centra en la eficacia del contacto previo a la entrevista como estrategia para aumentar la colaboración en encuestas telefónicas. Para ello, lleva a cabo un análisis exhaustivo de las investigaciones publicadas ﻿en cinco bases de datos que recogen trabajos sociológicos, cuyos hallazgos son analizados con la técnica del metaanálisis. Los resultados desvelan que la utilización de notificaciones consigue un aumento de la tasa de cooperación en las encuestas telefónicas con un tamaño de efecto de 1,24, que se incrementa en las encuestas realizadas a teléfonos móviles.</p></td></tr></tbody></table><texto>Citation</texto><texto>Díaz de Rada, Vidal; Díaz de Rada, Ana (2026).  ﻿Influence of (Pre-interview) Notification on Response Rates in Telephone Surveys . Revista Española de Investigaciones Sociológicas, undefined:153-164.(doi:10.5477/cis/reis.153-164)</texto><texto>﻿﻿Vidal Díaz de Rada: Universidad Pública de Navarra | vidal@unavarra.es</texto><texto>Ana Díaz de Rada: Universidad Pública de Navarra | anamaria.diazderada@unavarra.es</texto><texto>doi:10.5477/cis/reis.195. - </texto><texto> </texto><texto>Several factors can explain this situation: the difficulty in distinguishing between residential and business numbers; calls that are never answered; the widespread use of answering machines; and the high volume of telephone contacts for commercial purposes (among others, Dillman, 2017; Couper, 2017). Using a notification and conducting a detailed examination of the responses makes it possible to differentiate between residential telephones—the research object—and other types of telephones (businesses, non-existent telephones, etc.).</texto><texto>Parallel to these factors, it is worth noting the expansion of mobile telephones, which have absorbed landlines (Lavrakas et al., 2017), with many people now using only mobile phones. In fact, 46 % of dwellings in Spain were accessible only by mobile phone in 2024, double those in 2019 (Instituto Nacional de Estadística-INE, 2024). The problem with this situation is that it does not affect all social sectors equally and that people with only mobile phones are different from those with landline telephones (Lavrakas et al., 2017).</texto><texto>To remedy this situation, a number of strategies have been developed that help both to locate the unit of analysis and to reduce the number of rejections. Some of these have been ineffective, and therefore telephone response rates continue to decline, leading to a loss of representativeness (e.g. Luiten, Hox and Leeuw, 2020). One of the most commonly used strategies is to send a letter by ordinary post as a notification of an upcoming telephone call to conduct a survey. The letter provides information about the public body that is conducting the survey and its topic, as well as the next contact to be made by an interviewer. It is signed by the survey manager (or relevant person).</texto><texto>Having this information makes it easier to contact the selected person, as it is a more professional way of asking for their participation. It also helps to remove any initial reticence they may have about cooperating, because the importance of both the survey and their participation is communicated more effectively. Pre-notification is a more suitable mechanism for legitimising the demand on respondents  time that cooperation entails, while also reducing the  surprise  factor associated with an unexpected visit or phone call, and potentially decreasing  impromptu refusals  (impulsive refusals).</texto><texto>Introduction</texto><texto>Telephone surveys began to be widely used in the United States in the 1930s (Massey, 1988). Although some organisations had used the telephone for electoral polling, and this data collection method was extensively employed in health research during the 1950s and 1960s (Nathan, 2001), telephone surveys were mainly used as a supplementary method during this period.</texto><texto>In the 1960s, the population with a telephone in the United States grew to reach 90 % of households (Nathan, 2001), which was the decisive factor behind the large expansion of the telephone survey. This factor was compounded by the implementation of computer-assisted telephone interviewing (CATI) in 1971 and samples with random number systems (Couper, 2017; Dillman, 2017). This marked the end of the  dominance  of mail and face-to-face surveys, which had been the most commonly used modes of survey questionnaire administration until then (Lyberg and Kasprzyk, 1991). The telephone survey has been predominant in North America, Australia and most European countries since the mid-1980s (Leeuw and Hox, 2015).</texto><texto>This has taken place in parallel with a major phenomenon in the survey field, namely the progressive decline in response rates, a situation that jeopardises the future viability of the survey (among others, Massey and Tourangeau, 2013). This reduced level of cooperation has been more pronounced in telephone surveys. Thus, for example, the response rate of the barometers (periodic surveys) conducted by the Pew Research Center (a US think tank) decreased from 9 % in the period 2013-2016 to 6 % in 2018 (Kennedy and Hartig, 2019).</texto><texto>Several factors can explain this situation: the difficulty in distinguishing between residential and business numbers; calls that are never answered; the widespread use of answering machines; and the high volume of telephone contacts for commercial purposes (among others, Dillman, 2017; Couper, 2017). Using a notification and conducting a detailed examination of the responses makes it possible to differentiate between residential telephones—the research object—and other types of telephones (businesses, non-existent telephones, etc.).</texto><texto>Similar research frequently yields different—at times, even contradictory—findings. Meta-analysis is a method for synthesising the evidence accumulated about a specific research question (Botella and Zamora, 2017). It is the most appropriate means of avoiding findings being classified as inconclusive, a label typically applied when studies on a given topic reach divergent conclusions. Some publications have questioned the effectiveness of (pre-interview) notifications as a tool to increase response rates (e.g. Capistrano and Creighton, 2022), despite the fact that they are frequently used in large surveys. In fact, the much cited meta-analysis by De Leeuw et al. (2007) found an increase in the telephone survey cooperation rate of more than ten percentage points. However, this effect, found in research published before 2007, may have disappeared or declined in recent years. The aim of this paper is to test the extent to which pre-interview notifications influence the cooperation of the selected respondents, focusing on the most recently published research, namely the period between 2010 and 2024.</texto><texto>Sources of information</texto><texto>Five databases were used to locate research on the subject published in the last fifteen years. The Web of Science was initially used, followed by the Social Sciences Citation Index-SSCI and Scopus, Sociological Abstracts and, finally, the Applied Social Sciences Index and Abstracts-ASSIA.</texto><texto>Web of Science (WOS) is a bibliographic platform that enables users to access and simultaneously search across its Core Collection, CAB Abstracts, Food Science and Technology Abstracts, MEDLINE and other databases. It contains approximately 133 million records.</texto><texto>The Social Sciences Citation Index is specific to the social sciences and covers 3400 scientific journals, with approximately nine million records.</texto><texto>Scopus collects journal articles, conference papers and book chapters. It indexes more than 16 000 scientific journals in the social sciences and humanities. It contained 51 million records after 1995 and more than 100 million in 2024.</texto><texto>Sociological Abstracts includes information from more than two thousand international scientific journals in the field of sociology, as well as books, book chapters, theses and conference proceedings.</texto><texto>ASSIA has collected publications in the applied social sciences from 1987 until the present day. It contains records from approximately five hundred scientific journals, yielding a total of approximately 470 000 records.</texto><texto>It is our understanding that these five databases provide sufficient information on the importance of pre-interview notification to increase response rates in telephone surveys.</texto><texto>Having this information makes it easier to contact the selected person, as it is a more professional way of asking for their participation. It also helps to remove any initial reticence they may have about cooperating, because the importance of both the survey and their participation is communicated more effectively. Pre-notification is a more suitable mechanism for legitimising the demand on respondents  time that cooperation entails, while also reducing the  surprise  factor associated with an unexpected visit or phone call, and potentially decreasing  impromptu refusals  (impulsive refusals).</texto><texto>The aim of this paper is to analyse the extent to which a pre-notification of telephone contact leads to an increase in the response rates of telephone surveys. Research published between 2010 and 2024 is analysed in order to fulfil that aim.</texto><texto>Methodology</texto><texto>Similar research frequently yields different—at times, even contradictory—findings. Meta-analysis is a method for synthesising the evidence accumulated about a specific research question (Botella and Zamora, 2017). It is the most appropriate means of avoiding findings being classified as inconclusive, a label typically applied when studies on a given topic reach divergent conclusions. Some publications have questioned the effectiveness of (pre-interview) notifications as a tool to increase response rates (e.g. Capistrano and Creighton, 2022), despite the fact that they are frequently used in large surveys. In fact, the much cited meta-analysis by De Leeuw et al. (2007) found an increase in the telephone survey cooperation rate of more than ten percentage points. However, this effect, found in research published before 2007, may have disappeared or declined in recent years. The aim of this paper is to test the extent to which pre-interview notifications influence the cooperation of the selected respondents, focusing on the most recently published research, namely the period between 2010 and 2024.</texto><texto>Chart 1. Example of a search strategy</texto><texto> </texto><table><tbody><tr><td><p>Advance* letter*+ Telephon* survey+ Cooperat*+ Respons*+ Response rate+ contact</p></td></tr></tbody></table><texto>Source: Prepared by the authors.</texto><texto>Pre-contact notifications are also subject to terminological variability:  advance letter  (Beullens et al., 2018),  advance postcards  (Brenner and Buskirk, 2022), “lead letter” (Badoe and Biney, 2017), “notification” (Lynn and Taylor, 1998) and “prenotification” (Conrad et al., 2013).</texto><texto>Search strategy</texto><texto>Given that these terms do not always appear in the publication titles, the abstract of each contribution was searched. This approach increased the comprehensiveness of the data collection. </texto><texto>Once the publication period had been defined as being from January 1, 2010 to December 31, 2024, the search terms were combined systematically. Each search began with the term used to refer to the notification ( advance letter ), followed by the mode of interview ( phone  or “telephone”), and ended with the terms used to refer to response rates (“cooperation rate”, “response rate”, “response”, and “contact”). In order to maximise the number of results, successive searches were then performed by replacing the notification term “advance letter” with “advance postcard”, “lead letter”, “notification” and “prenotification”.</texto><texto>Chart 1 shows the first search strategy, the one related to  advance* letter . Three additional searches were conducted using this term and changing the mode of data collection: replacing  telephon* survey  with “phone survey”; “telephone interview”; and “phone interview”, respectively. These four combinations were repeated using all the terms relating to prior notification: “advance postcard”, “lead letter”, “notification” and “prenotification”. The four words referred to response remained unchanged.</texto><texto>It is our understanding that these five databases provide sufficient information on the importance of pre-interview notification to increase response rates in telephone surveys.</texto><texto>Eligibility and inclusion criteria for studies</texto><texto>Three terms, or keywords, were considered for the selection of publications: 1) using the  telephone survey  as the collection technique under study; 2) having  pre-interview notification  as an intervening factor; and 3) having “cooperation rate” as the outcome, considering to what extent the so-called intervening factor (notification) affects cooperation. Let us look in detail at how each of these terms is defined.</texto><texto>The literature review (among others, Frey, 1983; Lepkowski et al., 2008) yielded four terms referring to the telephone survey:  telephone survey ,  phone survey , “telephone interview” and “phone interview”. In order to take into account the plural forms of these, the singular form of the term was searched for by adding an asterisk at the end of that term.</texto><texto>The texts on survey non-response (among others, Dillman et al., 2002; Stoop et al., 2010) used various terms to refer to people s willingness to cooperate, whether considering response rate, cooperation or contact. This is why the terms  response rate ,  response , “cooperation rate” and “contact” were used.</texto><texto>﻿FIGURE 1. Flow diagram of the screening of primary documents</texto><texto>￼</texto><texto>Source: Prepared by the authors based on PRISMA, 2019.</texto><texto>The four search strategies, which combined the types of notification, the four terms used to define the telephone survey and the four terms relating to response, generated sixty-four search strings. These searches yielded 1325 primary documents when applied to the databases referred to above, as shown in Chart 1.</texto><texto>Extraction of data from selected studies</texto><texto>The 1325 documents referred to above were reduced to 1110 after repetitions had been removed.</texto><texto>Chart 1 shows the first search strategy, the one related to  advance* letter . Three additional searches were conducted using this term and changing the mode of data collection: replacing  telephon* survey  with “phone survey”; “telephone interview”; and “phone interview”, respectively. These four combinations were repeated using all the terms relating to prior notification: “advance postcard”, “lead letter”, “notification” and “prenotification”. The four words referred to response remained unchanged.</texto><texto>The four search strategies, which combined the types of notification, the four terms used to define the telephone survey and the four terms relating to response, generated sixty-four search strings. These searches yielded 1325 primary documents when applied to the databases referred to above, as shown in Chart 1.</texto><texto>A meta-analysis of publications requires an analysis of the extent to which published research is similar to unpublished research, known as publication bias.</texto><texto>To conduct this type of assessment, graphical tests are typically used, particularly the funnel plot. However, it has low reliability when the number of studies is small (Sterne, Gavaghan and Egger, 2000), as in the present case. In these situations, statistical tests should be used, namely Kendall s rank correlation coefficient and Egger’s test.</texto><texto>As a reminder, the variable under study is cooperation rate, and the hypothesis to be tested is that the use of pre-response notifications in a questionnaire leads to an increase in cooperation. Given the type of data available (cooperation rates), a meta-analysis based on the ratio of proportions was used to estimate the effect, following the recommendations made by Botella Ausina and Sánchez Meca (2015).</texto><texto>Results: measuring the effect</texto><texto>Table 1 presents the studies analysed, detailing the country where the fieldwork was conducted, type of telephone, sample sizes and cooperation rates of the experimental group (with pre-notification)  and control group (no pre-notification). The two right-hand columns show the effect size together with its sample variance. The effect size of 1.24 in the first study shown in Table 1 is the ratio of the cooperation rate in the experimental group to that of the control group (0.532/0.430). It should be noted that all effect sizes but one have values greater than 1, which means that the use of pre-interview notifications was successful in increasing the cooperation rate. This increase reached 1.79 in the 2015 Australian study (Dal Grande et al., 2016) and a slightly lower value in the most recent study, the one performed by Kocar (2022).</texto><texto>Following this initial selection, documents were screened by reading the abstracts. This process was carried out individually by three reviewers, who then worked together on the discrepancies until a consensus was reached. This stage began by excluding those studies that were not aimed at investigating telephone surveys, but used this tool solely as a mode of data collection (763 documents). The present paper focuses on response rates rather than  on other aspects of telephone survey research; accordingly, 295 papers were excluded on the grounds that they fell outside the scope of the subject under consideration. When addressing the remaining studies, attention was paid to whether two random groups had been used, one that received an advance letter and one that did not; and to whether research had been conducted using telephone surveys or a different mode of data collection. Finally, a total of eleven papers were selected. They had been published between 2010 and 2024 and presented twelve experimental situations. The articles that met these conditions were selected as primary papers for meta-analysis.</texto><texto>The following information was extracted from the twelve documents: year of fieldwork; country of collection; type of telephone used; total sample size; cooperation rate of both the experimental group and control sample (see Table 1). In line with the latest edition of AAPOR (2023), cooperation rate was defined as the proportion of all cases interviewed of all eligible units ever contacted, a measure used on many occasions as a response rate (among others, in the European Social Survey).</texto><texto>Publication bias</texto><texto>A meta-analysis of publications requires an analysis of the extent to which published research is similar to unpublished research, known as publication bias.</texto><texto>Studies in Europe, specifically in Germany, Sweden and England, showed an effect size slightly above 1.2, with the exception of England, where it was 0.05 lower. This is a larger effect size than those found in other countries such as Canada and the US Midwest. Mention should also be made of an effect size slightly below 1 (Carey et al., 2013). Nevertheless, this should be considered with extreme caution, as it was based on a very small sample, with only 139 interviews in the experimental sample and 140 in the control sample.</texto><texto>Another aspect worth mentioning is the weak relationship between pre-notification and response rates over time, i.e. the fact that its influence neither increased nor decreased over the years. Rather, there were highs and lows, with no clear influence of time. Thus, both the studies by Dal Grande et al. (2016) and by Skalland, Zhao and Jeyarajah (2015), which were based on mobile phone surveys and fieldwork conducted in 2013 and 2015, reported the largest effect sizes, with results exceeding those of the earlier studies.</texto><texto>It should also be noted that, when calculating the pooled effect, the studies considered were not replicas of other studies, but had important differences. It was therefore not advisable to use a fixed effects model, and a random effects model was chosen instead (Botella and Sánchez, 2015). In this case, the pooled effect size was 1.24, with a standard error of 0.0615, which yielded a Z-value of 20.2 and a p &lt; 0.0001 (Table 2). This information indicates that the use of pre-response notifications can be guaranteed to increase the response rate.</texto><texto>TABLE 1. Cooperation rates, effect size and variance (by date of collection)</texto><texto> </texto><table><tbody><tr><td><p>Cooperation rates</p></td></tr><tr><td><p>Author</p></td><td><p>Year of data collection</p></td><td><p>Experiment location</p></td><td><p>Type of phone</p></td><td><p>Sample size</p></td><td><p>Experimental group</p></td><td><p>Control group</p></td><td><p>Design effect</p></td><td><p>Variance</p></td></tr><tr><td><p>Vogl, 2018</p></td><td><p>2007</p></td><td><p>Germany</p></td><td><p>Landline</p></td><td><p>936</p></td><td><p>0.532</p></td><td><p>0.430</p></td><td><p>1.24</p></td><td><p>0.005</p></td></tr><tr><td><p>Von der Lippe, 2011</p></td><td><p>2009</p></td><td><p>Germany</p></td><td><p>Landline</p></td><td><p>4,751</p></td><td><p>0.406</p></td><td><p>0.335</p></td><td><p>1.21</p></td><td><p>0.001</p></td></tr><tr><td><p>Carey et al., 2013</p></td><td><p>2011</p></td><td><p>Australia</p></td><td><p>Landline</p></td><td><p>244</p></td><td><p>0.784</p></td><td><p>0.797</p></td><td><p>0.98</p></td><td><p>0.004</p></td></tr><tr><td><p>Koitsalu et al., 2018</p></td><td><p>2012</p></td><td><p>Sweden</p></td><td><p>Landline</p></td><td><p>20,958</p></td><td><p>0.355</p></td><td><p>0.290</p></td><td><p>1.22</p></td><td><p>0.000</p></td></tr><tr><td><p>McLean et al., 2014</p></td><td><p>2013</p></td><td><p>Australia</p></td><td><p>Landline</p></td><td><p>1,512</p></td><td><p>0.249</p></td><td><p>0.200</p></td><td><p>1.25</p></td><td><p>0.009</p></td></tr><tr><td><p>Skalland, 2015</p></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td><p>Landline</p></td><td><p>2013</p></td><td><p>Columbia</p></td><td><p>Landline</p></td><td><p>20,403</p></td><td><p>0.921</p></td><td><p>0.905</p></td><td><p>1.02</p></td><td><p>0.004</p></td></tr><tr><td><p>Mobile</p></td><td><p>2013</p></td><td><p>Columbia</p></td><td><p>Mobile</p></td><td><p>21,941</p></td><td><p>0.781</p></td><td><p>0.478</p></td><td><p>1.63</p></td><td><p>0.011</p></td></tr><tr><td><p>Dal Grande et al., 2016</p></td><td><p>2015</p></td><td><p>Australia</p></td><td><p>Mobile</p></td><td><p>520</p></td><td><p>0.286</p></td><td><p>0.478</p></td><td><p>1.79</p></td><td><p>0.034</p></td></tr><tr><td><p>Aizpurua et al., 2018</p></td><td><p>2017</p></td><td><p>Midwest (USA)</p></td><td><p>Mobile</p></td><td><p>1,200</p></td><td><p>0.877</p></td><td><p>0.775</p></td><td><p>1.13</p></td><td><p>0.001</p></td></tr><tr><td><p>Schell et al., 2018</p></td><td><p>2017</p></td><td><p>Canada</p></td><td><p>Landline</p></td><td><p>279</p></td><td><p>0.593</p></td><td><p>0.500</p></td><td><p>1.19</p></td><td><p>0.012</p></td></tr><tr><td><p>Harrison et al., 2019</p></td><td><p>2017</p></td><td><p>England</p></td><td><p>Landline</p></td><td><p>3,000</p></td><td><p>0.331</p></td><td><p>0.287</p></td><td><p>1.15</p></td><td><p>0.003</p></td></tr><tr><td><p>Kocar, 2022</p></td><td><p>2020</p></td><td><p>Australia</p></td><td><p>Mobile</p></td><td><p>7,675</p></td><td><p>0.025</p></td><td><p>0.018</p></td><td><p>1.37</p></td><td><p>0.025</p></td></tr></tbody></table><texto>Source: Prepared by the authors.</texto><texto>The highest design effect was found in three of the four studies that conducted data collection using mobile phones. It could therefore be argued that notification increased the response rates in mobile phone surveys to a larger extent, although the low effect reported in the study by Aizpurua et al. (2018) makes it difficult to generalise these findings. However, it should be noted that the control group of the latter had a high cooperation rate (77.5 %).</texto><texto>Studies in Europe, specifically in Germany, Sweden and England, showed an effect size slightly above 1.2, with the exception of England, where it was 0.05 lower. This is a larger effect size than those found in other countries such as Canada and the US Midwest. Mention should also be made of an effect size slightly below 1 (Carey et al., 2013). Nevertheless, this should be considered with extreme caution, as it was based on a very small sample, with only 139 interviews in the experimental sample and 140 in the control sample.</texto><texto>FIGURE 1. Forest plot</texto><texto>￼</texto><texto>Source: Prepared by the authors.</texto><texto>TABLe 2. Effect size (random models)</texto><texto> </texto><table><tbody><tr><td><p>Random-effects model (K = 12)</p></td></tr><tr><td></td><td><p>Estimate</p></td><td><p>Standard Error</p></td><td><p>Z</p></td><td><p>P</p></td><td><p>Confidence intervals</p></td></tr><tr><td><p>Lower</p></td><td><p>Upper</p></td></tr><tr><td><p>Intercept</p></td><td><p>1,24</p></td><td><p>0,0615</p></td><td><p>20,2</p></td><td><p>&lt;0,01</p></td><td><p>1,424</p></td><td><p>1,365</p></td></tr></tbody></table><texto>Source: Prepared by the authors using Jamovi.</texto><texto>After selecting the model, heterogeneity was assessed, as it also indicates whether a fixed- or a random-effects model is appropriate. I2 was used for this purpose. This measure compares variability due to real differences between estimates with random variability and is characterised by being independent of the number of studies as well as being insensitive to effect size. According to the criteria proposed by Higgins et al. (2003), who classified heterogeneity into four groups, the value obtained (98.8 %) fell within the  high  range, as it clearly exceeded the 75 % threshold. As argued by Huedo-Medina et al. (2006: 203), obtaining high heterogeneity among effect sizes indicates that the assumed model is appropriate. Having an I2 value of 99.8 % thus justified the use of the random effects model. </texto><texto>As can be seen in Table 1, variances were low, no doubt due to the large sample sizes. The studies by Dal Grande et al. (2016) and Kocar (2022) had the highest variances. However, the 95% confidence intervals (see Figure 1) show that the vast majority of the 12 studies considered had significant effect sizes. The exceptions were the studies by Carey et al. (2013), Skalland, Zhao and Jeyarajah (2015), conducted with mobile phones, and Schell et al. (2018). The minimum confidence interval values were 0.97, 0.83 and 0.85 respectively, all three lower than 1.</texto><texto>It should also be noted that, when calculating the pooled effect, the studies considered were not replicas of other studies, but had important differences. It was therefore not advisable to use a fixed effects model, and a random effects model was chosen instead (Botella and Sánchez, 2015). In this case, the pooled effect size was 1.24, with a standard error of 0.0615, which yielded a Z-value of 20.2 and a p &lt; 0.0001 (Table 2). This information indicates that the use of pre-response notifications can be guaranteed to increase the response rate.</texto><texto>After selecting the model, heterogeneity was assessed, as it also indicates whether a fixed- or a random-effects model is appropriate. I2 was used for this purpose. This measure compares variability due to real differences between estimates with random variability and is characterised by being independent of the number of studies as well as being insensitive to effect size. According to the criteria proposed by Higgins et al. (2003), who classified heterogeneity into four groups, the value obtained (98.8 %) fell within the  high  range, as it clearly exceeded the 75 % threshold. As argued by Huedo-Medina et al. (2006: 203), obtaining high heterogeneity among effect sizes indicates that the assumed model is appropriate. Having an I2 value of 99.8 % thus justified the use of the random effects model. </texto><texto>Effect sizes were higher in studies conducted in European countries than in those carried out in North America (Canada and the United States). This finding should be interpreted with caution, as the comparison was based on five European studies and four from North America. Given the limitation of working with only twelve studies, another finding of this research has been that the effectiveness of pre-notification does not increase over time.</texto><texto>The pooled effect size was 1.24, with a standard error of 0.0615 giving a confidence interval between the values of 1.124 and 1.365. The fact that the confidence interval does not contain 1 indicates that the use of advance notifications increases the response rate. The studies used were highly heterogeneous (Higgins et al., 2003) and lacked selection bias. The reasons for this heterogeneity are varied and, in fact, constitute the main limitations of our research. Twelve studies with fieldwork conducted between 2007 and 2020 are insufficient to determine whether the effect of pre-notification is stronger in more recent or in earlier research, although no other publications exist for the period considered (Woolf and Edwards, 2021). No less important is the location, from Central European countries to Australia and the United States, the latter having one of the most  over-surveyed  societies (Presser and McCulloch, 2011). The findings reported here need to be corroborated in future studies.</texto><texto>An important aspect is the impact of the type of phone used, at a time when mobiles are replacing landline telephones. Three of the four studies had a higher pre-notification effect in mobile phone surveys, although the small number of experiments prevents generalising the finding that pre-notifications are more effective in this type of survey. This is an area that requires further research, given that landline-only surveys present significant biases.</texto><texto>As can be seen in Table 1, variances were low, no doubt due to the large sample sizes. The studies by Dal Grande et al. (2016) and Kocar (2022) had the highest variances. However, the 95% confidence intervals (see Figure 1) show that the vast majority of the 12 studies considered had significant effect sizes. The exceptions were the studies by Carey et al. (2013), Skalland, Zhao and Jeyarajah (2015), conducted with mobile phones, and Schell et al. (2018). The minimum confidence interval values were 0.97, 0.83 and 0.85 respectively, all three lower than 1.</texto><texto>Finally, selection bias can be accounted for by using Kendall s and Egger’s tests, which are less sensitive when there are few studies being considered. In the former, high (statistically significant) values indicate differences between published and unpublished studies, whereas low values indicate the opposite. This is the case here, since the value obtained, -0.030 (p = 0.947), indicates the absence of this kind of bias. Given its sensitivity when there are few studies being analysed, Egger’s test was also applied (1.219, p = 0.223), again indicating the absence of publication bias.</texto><texto>These findings are in line with a similar study by Woolf and Edwards (2021), which analysed any type of pre-notification in all types of surveys (face-to-face, telephone, self-administered by mail, online, etc.). Looking at a similar time period, and using references from nine databases, Woolf and Edwards (2021) found one hundred and seven studies that tackled pre-notification. A thorough analysis of the telephone surveys selected by these authors revealed that there were no studies other than those included in this paper.</texto><texto>DISCUSSION</texto><texto>The study has shown that the use of pre-contact notifications increases cooperation rates in telephone surveys. The effects, calculated using the ratio of proportions, ranged from 1.02 to 1.79, although half of the studies conducted had effects around 1.2.</texto><texto>Effect sizes were higher in studies conducted in European countries than in those carried out in North America (Canada and the United States). This finding should be interpreted with caution, as the comparison was based on five European studies and four from North America. Given the limitation of working with only twelve studies, another finding of this research has been that the effectiveness of pre-notification does not increase over time.</texto><texto>Bibliography</texto><texto>American Association for Public Opinion Research (AAPOR) (2023). Standard Definitions. Final Dispositions of Case Codes and Outcome Rates for Surveys. Available at: https://aapor.org/wp-content/uploads/2023/05/Standards-Definitions-10th-edition.pdf, access April 8, 2025.</texto><texto>Aizpurua, Eva; Park, Ki H.; Avery, Mitchell; Wittrock, Jill; Muilenburg, Rodney and Losch, Mary E. (2018).  The Impact of Advance Letters on Cellphone Response in a Statewide Dual-Frame Survey . Survey Practice, 11(2). doi: 10.29115/SP-2018-0011</texto><texto>Badoe, Daniel A. and Biney, Angela (2017).  Receipt of Travel Survey Advance Letter and Its Impact on Reported Trips and Number of Phone Calls for Survey Completion in Telephone Surveys . Journal of Urban Planning and Development, 143(2). doi: 10.1061/(ASCE)UP.1943-5444.0000370</texto><texto>Beullens, Koen; Loosveldt, Geert; Vandenplas, Caroline and Stoop, Ineke (2018).  Response Rates in the European Social Survey: Increasing, Decreasing, or a Matter of Fieldwork Efforts? . Survey Methods: Insights from the Field: 1-12. doi: 10.13094/SMIF-2018-00003 </texto><texto>Botella Ausina, Juan and Sánchez Meca, Julio (2015). Meta-analysis en ciencias sociales y de la salud. Madrid: Síntesis.</texto><texto>Botella Ausina, Juan and Zamora, Ángela (2017).  El meta-análisis: una metodología para la investigación en educación . Educación XX1, 20(2): 17-38. doi: 10.5944/educxx1.19030  </texto><texto>Brenner, Phillip S. and Buskirk, Trent D. (2022).  Scratch the Scratch-off: Testing Prepaid and Conditional Incentives with Postcard and Letter Invitations . Field Methods, 34(1): 20-35. doi: 10.1177/1525822X211069640</texto><texto>Capistrano, Daniel and Creighton, Mathew (2022).  The Effect of Advance Letters on Survey Participation . Survey Methods: Insights from the Field. doi: 10.13094/SMIF-2022-00002</texto><texto>Carey, Renee N.; Reid, Allison; Driscoll, Timothy R.; Glass, Deborah C.; Benke, Geza and Fritschi, Lin (2013).  An Advance Letter did not Increase the Response Rates in a Telephone Survey . Journal Of Clinical Epidemiology, 66(12): 1417-1421.</texto><texto>Conrad, Frederic; Broome, Jessica S.; Benkí José R.; Kreuter, Frauke; Groves, Robert M.; Vannette, David and McClain, Colleen (2013).  Interviewer Speech and the Success of Survey Invitations . Journal of the Royal Statistical Society, 176: 191-210. doi: 10.2307/23355183</texto><texto>These limitations are compounded by the different types of notification, as almost all surveys used conventional letters (paper) and only two studies employed text messages (Dal Grande et al., 2016; Kocar, 2022). Greater use of the latter would be necessary to understand what their real effectiveness is.</texto><texto>Research on the content of pre-notification messages would also be valuable, considering not only word count but also the type of language used (whether common or specialised) and the motivational content addressed to selected respondents, factors that have been shown to influence outcomes in other contexts (Greenberg and Dillman, 2021).</texto><texto>While the low number of studies could be interpreted as an indicator of the discipline s lack of interest in the subject, it can be explained by the decline in the use of the telephone survey (Olson et al., 2021). This situation was shown in a study of the top seventy-eight survey research companies in North America conducted by Kennedy, Popky and Keeter (2023). This team found that 61 % of the companies used different modes of survey in 2022 than in 2016, and only 10 % used the telephone as the only mode.</texto><texto>In light of these considerations, and considering the specific advantages of mobile telephones, it is important to reflect on what it means to increase the response rate of telephone surveys by 24 %, especially considering that this is the mode of data collection most affected by the decrease in the cooperation rate. Achieving an increase of this magnitude through a resource that does not require substantial financial investment represents a significant improvement in representativeness, while also making it possible to select individuals who rarely cooperate with this type of survey, thereby reducing a major source of bias in the results.</texto><texto>Kennedy, Courtney; Popky, Dana and Keeter, Scott (2023). How public polling has changed in the 21st century. Pew Research Center. Available at: www.pewresearch.org/methods/2023/04/19/how-public-polling-has-changed-in-the-21st-century/, access January 23, 2026.</texto><texto>Kocar, Sebastian (2022).  Survey Response in RDD-Sampling SMS-Invitation Web-Push Study . Survey Research Methods, 16(3): 283-299. doi: 10.18148/srm/2022.v16i3.7846</texto><texto>Lavrakas, Paul; Benson, Grant; Blumberg, Stephen; Buskirk, Trent; Flores Cervantes, Ismael; Christian, Leah; Dutwin, David; Fahimi, Mansour; Fienberg, Howard; Guterbock, Tom; Keeter, Scott; Kelly, Jenny; Kennedy, Courtney; Peytchev, Andy; Piekarski, Linda and Shuttles, Chuck (2017).  The future of U.S. general population telephone survey research . AAPOR Task Force. Available at: https://aapor.org/wp-content/uploads/2022/11/Future-of-Telephone-Survey-Research-Report.pdf, access January 23, 2026.</texto><texto>Leeuw, Edith de; Callegaro, Mario; Hox, Joop and Korendijk, Elly (2007).  The Influence of Advanced Letters on Response in Telephone Surveys: A Meta-analysis . Public Opinion Quarterly, 71: 413-443. doi: 10.1093/poq/nfm014</texto><texto>Leeuw, Edith de and Hox, Joop (2015). Survey Mode and mode effects. In: Engel, U.; Jann, Ben; Lynn, Peter; Scherpenzeel, Annette and Sturgis, Patrick (eds.). Improving survey methods (pp. 25-45). London: Routledge.</texto><texto>Lepkowski, James M.; Tucker, Clyde; Brick, J. Michael; Leeuw, Edith D. de; Japec, Lilli; Lavrakas, Paul J.; Link, Michael W. and Sangster, Roberta L. (2008). Advances in telephone survey methodology. New York: Wiley.</texto><texto>Lippe, Elena von der; Schmich, Patrick and Lange, Cornelia (2011).  Advance Letters as a Way of Reducing Non-response in a National Health Telephone Survey . Survey Research Methods, 5(3): 103-116. Available at: http://www.surveymethods.org, access January 23, 2026.</texto><texto>Luiten, Annemieke; Hox, Joop and Leeuw, Edith de (2020).  Survey Nonresponse Trends and Fieldwork . Journal of Official Statistics, 36(3): 469-487.</texto><texto>Lyberg, Lars and Kasprzyk, David (1991). Data collection methods and Measurement Errors. In: Biemer, P. P.; Groves, R. M.; Lyberg, L. E.; Mathiowetz, N. A. and Sudman, S. (eds.). Measurement Errors in Surveys (pp. 235-257). New York: Wiley.</texto><texto>Conrad, Frederic; Broome, Jessica S.; Benkí José R.; Kreuter, Frauke; Groves, Robert M.; Vannette, David and McClain, Colleen (2013).  Interviewer Speech and the Success of Survey Invitations . Journal of the Royal Statistical Society, 176: 191-210. doi: 10.2307/23355183</texto><texto>Couper, Mick P. (2017).  New Developments in Survey Data Collection . Annual Review of Sociology, 43: 21-45.</texto><texto>Dal Grande, Eleonora; Chittleborough, Catherine R.; Campostrini, Stefano; Dollard, Maureen and Winifred Taylor, Anne (2016).  Pre-survey Text Messages (SMS) Improve Participation Rate in an Australian Mobile Telephone Survey: An Experimental Study . PLoS ONE 11(2): e0150231.</texto><texto>Dillman, Don A. (2017).  The Promise and Challenge of Pushing Respondents to the Web in Mixed-Mode Surveys .  Survey Methodology , 43: 3-30.</texto><texto>Dillman, Don A.; Groves, Robert M.; Eltinge, John L. and Little, Roderick J.A. (2002). Survey nonresponse. New York: Wiley.</texto><texto>Frey, James H. (1983). Survey Research by Telephone. London: Sage.</texto><texto>Greenberg, Pierce and Dillman, Don (2021).  Mail Communications and Survey Response . Journal of Survey Statistics and Methodology, 11: 1-22. doi: 10.1093/jssam/smab020</texto><texto>Harrison, Siân; Henderson, Jane; Alderdice, Fiona and Quigley, Maria A. (2019).  Methods to Increase Response Rates to a Population-based Maternity Survey: A Comparison of Two Pilot Studies . BMC Medical Research Methodology, 19.</texto><texto>Higgins, Julian P. T.; Thompson, Simon G.; Deeks, Jonathan J. and Altman, Douglas G. (2003).  Measuring Inconsistency in Meta-analyses . British Medical Journal, 327: 557-560. doi: 10.1136/bmj.327.7414.557</texto><texto>Huedo-Medina, Tania B.; Sánchez-Meca, Julio; Marín-Martínez, Fulgencio and Botella, Juan (2006).  Assessing Heterogeneity in Meta-analysis: Q Statistic or I2 Index? . Psychol Methods, 11(2). doi: 10.1037/1082-989X.11.2.193</texto><texto>Instituto Nacional de Estadística (INE) (2024). Encuesta sobre equipamiento y uso de tecnologías de la información y comunicación en los hogares 2024. Madrid: INE.</texto><texto>Kennedy, Courtney and Hartig, Hannah (2019). Response rates in telephone surveys have resumed their decline. Pew Research Center. Available at: https://www.pewresearch.org/fact-tank/2019/02/27/response-rates-in-telephone-surveys-have-resumed-their-decline/, access January 23, 2026.</texto><texto>RECEPTION: December 3, 2024</texto><texto>REVIEW: April 8, 2025</texto><texto>ACCEPTANCE: September 10, 2025</texto><texto>Schell, Christina; Godinho, Alexandra; Kushnir, Vladyslav and Cunningham, John A. (2018).  To Send or Not to Send: Weighing the Costs and Benefits of Mailing an Advance Letter to Participants before a Telephone Survey . BMC Medical Research Methodology, 11(1): 813. doi: 10.1186/s13104-018-3920-6</texto><texto>Skalland, Benjamin; Zhao, Zhen and Jeyarajah, Jenny (2015).  The Effectiveness of Advance Letters for Cell Telephone Samples . Proceedings. American Statistical Association. Annual Meeting, 20 (May 15-18, 2014).</texto><texto>Sterne, Jonathan A. C.; Gabaghan, David and Edger, Matthias (2000).  Publication and Related Bias in Meta-analysis: Power of Statistical Tests and Prevalence in the Literature . Journal of Clinical Epidemiology, 53: 1119-1129. doi: 10.1016/s0895-4356(00)00242-0</texto><texto>Stoop, Ineke; Billiet, Jaak; Koch, Achim and Fitzgerald, Rory (2010). Improving survey response: lessons learned from the European Social Survey. London: Wiley.</texto><texto>Vicente, Paula and Marques, Catarina (2017).  Do Initial Respondents Differ From Callback Respondents? Lessons From a Mobile CATI Survey . Social Sciences Computer Review, 35: 606-618. doi: 10.1177/0894439316655975 </texto><texto>Vogl, Susanne (2018).  Advance Letters in a Telephone Survey on Domestic Violence Letters in Surveys . International Journal of Public Opinion Research, 31(2): 243-265. doi: 10.1093/ijpor/edy006</texto><texto>Woolf, Benjamin and Edwards, Phil (2021).  Does Advance Contact with Research Participants Increase Response to Questionnaires: An Updated Systematic Review and Meta-analysis . BMC Medical Research methodology, 21(1). doi: 10.1186/s12874-021-01435-2</texto><texto>Lynn, Peter and Taylor, Sol (1998).  The Effect of Preliminary Notification Letter on Response to a Postal Survey . International Journal of Market Research, 40(2). doi: 10.1177/147078539804000204</texto><texto>Massey, James T. (1988). An overview of telephone coverage. In: R. M. Groves et al. (eds.). Telephone Survey Methodology (pp. 3-8). New York: Wiley.</texto><texto>Massey, Douglas and Tourangeau, Roger (2013).  Introduction: New Challenges to Social Measurement . The ANNALS of the American Academy of Political and Social Science, 645: 6-22. Available at: https://www.jstor.org/stable/23479079, access April 8, 2025. </texto><texto>Nathan, Gad (2001).  Telesurvey Methodologies for Household Surveys - A Review and Some Thoughts for the Future . Survey Methodology, 27: 7-31.</texto><texto>Olson, Kristen; Smyth, Jolene D.; Horwitz, Rachel; Keeter, Scott; Lesser, Virginia; Marken, Stephanie; Mathiowetz, Nancy A.; McCarthy, Jaki S.; O Brien, Eileen; Opsomer, Jean D.; Steiger, Darby; Sterrett, David; Su, Jennifer; Suzer-Gurtekin, Z. Tuba; Turakhia, Chintan and Wagner, James (2021).  Transitions from Telephone Surveys to Self-Administered and Mixed-Mode Surveys: AAPOR Task Force Report . Journal of Survey Statistics and Methodology, 9(3): 381-411.</texto><texto>Presser, Stanley and McCulloch, Susan (2011).  The Growth of Survey Research in the United States: Government-Sponsored Surveys 1984-2004 . Social Science Research, 40: 1019-1024. doi: 10.1016/j.ssresearch.2011.04.004</texto><texto>Schell, Christina; Godinho, Alexandra; Kushnir, Vladyslav and Cunningham, John A. (2018).  To Send or Not to Send: Weighing the Costs and Benefits of Mailing an Advance Letter to Participants before a Telephone Survey . BMC Medical Research Methodology, 11(1): 813. doi: 10.1186/s13104-018-3920-6</texto></revista>