Back to Journals » Psychology Research and Behavior Management » Volume 17

Comparative Analysis Between Directly Measured and Parent-Evaluated Executive Function: Predicting Children’s Academic Achievement and Social Development in a One-Year Longitudinal Study

Authors Yin K , Wu Q , Gai X

Received 28 January 2024

Accepted for publication 25 May 2024

Published 4 June 2024 Volume 2024:17 Pages 2255—2270

DOI https://doi.org/10.2147/PRBM.S461720

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Gabriela Topa



Ke Yin,1 Qiong Wu,2 Xiaosong Gai1

1School of Psychology, Northeast Normal University, Changchun, People’s Republic of China; 2Faculty of Education, Northeast Normal University, Changchun, People’s Republic of China

Correspondence: Qiong Wu, Tel +86 13504314652, Fax +86 85683180, Email [email protected]

Purpose: The purpose of this study was to examine differences between directly measured and parent-evaluated executive function in predicting children’s academic achievement and social development, and to explore the mediating roles of peer status and social competence in the effects of executive function on social behavior.
Patients and Methods: The study followed 106 first-grade children in an elementary school in China for one year. Regression and mediation analyses were conducted using SPSS 26.0 and AMOS 21.0 to test the hypotheses.
Results: First, in a comparison of the predictive role of directly measured and parent-evaluated executive function, directly measured executive function played a more important role in predicting academic achievement, while parent-evaluated executive function played a greater role in predicting social development. Second, parent-evaluated executive function influenced social behavior primarily through social competence and peer status, with social competence playing a more significant mediating role than peer status.
Conclusion: Compared with previous studies, the results of the present study provide more direct evidence for the relationship and differences between directly measured and parent-evaluated executive function, further suggesting that they have different efficacy and predictive goals, while the present study also describes the pathways through which executive function influences social behavior: the mediating role of peer status and social competence. This suggests that, on the one hand, educators or researchers need to choose appropriate measures of executive function for their own purposes and, on the other hand, in order to promote the development of children’s social behavior, they need to focus on the development of children’s executive function, social competence and peer relationships.

Keywords: peer status, social behavior, social competence, cognitive control, measurement

Introduction

Executive function (EF) generally refers to a series of top-down mental processes that a person performs to overcome his or her automatic responses, instincts, or intuitions when focusing attention.1 Miyake et al found that executive function is not a single cognitive structure, but a collection of cognitive functions, including inhibitory control, working memory updating, and cognitive flexibility.2 The three subcomponents are related to each other. The three subcomponents are interconnected but fundamentally different and functionally separate,3 and on the basis of these subcomponents, individuals are able to construct more advanced executive functions such as reasoning, problem solving, and planning.4,5 Furthermore, Zelazo et al divided executive functions into two categories: “hot” executive functions associated with the orbitofrontal cortex and “cool” executive functions associated with the dorsolateral prefrontal cortex.6 The former is characterised by a high degree of emotional involvement, requiring flexible evaluation of the emotional significance of stimuli; the latter is more likely to be triggered by relatively abstract, decontextualised problems. Executive function is not only closely related to academic achievement and social development in young children,7–9 but it is also an important and stable predictor of children’s academic achievement and social development.10–15 Good executive function (good performance on inhibitory control, working memory, and cognitive flexibility) can help individuals better plan, regulate attention, and retain relevant information in learning or social environments, thereby promoting their academic achievement or social development.16,17

However, previous research exploring the relationship between executive function and academic achievement or social behavior in young children often did not consider the potential impact of the measurement method of executive function on the research conclusions.18–22 Additionally, there has been a scarcity of studies investigating potential mediating factors between executive function and social behavior. Given this, it is necessary to further research the predictive or influencing role of executive function on academic achievement or social development, in order to deepen researchers’ understanding of the relationships between these variables.

The Impact of Measurement Methods of Executive Function on Its Predictive Role

Directly measured executive function rely on cognitive performance tests.23 These tests are administered under highly standardised conditions where the presentation of stimuli is precisely controlled to ensure that each subject experiences and completes the task in a consistent manner. Assessment criteria are primarily based on subjects’ accuracy, reaction time, and ability to respond quickly under time constraints. Common measures of executive function include the Wisconsin Card Sorting Test (WCST),24 the go/no-go test,25 and the digit span backwards.26 As an example, the Wisconsin Card Sorting Test (WCST) requires subjects to maintain task sets, respond flexibly to feedback, avoid persistent tendencies, and inhibit prior responses that are no longer appropriate.27 A key assessment metric of the WCST is the total number of sets of 10 consecutive correct matches.

Parent-evaluated of executive function are designed to provide ecological validity and valid indicators of an individual’s ability to perform executive function in complex, everyday, problem-solving situations.28 One of the assumptions underlying the use of relevant assessment scales is that they measure behaviors that are closely related to the processes assessed by directly measured executive function assessment methods. The most commonly used executive function assessment scale is the Behavior Rating Inventory of Executive Function (BRIEF).29 The scale contains a total of 86 entries describing subjects’ difficulties with daily living, each rated on a 1–3 scale (1 = never, 2 = sometimes, 3 = often) and categorised as inhibition, shift, and emotional control, Initiative, Working Memory, Plan/Organize, Organization of Materials, and Monitor, among several subscales. In addition, the Children’s Executive Functioning Inventory (CHEXI) can be used to measure inhibition and working memory.30

Direct measurement and parental evaluation are the two most common methods used by researchers to measure executive function. Although researchers have used these two methods interchangeably to assess executive function and often conflate results from different measurement types, researchers have found that directly measured and parent-evaluated executive function are weakly correlated. Some researchers have measured both in children or adolescents and found only a significant weak correlation between the two,31,32 while others have conducted meta-analyses of correlational studies and found that the overall correlation coefficient between the two was only 0.19.33 This weak correlation suggests that the directly measured and the parent-evaluated executive function may be inherently different, and thus the two may not be interchangeable.

For the low correlation between the two measurement methods, three main explanations are proposed according to related studies:33–35

First, the cognitive level or constructs assessed by the two methods differ. Some researchers have argued that directly measured executive function utilizes algorithmic thinking, while parent-evaluated executive function relys on reflective thinking.33,36 Algorithmic thinking is related to information processing mechanisms, including input encoding, sensory registration, working memory, and long-term memory. In contrast, reflective thinking focuses on an individual’s goals, beliefs related to these goals, and rational action choices under these goals and beliefs.36 Therefore, direct measurements of executive function assess the processing efficiency in behavioral control, reflecting an individual’s optimal performance in laboratory tasks. In contrast, parental evaluations assess behavior conducive to goal achievement in real-world environments, reflecting an individual’s executive function performance in daily life.33 Moreover, in the 20 studies analyzed by Toplak et al,33 the direct measurement tasks used were all “cool” executive function tasks, which are relatively abstract and decontextualized, while parental evaluations reflect children’s executive function in emotionally involved situations. Thus, the difference may also reflect the distinction between “cool” and “hot” executive function.

Second, the two measurement methods differ in their variability stability. Many direct measurement tasks of executive function were initially developed to ensure the replicability of experimental effects. Such tasks, by maximizing within-person differences, inherently sacrifice between-person variability, thereby fundamentally reducing measurement reliability or variability stability.34,37 For example, in the color-naming Stroop task, the aim is to maximize the within-person differences between congruent conditions (eg, naming the word “red” as “red”) and incongruent conditions (eg, naming the word “red” as “green”). The results showed that while nearly all participants exhibited a Stroop interference effect, the between-person differences in this interference effect were relatively small, which in turn reduced the reliability or stability of the measure.37 In contrast, parental evaluations of executive function typically have higher variability stability.29

Third, the two measurement methods are differently influenced by the evaluator.33,37 In directly measured executive function, the subjects’ responses are more influenced by the testing environment, instructions, and tester’s hints. Although the assessment is also influenced by the tester’s interpretation of the subject’s responses, this influence is relatively minor. In parental evaluations of executive function, the subjects’ executive function are largely determined by the evaluator (parent), who must select instances from daily life corresponding to the questions or structure and provide estimates of the frequency of certain types of events.38 Different evaluators might make different estimates.

These differences may also make the two different predictors of academic achievement or social development. Some studies have found that directly measured executive function is a stronger predictor of academic achievement than parent- or teacher-evaluated executive function,39 and some studies have found that directly measured executive function is a stronger predictor of neurocognitive performance and parent-evaluated executive function is a stronger predictor of impaired social function in patients with schizophrenia or ADHD.40,41 However, previous studies have either not simultaneously examined the predictive role of both on academic achievement as well as on social development, or have not included normally developing children as subjects, which is not conducive to further exploration of the relationship between the two. Thus, it is necessary to measure the two at the same time, to examine their differences in predicting academic achievement and social development, and to explore the relationship more directly in terms of cognitive level or conceptualisation, stability of variance, and degree of influence by the evaluator.

The Mediating Role of Peer Status and Social Competence in the Impact of Executive Function on Social Behavior

The integrative model of social cognitive abilities establishes a dynamic relationship between executive function and social development. This model, proposed by Beauchamp and Anderson,42 suggests that cognitive and emotional factors determining social behavior include attention, executive function, and socio-emotional skills. These processes are interconnected at both behavioral and neurological levels, forming a functional system. Executive function interact with mediators affecting social competence (such as brain structure/function, biological factors, and environment) and also directly impact an individual’s ability to engage in social interactions and navigate environments.

According to the integrative model of social cognitive abilities and related studies, components of executive function can promote the development of social behavior (manifestations of social development in everyday domains, including positive social behaviors and problem behaviors) by influencing social competence (the ability to coordinate various processes and resources to meet social needs and achieve social goals, including emotional regulation, adherence to group norms, and self-awareness) or peer status (the degree of acceptance by peers). Firstly, inhibitory control allows individuals to adjust and adapt their behavior to comply with established social norms, playing a crucial role in the development of children’s social behavior. For instance, preschoolers often conflict with peers, and sometimes other children may interfere with their activities (like taking away toys they are playing with). Children who can inhibit impulses and resolve issues through communication are likely to be seen as better playmates by classmates and teachers, thus having better sociality. Conversely, those unable to inhibit impulses may exhibit externalized problem behaviors, such as physical aggression, and could be viewed as undesirable playmates, leading to potential internalized problems.43–45 Secondly, a robust working memory helps children remember the behavioral ways of social norms and maintain social goals,1,46,47 aiding them in enacting positive social behaviors. For example, reminding children that “it is better to communicate than to use violence if a classmate takes away the toy they are playing with” can increase their likelihood of exhibiting communicative behaviors in peer conflicts. Thirdly, cognitive flexibility aids individuals in flexibly adapting to environmental demands and viewing problems from different perspectives. This benefits children in creatively solving problems (eg, children with stronger cognitive flexibility are more likely to engage in communication and find solutions or behaviors that satisfy both parties when others play with their toys), thereby enhancing self-efficacy, promoting self-awareness development, and further advancing their positive social behaviors.21

In conclusion, although previous studies have explored the interrelations among various factors, there has been a lack of research analyzing the overall relationship between these factors. Therefore, further exploration is needed into the mediating role of peer status and social competence in the impact of executive function on social behavior.

Research Hypotheses

This study aims to explore the predictive effects of executive function, both directly measured and parent-evaluated, on the academic achievement and social development of children, as well as to investigate the mediating role of peer status and social competence in the impact of executive function on social behavior. Considering that the first grade of elementary school is a critical period for the development of children’s executive function, academic achievement, and social development,48 this study focuses on first-grade children as its subjects. Given that academic achievement is usually obtained from children’s language and mathematics test scores (a direct measurement, similar to directly measured executive function), and social development is typically obtained through adult evaluations (similar to parent-evaluated executive function), this study hypothesizes that, after controlling for the impact of family economic status and gender, directly measured executive function have a better predictive effect on academic achievement, and parent-evaluated executive function have a better predictive effect on social development (Hypothesis 1). Furthermore, considering the role of executive function in influencing social behavior, including peer status and social competence, this study hypothesizes that, after controlling for family economic status and gender, peer status and social competence mediate the relationship between executive function and social behavior (Hypothesis 2).

Materials and Methods

Participants

This study was conducted with all children (106 in total) in three first-grade classes in a primary school in Changchun City. There was no subject attrition during the study period, and teachers reported that all children were normally developing. The mean age of the participants was 6.7 (±0.5) years, and 50.9% were boys. More information about the participants can be found in the Table 1.

Table 1 Basic Information of Subjects

Measurement Tools

Executive Function

Direct Measurement 1: Fish Flanker Task

This task is a classic one for assessing children’s inhibitory control.49 Participants sit in front of a computer screen and respond to a fish facing left or right in the center of the screen by pressing “left” or “right” buttons on the keyboard. The central target fish is flanked by two fish on each side. In congruent trials, the flanking fish face the same direction as the target fish, and in incongruent trials, they face the opposite direction. Each stimulus is presented for a maximum of 3000 ms (until the participant presses a key, as shown in Figure 1). The participant’s inhibitory control is measured by subtracting the reaction time in congruent trials from that in incongruent trials; a larger value indicates poorer inhibitory control.

Figure 1 Flowchart of the Fish Flanker Task.

Direct Measurement 2: Self-Ordered Pointing Task

This study uses a computerized version of this task. Several images (starting from 2 and increasing progressively) are displayed on a computer screen. Participants must first point out one of the images, then in the subsequent trial, point to a different image, and so on, until they repeat a previously indicated image or correctly identify all images on the screen. The difficulty of the test increases as the number of images increases, continuing until the participant fails to correctly identify the images (the task with image number 2 is shown in Figure 2). The number of consecutively correctly identified images reflects the participant’s working memory span.50 Working memory capacity is indicated by the working memory span; a larger value indicates better working memory.

Figure 2 Flowchart of the Self-Ordered Pointing Task.

Direct Measurement 3: Picture-Symbol Task

Based on the number-letter task by Miyake et al,2,51 a bigram composed of a picture and a symbol appears in one of the four quadrants of the computer screen (displayed for up to 3000 ms). Participants must decide if the picture in the bigram is an animal when it appears in the first or second quadrant, or if the symbol is a number when it appears in the third or fourth quadrant (as shown in Figure 3). Each presentation of a bigram is followed by a voice asking “Animal?” or “Number?”. The participant’s response accuracy in this task reflects their cognitive flexibility. In this study, the response accuracy rate is used as an indicator; a higher value indicates better cognitive flexibility.

Figure 3 Flowchart of the Picture-Symbol Task.

Parental Evaluation: BRIEF Parent Rating Scale

This study uses the second edition of the behavior rating inventory of executive function (BRIEF),52 which has been modified. The inventory consists of 66 items, each scored on a 1–3 scale (1=Never, 2=Sometimes, 3=Often), and includes subscales for inhibition (eg, “Talks at the wrong time”), shifting (eg, “Becomes upset with new situations”), emotional control (eg, “Has explosive, angry outbursts”), initiation (eg, “Has trouble getting started on homework or chores”), working memory (eg, “Has trouble with chores or tasks that have more than one step”), plan/organize (eg, “Gets caught up in details and misses the big picture”), organization of materials (eg, “Forgets to hand in homework, even when completed”), and monitor (eg, “Makes careless errors”). The Cronbach’s alpha for the scale in this study is 0.97, with subscale alphas ranging from 0.70 to 0.87. The structural validity from confirmatory factor analysis is: χ2/df=1.99, GFI = 0.96, IFI = 0.63, CFI = 0.62, RMSEA = 0.10. The total score on this inventory is used as an indicator in this study, with a higher score indicating poorer executive function as evaluated by parents.

Social Development

Peer Status

Peer status was measured using the peer nomination method.53 Children were given a class roster and asked two questions: “When you have a birthday, who are the three best friends you would most like to invite?” and “The class is going to do activities in groups, which three people would you least like to be in a group with?”. The number of nominations received for each question was divided by the total number of children in the class to calculate the proportions of positive and negative nominations. Peer status was determined by the difference between these two proportions. In this study, this difference was used as an indicator, with a larger value indicating higher peer status.

Social Competence

Social competence was assessed using the social competence subscale of the children’s social scale (CSS) developed by Zhuang.54 Parents completed this scale online, rating 21 items on a 3-point scale, assessing children’s emotional regulation (eg, “When parents do not immediately fulfill the child’s request, the child usually”), self-awareness (eg, “When seeing other children struggling with something, the child will”), and group norm compliance (eg, “During class, when the teacher asks for quiet and good behavior, the child will”). The overall Cronbach’s alpha for the social competence scale in this study was 0.86, with alphas for emotional regulation, self-awareness, and group norms being 0.65, 0.78, and 0.57 respectively. The confirmatory factor analysis showed structural validity: χ2/df=1.39, GFI = 0.83, IFI = 0.85, CFI = 0.84, RMSEA = 0.06. The score on this scale was used as an indicator, with higher scores indicating better social development in respective dimensions.

Social Behavior

Social behavior was assessed using the problem behaviors subscale of the strengths and difficulties questionnaire (SDQ) and the positive social behavior subscale of the CSS. Teachers completed the SDQ,55 which comprises 20 items (3 items were omitted due to reliability issues) assessing emotional symptoms (eg, “Often unhappy, down-hearted or tearful”), conduct problems (eg, “Often lies or cheats”), hyperactivity/inattention (eg, “Often restless, overactive, cannot stay still for long”) and peer relationship problems (eg, “Has one or more good friends”). The questionnaire uses a 3-point scale, from 0 to 2, indicating “Not True” to “Certainly True”. The CSS positive social behavior subscale, completed by parents, consists of 11 items assessing behaviors such as sharing (eg, “When the child has snacks and encounters other children, the child will”), cooperation (eg, “When building blocks with other children, the child will”), helping others (eg, “When another child falls, the child will”), and empathetic concern (eg, “When seeing another child crying, the child will”). The scale also uses a 3-point scale, from 1 to 3, indicating “Not True” to “Certainly True”. The overall Cronbach’ s alpha for the social behavior scale in this study was 0.78, with confirmatory factor analysis showing structural validity: χ2/df=1.72, GFI = 0.75, IFI = 0.83, CFI = 0.82, RMSEA = 0.08. The alphas for the problem behavior and positive social behavior scales were 0.81 and 0.78, respectively. The total social behavior score was generated by averaging the standard scores of the problem behaviors and social behavior scales; a higher score indicates better social behavior development.

Academic Achievement

In this study, academic achievement was reflected through participants’ language arts and mathematics scores. These subjects’ tests, based on national new curriculum standards by respective experts (end-of-semester examination papers), were conducted in classrooms in a one-hour timed setting. Both language arts and mathematics had a maximum score of 100. Academic achievement was represented by the mean of the z-scores of these two subjects; higher scores indicated better academic performance.

Socioeconomic Status

Socioeconomic Status (SES) was measured by reporting the educational level and occupation of the child’s parents. Educational levels included: A. elementary school or below; B. junior high school; C. high school or vocational school; D. junior college; E. university; F. master’s degree or above; G. unknown. Occupational categories included: A. unemployed or semi-unemployed; B. service and manual labor (eg, workers, farmers, waiters); C. clerical staff (eg, secretaries, salespeople); D. self-employed with no or few employees; E. owners of medium to large businesses; F. mid-level corporate managers; G. military personnel or police officers; H. professionals (eg, doctors, teachers, engineers, accountants, lawyers, designers); I. government officials; J. unknown. Following the method of Shi and Shen,56 these variables were coded and transformed, and their z-scores were combined to determine the child’s family SES, with higher values indicating higher SES. In this study, this variable was used as a control variable.

Research Procedure

This study measured variables such as executive function, social development, family SES, and academic achievement of first-grade students at two time points. At the first time point (Fall semester of 2022), children’s executive function and family SES were measured. Direct measurements of executive function were conducted by researchers in two quiet and tidy elementary school classrooms. Family economic status and parental evaluations of executive function were obtained through online questionnaires completed by the children’s parents. At the second time point (Spring semester of 2023), children’s social development and academic achievement were measured. Children completed peer nomination for peer status and academic achievement tests in classroom settings. Teachers filled out the SDQ paper questionnaires, and parents completed the CSS scale online.

Data Processing

Before data analysis, the normality of the data was assessed (all variables were normally distributed), and regression was used to replace outliers (values more than three standard deviations from the mean) and missing values. Additionally, for first-grade children, the various components of EF (such as working memory, inhibition, shifting) are highly integrated,57–59 and it is standard practice to combine measures of EF components into a single composite variable. Therefore, this study created a composite variable “EFDirect” based on the average of the standardized scores of the three EF components.

Descriptive statistics, regression, and mediation analyses were conducted using SPSS 26.0 and AMOS 21.0.

Results

Test for Common Method Bias

Considering that the BRIEF 2 parent rating scale, the strengths and difficulties questionnaire, and the children’s social scale were all assessed by adults, which might affect the research conclusions, this study employed the Harman single-factor test for common method bias. The results showed that there were 34 factors with eigenvalues greater than 1, and the first factor accounted for 21.32% of the variance (less than the critical standard of 40%). This indicates that common method bias is not a serious concern in this study.

Descriptive Statistics of Variables and Test of Gender Differences

Descriptive statistics were conducted for sample size, minimum, maximum, mean, and standard deviation of each variable, and t-tests were used to examine gender differences in the variables. The results (as shown in Table 2) revealed significant gender differences in academic achievement and peer status. Boys had significantly higher academic achievement than girls (p = 0.04, d = 0.42), and girls had significantly higher peer status than boys (p = 0.04, d = 0.41).

Table 2 Descriptive Statistics and Gender Differences Test for Each Variable

Correlation Analysis of Executive Function, Academic Achievement, and Social Development

After controlling for gender and age, partial correlation analyses were conducted for each variable, as shown in Table 3. The results indicated that direct measurement of EF was significantly correlated with academic achievement (r = 0.19, p = 0.050). Parentally evaluated EF was significantly correlated with social competence (r = −0.45, p < 0.001), peer status (r = −0.26, p = 0.008), and social behavior (r = −0.40, p < 0.001).

Table 3 Partial Correlation Analysis of Executive Function, Academic Achievement, and Social Development

Hierarchical Linear Regression Analysis of Executive Function, Academic Achievement, and Social Development

A hierarchical linear regression model was used to explore the predictive effects of directly measured EF and parent-evaluated EF on academic achievement and social development. The variables were introduced into the equation in three steps: first, gender and SES were entered; second, directly measured EF was added; and third, parent-evaluated EF was included. The dependent variables were academic achievement, social competence, peer status, and social behavior. The results (as shown in Table 4) indicated that, after controlling for gender and SES, directly measured EF significantly and positively predicted academic achievement (with significant model, regression coefficients, and ΔR2), whereas parent-evaluated EF significantly predicted children’s peer status, social competence, and social behavior (with significant model, regression coefficients, and ΔR2).

Table 4 Hierarchical Linear Regression Model for Predicting Academic Achievement

Test of the Indirect Effect of Executive Function on Social Behavior

The mediation analysis was conducted using the Bootstrap method with 5000 resamples and a 95% bias-corrected confidence interval. An effect was considered significant if the confidence interval did not include zero.60 Considering that directly measured EF had no significant correlation with the variables of sociality, and it did not significantly predict any of the social variables, this part of the analysis only used the total score of parent-evaluated executive function as the indicator of executive function. The parallel multiple mediation effects of social competence and peer status between executive function and social behavior were tested. The fit indices for this model were good: χ2/df=0.44, GFI = 1.00, IFI = 1.01, CFI = 1.00, RMSEA = 0.00. The results (as shown in Figure 4) indicated that the mediating effects of social competence and peer status were significant. The mediating effect of peer status was −0.07, accounting for 23.33% of the total effect, with a 95% confidence interval of [−0.18, −0.01]. The mediating effect of social competence was −0.23, accounting for 76.67% of the total effect, with a 95% confidence interval of [−0.38, −0.13].

Figure 4 Parallel multiple mediating effects of social competence and peer status between executive function and social behavior.

Discussion

Differences in Predictive Effects of Directly Measured and Parent-Evaluated Executive Function on Academic Achievement and Social Development in First-Grade Children

This study, employing a longitudinal design and controlling for SES and gender, explored differences in predictive effects of directly measured and parent-evaluated executive function on the academic achievement and social development of first-grade children. The results revealed that directly measured executive function had a significant advantage in predicting academic achievement, whereas parent-evaluated executive function were more predictive of social development variables such as peer status, social competence, and social behavior. This finding is generally consistent with the research hypotheses and with Graziano et al’s finding (that directly measured executive functions play a greater role in predicting academic achievement than parent-evaluated executive functions),39 and can be explained in the following ways:

Firstly, in terms of the cognitive level or constructs measured, directly measured executive function primarily reflect an individual’s processing efficiency in behavioral control situations, focusing on optimal performance in laboratory tasks. Parent-evaluated executive function, on the other hand, reflect behaviors that facilitate goal achievement in real-world environments, focusing on executive function performance in daily life.33 Therefore, directly measured executive function may predict academic achievement better because the assessment methods used in this study, focused on children’s processing efficiency in numerical operations and verbal comprehension, are similar to direct measurement in cognitive level or constructs. Parent-evaluated executive function may predict social development better because indicators of social development, such as social competence or social behavior, focus on psychological or behavioral characteristics reflecting sociality in life, making them more similar in cognitive level or constructs to parent evaluation.

Second, in terms of stability of variance, directly measured executive function has lower between-person variability and thus lower stability of variance, whereas parent-evaluated executive function has higher between-person variability and thus higher stability of variance.34,35,37 Therefore, directly measured executive function may predict academic achievement better because the assessment of academic achievement as direct measurement involves lower between-person variability or variability stability, akin to the nature of direct measurement of executive function. Parent-evaluated executive function may predict social development better because the assessment of social development as social evaluation involves higher between-person variability or variability stability, similar to parent evaluation of executive function.

Thirdly, from the perspective of the influence of evaluators, both directly measured executive function and academic achievement primarily involve children completing specific tests, although the assessments are somewhat influenced by evaluators’ interpretation of the responses. In contrast, most indicators of parent-evaluated executive function and social development are assessed by adults, requiring them to select corresponding instances from life and provide estimates of the frequency of relevant events, thus being more influenced by the evaluators. Hence, there are differences in the predictive effects of directly measured and parent-evaluated executive function.33,37

The results of this study indicate that direct measurement and parental evaluation of executive function cannot replace each other. They differ significantly in the content measured, clarity of children’s response expectations, and the degree of evaluator influence, showing substantial differences in predicting different child development variables (academic achievement and social development). Therefore, using both methods together to measure executive function can help researchers better understand the predictive role of executive function in academic achievement and social development.

The Indirect Effect of Executive Function on Social Behavior

This study aimed to explore the mediating role of peer status and social competence in the influence of directly measured and parent-evaluated executive function on social behavior. The results showed that peer status and social competence played mediating roles between parent-evaluated executive function and social behavior. The parallel mediation model of peer status and social competence indicated that parent-evaluated executive function do not directly affect social behavior, but rather influence social behavior by affecting peer status and social competence, consistent with the study hypothesis and the integrative model of social cognitive abilities. This finding echoes the research by Martarelli et al,61 who measured executive function, social competence, and social adaptation level a year later in 6-7-year-old children and found that children’s social adaptation level was highest only when both executive function and social competence were high. Additionally, Elliott found that executive function could not fully explain children’s problem behaviors,62 and this study provides an explanation: executive function primarily influence social behavior through peer status and social competence.

Executive function can influence social behavior through this mediating pathway. First, from the perspective of social information processing theory,63 children with stronger executive function might have the following advantages in information processing: 1. Better inhibition of attention to irrelevant cues, thus gaining more relevant social cues; 2. More flexible and rich interpretation of information, enabling deeper interpretation of social cues; 3. Ability to retain sufficient information to ensure effective assessment of response methods; 4. Greater self-control in response execution, inhibiting impulsive reactions. Secondly, the advantages in information processing can translate into advantages in social competence or peer status: efficient processing of social cues and effective execution of appropriate response methods help children better understand social situations, adhere to group norms, and develop self-awareness, thereby promoting the development of social competence. Simultaneously, this helps them adjust response methods in peer conflicts, enhancing peer status. Finally, advantages in social competence or peer status can lead to changes in social behavior. For example, children who can effectively control their emotions are more likely to avoid conflict behaviors, and children with higher peer status may exhibit more cooperative or communicative behaviors, rather than aggressive behaviors, in interactions with peers.

In summary, the results of this study suggest that cognitive factors in children (such as executive function) can influence the development of their social behavior by affecting social factors (such as peer status and social competence). Therefore, when fostering children’s social behavior, the role of cognitive abilities (such as executive function) should be valued and utilized.

Research Inspiration and Practical Suggestions

The present study found that in a comparison of the predictive role of directly measured executive function versus parent-evaluated executive function, directly measured executive function was a greater predictor of academic achievement, while parent-evaluated executive function was a greater predictor of social development; parent-evaluated executive function influenced social behavior primarily through social competence and peer status, with the mediating role of social competence being more pronounced than the mediating role of peer status. Based on these findings, the following research insights and practice recommendations are made:

First, a rational choice of executive function measures. When exploring the relationship between executive function and other variables, the following characteristics of other variables need to be considered: whether the response expectations are clear, whether the cognitive level assessed is algorithmic or reflective thinking and the degree to which the measurement is influenced by the assessor, and the corresponding measurement should be selected based on the similarity between direct measurement/parental evaluation of executive function and other variables in terms of these characteristics. For example, when it is necessary to consider the relationship between executive function and some cognitive abilities that reflect the processing speed of the subjects (eg, arithmetic ability), it may be more appropriate to choose the direct measurement of executive function; and when it is necessary to consider the relationship between executive function and some variables that reflect the typical psychological or behavioural characteristics of the subjects’ lives (eg, social ability), it may be more appropriate to choose the parental evaluation of executive function.

Second, attention should be paid to the development of executive function in young children. Executive function is closely related not only to children’s academic achievement but also to their social development, and it is a crucial competency in children’s family, school and social life. Early childhood is a developmentally sensitive period, teachers or parents need to pay attention to the development of executive function of young children. In addition, in order to promote executive function of young children, teachers or parents may consider allowing children to participate in pretend play.64 Conduct mindfulness training,65 increase their cognitive engagement during exercise,66 and give them more responses or feedback in their daily interactions with children.67

Third, emphasis is placed on the development of social competence and improvement of peer relationships for young children. The development of children’s social behaviors is very often mediated by social competence and peer relationships,68 thus to promote children’s social behaviors, it is necessary to develop their social competence as well as to improve their peer relationships. Teachers or parents should develop children’s emotional control in their daily educational and teaching activities, help them understand and comply with group norms, promote the development of their self-awareness with the help of encouragement or guidance, as well as promote the development of their peer interaction skills by creating more peer interaction activities, so as to reduce their problematic behaviors and promote the development of their positive social behaviors.

Limitations and Future Directions

This study aimed to explore the differences in the predictive effects of directly measured and parent-evaluated executive function on academic achievement and social development, and to analyze the mediating role of peer status and social competence between executive function and social behavior. However, there are several limitations in this study. First, although the present study revealed significant differences in the predictive effects of direct measures and parent-evaluated executive functions on academic achievement and social development, future research needs to control for more variables for in-depth analyses in order to accurately identify potential mechanisms or causes, such as determining the effects of factors such as cognitive level or constructs, stability of variation, and degree of influence by the evaluator. Second, there are limitations in the selection of the study population. This study involved only first-grade students in a primary school in Changchun City. Future studies should consider expanding the sample to include a more diverse group of participants and take cultural specificities into account. Third, because the directly measured and parent-evaluated executive function measures used in this study measured different levels of executive function (directly measured executive function measures included the fish flanker, self-ordered pointing, and picture symbol tasks, which require depletion of inhibition, working memory, and switching of executive function, and parent-evaluated executive function measures included the BRIEF Parent Rating Inventory, which includes not only inhibition, working memory and switching, but also emotional control and higher-order executive functions such as planning and organisation), so the results of the present study may have been affected by this issue, and future research could consider means to control for or attenuate the effect. Fourth, the present study had a short follow-up period, and longer follow-up studies may be needed in the future to validate the findings of this paper. Fifth, although the present study found that executive function influences social behavior primarily through social competence and peer status, with social competence being a more significant mediator, further research is nonetheless needed to explore the underlying mechanisms of these relationships, as well as to explore whether interventions aimed at improving executive function can contribute to social developmental outcomes. Finally, in terms of parent-evaluated measures of executive function and social development, this study primarily used questionnaires, which can be very burdensome for parents and teachers and may result in some questionnaires being filled out in a sloppy manner, which may affect the accuracy of the findings. Future research could mitigate this effect by using a variety of methods (eg, experimental, observational, and interview methods).

Conclusion

This study, through a longitudinal design, examined the differences in the predictive effects of directly measured and parent-evaluated executive function on academic achievement and social development, as well as the indirect effect of executive function on social behavior. The results found that: First, in a comparison of the predictive role of direct measures and parental assessments of executive function, directly measured executive function played a more important role in predicting academic achievement, while parent-evaluated executive function played a greater role in predicting social development. Second, parent-evaluated executive function influenced social behavior primarily through social competence and peer status, with social competence playing a more significant mediating role than peer status.

Ethics Statement

The study complies with the Declaration of Helsinki. The study involving human participants were reviewed and approved by Institutional Review Board of Northeast Normal University. Written informed consent to participate in this study was provided by the participants’ legal guardian/next of kin. No potential conflicts of interest.

Acknowledgments

The study would not have been possible without the contributions of the authors, the support of the institution, and the active participation of the subjects. We thank all the members who supported this study.

Disclosure

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

1. Diamond A. Executive functions. Annu Rev Psychol. 2013. doi:10.1146/annurev-psych-113011-143750

2. Miyake A, Friedman NP, Emerson MJ, Witzki AH, Howerter A, Wager TD. The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” tasks: a latent variable analysis. Cogn Psychol. 2000;41(1):49–100. doi:10.1006/cogp.1999.0734

3. Friedman NP, Miyake A. Unity and diversity of executive functions: individual differences as a window on cognitive structure. Cortex. 2017;86:186–204. doi:10.1016/j.cortex.2016.04.023

4. Collins A, Koechlin E. Reasoning, learning, and creativity: frontal lobe function and human decision-making. PLoS Biol. 2012;10. doi:10.1371/journal.pbio.1001293

5. Lunt L, Bramham J, Morris RG, et al. Prefrontal cortex dysfunction and “Jumping to Conclusions”: bias or deficit? J Neuropsychol. 2012;6:65–78. doi:10.1111/j.1748-6653.2011.02005.x

6. Zelazo PD, Carlson SM. Hot and cool executive function in childhood and adolescence: development and plasticity. Child Dev Perspect. 2012;6(4):354–360. doi:10.1111/j.1750-8606.2012.00246.x

7. Bachman HJ, Miller P, Elliott L, Duong S, Libertus M, Votruba-Drzal E. Associations among socioeconomic status and preschool-aged children’s, number skills, and spatial skills: the role of executive function. J Exp Child Psychol. 2022;221:105453. doi:10.1016/j.jecp.2022.105453

8. Korucu I, Litkowski E, Schmitt SA. Examining Associations between the Home Literacy Environment, Executive Function, and School Readiness. Early Educ Dev. 2020;31:455–473. doi:10.1080/10409289.2020.1716287

9. Beisly A, Kwon KA, Jeon S. Executive function and learning behaviors: associations with academic skills among preschoolers. Early Child Dev Care. 2020;190:2469–2483. doi:10.1080/03004430.2019.1585347

10. Willoughby MT, Piper B, Oyanga A, Merseth King K. Measuring executive function skills in young children in Kenya: associations with school readiness. Dev Sci. 2019;22. doi:10.1111/desc.12818

11. Wolf S, McCoy DC. The role of executive function and social-emotional skills in the development of literacy and numeracy during preschool: a cross-lagged longitudinal study. Dev Sci. 2019;22. doi:10.1111/desc.12800

12. Finders JK, McClelland MM, Geldhof GJ, Rothwell DW, Hatfield BE. Explaining achievement gaps in kindergarten and third grade: the role of self-regulation and executive function skills. Early Child Res Q. 2021;54:72–85. doi:10.1016/j.ecresq.2020.07.008

13. Meixner JM, Warner GJ, Lensing N, Schiefele U, Elsner B. The relation between executive functions and reading comprehension in primary-school students: a cross-lagged-panel analysis. Early Child Res Q. 2019;46:62–74. doi:10.1016/j.ecresq.2018.04.010

14. Simanowski S, Krajewski K. Specific Preschool Executive Functions Predict Unique Aspects of Mathematics Development: a 3-Year Longitudinal Study. Child Dev. 2019;90:544–561. doi:10.1111/cdev.12909

15. Purpura DJ, Schmitt SA, Ganley CM. Foundations of mathematics and literacy: the role of executive functioning components. J Exp Child Psychol. 2017;153:15–34. doi:10.1016/j.jecp.2016.08.010

16. Blair C, Raver CC. School readiness and self-regulation: a developmental psychobiological approach. Annu Rev Psychol. 2015;66:711–731. doi:10.1146/annurev-psych-010814-015221

17. Huyder V, Nilsen ES, Bacso SA. The relationship between children’s executive functioning, theory of mind, and verbal skills with their own and others’ behaviour in a cooperative context: changes in relations from early to middle school-age. Infant Child Dev. 2017;26. doi:10.1002/icd.2027

18. Schmerold K, Bock A, Peterson M, Leaf B, Vennergrund K, Pasnak R. The Relations Between Patterning, Executive Function, and Mathematics. J Psychol. 2017;151:207–228. doi:10.1080/00223980.2016.1252708

19. Williams KE, Bentley LA. Latent Profiles of Teacher-Reported Self-Regulation and Assessed Executive Function in Low-Income Community Preschools: relations With Motor, Social, and School Readiness Outcomes. Front Psychol. 2021;12. doi:10.3389/fpsyg.2021.708514

20. De Franchis V, Usai MC, Viterbori P, Traverso L. Preschool executive functioning and literacy achievement in Grades 1 and 3 of primary school: a longitudinal study. Learn Individ Differ. 2017;54:184–195. doi:10.1016/j.lindif.2017.01.026

21. Zorza JP, Marino J, Mesas AA. Executive functions as predictors of school performance and social relationships: primary and secondary school students. Span J Psychol. 2017;19:1–10. doi:10.1017/sjp.2016.23

22. Romero-López M, Pichardo MC, Ingoglia S, Justicia F. The role of executive function in social competence and behavioural problems in childhood education. Ann Psychol. 2018;34:490–499. doi:10.6018/analesps.34.3.307391

23. Pennington BF. The Development of Psychopathology: Nature and Nurture. New York: Guilford; 2002.

24. Heaton RK, Chelune GJ, Talley JL, Kay GG, Curtis G. Wisconsin Card Sorting Test (WCST) Manual, Revised and Expanded. Odessa, FL: Psychological Assessment Resources; 1993.

25. Brocki KC, Bohlin G. Executive functions in children aged 6 to 13: a dimensional and developmental study. Dev Neuropsychol. 2004;26(2):571–593. doi:10.1207/s15326942dn2602_3

26. Van der Ven SHG, Kroesbergen EH, Boom J, Leseman PPM. The development of executive functions and early mathematics: a dynamic relationship. Br J Educ Psychol. 2012;82(1):100.

27. Salthouse TA, Atkinson TM, Berish DE. Executive Functioning as a Potential Mediator of Age-Related Cognitive Decline in Normal Adults. J Exp Psychol Gen. 2003;132(4):566–594. doi:10.1037/0096-3445.132.4.566

28. Roth RM, Isquith PK, Gioia GA. Behavior Rating Inventory of Executive Function- Adult Version. Lutz, Florida: Psychological Assessment Resources, Inc; 2005.

29. Gioia GA, Isquith PK, Guy SC, Kenworthy L. Behavior Rating Inventory of Executive Function. Odessa, Florida: Psychological Assessment Resources; 2000.

30. Thorell LB, Eninger L, Brocki KC, Bohlin G. Childhood Executive Function Inventory (CHEXI): a promising measure for identifying young children with ADHD? J Clin Exp Neuropsych. 2010;32(1):38–43. doi:10.1080/13803390902806527

31. Hamamcı B, Acar IH, Uyanik G. Association between performance-based and ratings of Turkish children’s executive function. Cur Psychol. 2023;42(12):10053–10062. doi:10.1007/s12144-021-02307-0

32. Snyder HR, Friedman NP, Hankin BL. Associations Between Task Performance and Self-Report Measures of Cognitive Control: shared Versus Distinct Abilities. Assess. 2021;28(4):1080–1096. doi:10.1177/1073191120965694

33. Toplak ME, West RF, Stanovich KE. Practitioner Review: do performance-based measures and ratings of executive function assess the same construct? J Child Psychol Psychiatr. 2013;54(2):131–143. doi:10.1111/jcpp.12001

34. Enkavi AZ, Eisenberg IW, Bissett PG, et al. Large-scale analysis of test–retest reliabilities of self-regulation measures. Proc Natl Acad Sci U S A. 2019;116:5472–5477. doi:10.1073/pnas.1818430116

35. Annotti LA, Teglasi H. Functioning in the Real World: using Storytelling to Improve Validity in the Assessment of Executive Functions. J Pers Assess. 2017;99:254–264. doi:10.1080/00223891.2016.1205075

36. Stanovich KE. Rationality and the Reflective Mind, Rationality and the Reflective Mind. Oxford University Press; 2011; doi:10.1093/acprof:oso/9780195341140.001.0001

37. Dang J, King KM, Inzlicht M. Why Are Self-Report and Behavioral Measures Weakly Correlated? Trends Cognit Sci. 2020. doi:10.1016/j.tics.2020.01.007

38. Sharma L, Markon KE, Clark LA. Toward a theory of distinct types of “impulsive” behaviors: A meta-analysis of self-report and behavioral measures. Toward a theory of distinct types of ures Weakly Correlated?y in the Assessment of Executive Functions. of self-regu. Psychol Bull. 2014;140(2):374–408. doi:10.1037/a0034418

39. Graziano PA, Garb LR, Ros R, Hart K, Garcia A. Executive Functioning and School Readiness Among Preschoolers With Externalizing Problems: the Moderating Role of the Student-Teacher Relationship. Early Educ Dev. 2016;27(5):573–589. doi:10.1080/10409289.2016.1102019

40. van Aken BC, Rietveld R, Wierdsma AI, et al. Self-report versus performance based executive functioning in people with psychotic disorders. Schizophr Res Cogn. 2023;34:100293. doi:10.1016/j.scog.2023.100293

41. Lafavor T, Gimbel B, Olsen A, Travis A, Weber R. Relationship of parent-evaluated and objectively evaluated executive function to symptoms of posttraumatic stress and attention-deficit/hyperactivity disorder in homeless youth. Child Neuros. 2022;28(6):768–790. doi:10.1080/09297049.2021.2016671

42. Beauchamp MH, Anderson V. SOCIAL: an Integrative Framework for the Development of Social Skills. Psychol Bull. 2010;136:39–64. doi:10.1037/a0017768

43. Selcuk B, Yavuz HM, Etel E, Harma M, Ruffman T. Executive function and theory of mind as predictors of socially withdrawn behavior in institutionalized children. Soc Dev. 2018;27:109–124. doi:10.1111/sode.12252

44. Morgan PL, Farkas G, Hillemeier MM, Pun WH, Maczuga S. Kindergarten Children’s Executive Functions Predict Their Second-Grade Academic Achievement and Behavior. Child Dev. 2019;90:1802–1816. doi:10.1111/cdev.13095

45. Wang Y, Liu Y. The Development of Internalizing and Externalizing Problems in Primary School: contributions of Executive Function and Social Competence. Child Dev. 2021;92:889–903. doi:10.1111/cdev.13462

46. Caporaso JS, Boseovski JJ, Marcovitch S. The individual contributions of three executive function components to preschool social competence. Infant Child Dev. 2019;28. doi:10.1002/icd.2132

47. Wang Y, Zhou X. Longitudinal Relations Between Executive Function and Internalizing Problems in Grade School: the Role of Peer Difficulty and Academic Performance. Dev Psychol. 2019. doi:10.1037/dev0000790

48. Black MM, Walker SP, Fernald LC, et al. Early childhood development coming of age: science through the life course. Lancet. 2017. doi:10.1016/S0140-6736(16)31389-7

49. Rueda MR, Fan J, McCandliss BD, et al. Development of attentional networks in childhood. Neuropsychologia. 2004;42:1029–1040. doi:10.1016/j.neuropsychologia.2003.12.012

50. Ward H, Shum D, McKinlay L, Baker-Tweney S, Wallace G. Development of prospective memory: tasks based on the prefrontal-lobe model. Child Neuropsychol. 2005;11:527–549. doi:10.1080/09297040490920186

51. Lee K, Ng SF, Pe ML, Ang SY, Mnam H, Bull R. The cognitive underpinnings of emerging mathematical skills: executive functioning, patterns, numeracy, and arithmetic. Br J Educ Psychol. 2012;82:82–99. doi:10.1111/j.2044-8279.2010.02016.x

52. Gioia GA, Isquith PK, Guy SC, Kenworthy L. BRIEF2: Behavior Rating Inventory of Executive Function (Second Ed.). Lutz, FL: Psychological Assessment Resources; 2015.

53. Qin Y, Peng YS. The effect of parenting styles on social anxiety in junior high school students: the chain mediated role of rumination and peer acceptance. Psychol Dev Educ. 2024;40:103–113. doi:10.16187/j.cnki.issn1001-4918.2024.01.11

54. Zhuang YY. The Influence of the Quality of Teacher-Child Interaction on the Sociality of Children from Different Socioeconomic Status. [Dissertation]. Changchun: Northeast Normal University; 2019.

55. Goodman R. Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2001;40:1337–1345. doi:10.1097/00004583-200111000-00015

56. Shi BG, Shen JL. The Relationships among family SES, intelligence, intrinsic motivation and creativity (in Chinese). Psychol Dev Educ. 2007;23(30).

57. Carlson SM, Moses LJ, Breton C. How Specific is the Relation between Executive Function and Theory of Mind? Contributions of Inhibitory Control and Working Memory. Infant Child Dev. 2002;11:73–92. doi:10.1002/icd.298

58. Diamond A, Taylor C. Development of an aspect of executive control: development of the abilities to remember what I said and to “do as I say, not as I do”. Dev Psychobiol. 1996;29:315–334. doi:10.1002/(SICI)1098-2302(199605)29:4<315::AID-DEV2>3.0.CO;2-T

59. Hughes C, Ensor R, Wilson A, Graham A. Tracking executive function across the transition to school: a latent variable approach. Dev Neuropsychol. 2010;35:20–36. doi:10.1080/87565640903325691

60. Fang J, Wen ZL, Zhang MQ, Sun PZ. The analyses of multiple mediation effects based on structural equation modeling. J Psychol Sci. 2014;37:735. doi:10.16719/j.cnki.1671-6981.2014.03.001

61. Martarelli CS, Feurer E, Dapp LC, Roebers CM. Profiles of executive functions and social skills in the transition to school: a person-centred approach. Infant Child Dev. 2018;27. doi:10.1002/icd.2114

62. Elliott L. Profiles of academic, cognitive, and behavioral development from kindergarten to third grade. Learn Individ Differ. 2019;70:109–120. doi:10.1016/j.lindif.2019.01.010

63. Crick N, Dodge K. A review and reformulation of social information-processing mechanisms in children’ s social adjustment. Psychol Bull. 1994;115:74–101.

64. Thibodeau-Nielsen RB, Gilpin AT, Nancarrow AF, Pierucci JM, Brown MM. Fantastical pretense’s effects on executive function in a diverse sample of preschoolers. J Appl Dev Psychol. 2020;68:101137. doi:10.1016/j.appdev.2020.101137

65. Zelazo PD, Forston JL, Masten AS, Carlson SM. Mindfulness plus reflection training: effects on executive function in early childhood. Front Psychol. 2018;9(FEB). doi:10.3389/fpsyg.2018.00208

66. Schmidt M, Mavilidi MF, Singh A, Englert C. Combining physical and cognitive training to improve kindergarten children’s executive functions : a cluster randomized controlled trial. Cont Educ Psychol. 2020;63:101908. doi:10.1016/j.cedpsych.2020.101908

67. Merz EC, Landry SH, Johnson UY, Williams JM, Jung K. Effects of a responsiveness-focused intervention in family child care homes on children’s executive function. Early Child Res Q. 2016;34(1):128–139. doi:10.1016/j.ecresq.2015.10.003

68. Taylor RD, Oberle E, Durlak JA, Weissberg RP. Promoting positive youth development through school-based social and emotional learning interventions: a meta-analysis of follow-up effects. Child Dev. 2017;88(4):1156–1171. doi:10.1111/cdev.12864

Creative Commons License © 2024 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.