High School in Quezon City Maxine Joyce T. Pinson Arsenio Sze - - PowerPoint PPT Presentation

A Construct Validation of the Kilos at Kalooban ng Mag-aaral (KKM) in a Public High School in Quezon City

Maxine Joyce T. Pinson Arsenio Sze Alianan, Jr.

Kilos at Kalooban ng Mag-aaral

• Developed to measure factors that would

hinder students’ performance

• Test development: etic and emic approaches
• Two validity scales and 8 problem scales
• Six subscales patterned after the syndrome

scales of the Youth Self Report (YSR; Achenbach &

Rescorla, 2001)

KKM YSR Nerbyos (NB) Anxiety Kalungkutan (KL) Depression Paglabag sa Panuntunan (PN) Rule-breaking Behaviors Marahas na Kilos (MK) Aggressive Behaviors Problema sa Pag-iisip (PI) Thought Problems Problema sa Pag-pokus (PO) Attention Problems Di-wastong Pag-kain (PK)

• Kalagayan ng Tahanan (KT)
• Di-pangkaraniwang Sagot

(K1)

• Pagpapakitang-tao (K2)

Internalizing Behaviors

Nerbyos (NB)

• 6 items
• Feelings, thoughts, and behavioral manifestations that are

experienced as a result of anxiety Kalungkutan (KL)

• 9 items
• Feeling sad, crying, loss of hope, and thoughts of suicide

and self-harm

Externalizing Behaviors

Paglabag sa Panuntunan (PN)

• 12 items
• Behaviors that are prohibited in school (tardiness, truancy

and absenteeism, cheating, smoking, drinking alcohol, using illicit drugs, vandalism, gambling, theft) Marahas na Kilos (MK)

• 11 items
• Intentionally inflicting physical and emotional harm on
• thers; giving threats and retaliating

Executive Function Scales Problema sa Pag-iisip (PI)

• 14 items
• Seen in people who may be experiencing

psychosis (hearing voices, seeing things or people that others cannot hear and/or see, lethargy, confused states, display of strange behaviors)

Executive Function Scales Problema sa Pag-pokus (PO)

• 12 items
• Inability to stay still, listen to teachers, and finish

schoolwork; acknowledgement of rowdy behaviors and attitude of indifference to teachers as well as to one’s studies

External Factors

Di-wastong Pag-kain (PK)

• 11 items
• The acknowledgement of insufficient, untimely, and

unhealthy food consumption. This also includes the youth's perception of his/her health Kalagayan ng Tahanan (KT)

• 10 items
• A complete and peaceful home environment;

acknowledgement of the help and support provided by the parents in the students’ education

Aim of the Study

Test the latent structure of the constructs measured by the KKM

Sample

• 821 students (52% males)
• Age: 12 to 22 years (M=14, SD=1.60)

Freshmen N = 234 (28%) Sophomores N= 240 (29%) Juniors N = 168 (21%) Seniors N = 179 (22%)

Measure

Kilos at Kalooban ng Mag-aaral (KKM)

• 99 items, self-report
• 4-point Likert scale
• (0=hindi nangyayari; 3=palagi)

NB α = .69 PI α = .76 K1 α = .71 KL α = .80 PO α = .78 K2 α = .72 PN α = .71 PK α = .76 MK α = .80 KT α = .78

Data Analysis

Confirmatory Factor Analysis (CFA)

• Mplus 6.12
• Maximum likelihood with robust standard

errors (MLR)

χ2 Test of Model Fit p ≥ .05 RMSEA ≤ .08 CFI ≥ .90 SRMR < .08

CFA Results

Internalizing Behaviors (NB, KL) χ2 (89) = 267.72, p < .05  RMSEA = 0.05  CFI = 0.91  SRMR = 0.04  Factor covariance = .65 Factor loading = .33 to .69

CFA Results

Externalizing Behaviors (PN, MK) χ2 (229) = 672.97, p < .01  RMSEA = 0.05  CFI = 0.78  SRMR = 0.06  Model modifications:

• Added 5 error covariances
• Deleted items 6 (PN), 18 (MK), 27 (PN)

CFA Results

Externalizing Behaviors (PN, MK) χ2 (164) = 318.46, p < .05  RMSEA = 0.03  CFI = 0.90  SRMR = 0.05  Reliability coefficients: PN α = .68 MK α = .80 Factor covariance = .66 Factor loading = .33 to .67

CFA Results

Executive Function Scales (PI, PO) χ2 (298) = 804.53, p < .05  RMSEA = 0.05  CFI = 0.81  SRMR = 0.05  Model modifications:

• Added 4 error covariances

CFA Results

Executive Function Scales (PI, PO)

χ2 (294) = 569.46, p < .05  RMSEA = 0.03  CFI = 0.90  SRMR = 0.05 

Reliability coefficients: PI α = .76 PO α = .78

Factor covariance: .51 Factor loading = .30 to .64

CFA Results

External Factors (PK, KT) χ2 (188) = 1564.30, p < .05  RMSEA = 0.09  CFI = 0.61  SRMR = 0.09  Model modifications:

• Added 3 error covariances
• Deleted items 23, 33, 42, 51 (PK)

CFA Results

External Factors (PK, KT)

χ2 (115) = 244.71, p < .05  RMSEA = 0.04  CFI = 0.95  SRMR = 0.05 

Reliability coefficients: PK α = .78 KT α = .78

Factor covariance: -.29 Factor loading = .27 to .75

In Summary

• Model specifications were done to achieve

adequate to good model fit

• Significant parameter estimates for each factor

the items were designed to measure

• Items had zero loadings on other factors

Discussion

• Results provide initial evidence of the construct

validity of the KKM

• Highlights construct-related evidence of the 4-

factor structure of the KKM

– Internalizing Behaviors – Externalizing Behaviors – Executive Functions – External Factors

Significance & Implications

• Evidence for a new locally made tool for

adolescents

• Practical Implications in the use of the measure

−Community mental health −Education and social work −Outcome studies and program evaluation −Research on Filipino Adolescents

Limitations and Future Directions

• Sampling method
• Self-report
• Error covariances
• Use a more diverse and representative sample
• Gather data from multiple informants
• Item-weighting for items with error covariances
• Establish cut-off scores for the 2 validity scales
• Other evidences of validity: criterion-related

evidence and predictive validity

Thank you.