September 2017, The Concept of Validity: UBC as a Center of Research Excellence in Validity Theory & Validation Methods

Time: 1-2pm, September 21, 2017 (Thursday)
Location: Scarfe Room 2415
Speaker: Dr. Bruno Zumbo (Professor, ECPS, Faculty of Education)

Dr. Bruno Zumbo will provide an overview of his recent developments in the concept of validity in assessment and measurement with an eye toward highlighting UBC’s evolving role as a center of excellence in validity theory and validation methods. His talk will end with a proposal for a year-long series of lectures on what’s happening at UBC in validity and validation.

 

October 2017, Research Talks on Measurement Invariance

Time: 11am-12pm, October 12, 2017 (Thursday)
Location: Scarfe Library Block Room 278
Moderator: Ben Hives (M.Sc. student, School of Kinesiology)
Speakers:
Scott Emerson (M.Sc. student, School of Population and Public Health)
Danjie Zou (Ph.D. student, MERM, Faculty of Education)

When researchers are working on assessments, tests, or questionnaires, they want to ensure that comparisons are meaningful. Hence, it is essential for researchers to investigate measurement invariance issue. We will discuss measurement invariance related issues from different perspectives and in different contexts in the coming event.

Cross-cultural Invariance of the Satisfaction with Life Scale Adapted for Children (Scott Emerson)
Different Types of Grouping Variables in Light of the Attributional Stance for Bias and Impact Detection (Danjie Zou)

November 2017, Research Talk

Time: 11am-12:10pm, November 9, 2017 (Thursday)
Location: Scarfe Library Block Room 278
Moderator: Dr. Amery Wu (Assistant Professor, MERM, ECPS)
Speakers:  Dr. Sterett Mercer (Associate Professor, School Psychology, ECPS)

Dr. Mercer’s talk is based on two of his papers. One of his papers is attached here and his PowerPoint presentation is attached here. He will discuss a variety of analytical and psychometric issues:

  • Introduce curriculum-based measurement (CBM) as a framework for identifying and monitoring progress for students at-risk for academic difficulties;
  • Present findings based on generalizability theory to discuss challenges in writing assessment, namely the number of writing samples needed for reliable estimates of student skill level and skill growth.
  • Present recent work using automated text evaluation within an applied predictive modeling (machine learning) framework that has the potential to improve reliability and validity of written expression CBM, while also greatly improving its feasibility for use by teachers

January 2018, Open Science: Open Resources & Communication

Time: 11am-12:30pm, January 19, 2018 (Friday)
Location: Scarfe Room 2415
Moderator: Dr. Yan Liu (Assistant Professor, MERM, ECPS)
Penal Discussion Speakers:
Ben Hives (M.Sc. student, School of Kinesiology)
Geri Ruissen (PhD student, School of Kinesiology)
Scott Lapinski (Scholarly Communication & Research Librarian, Countway Library of Medicine, Harvard University)

Highlights: In this event, we will discuss the most updated practices of open science, including open resources, open access and open communication across research fields. Scott Lapinski will also talk about the current open science initiatives at Harvard University.

Reference:
Wasserstein, R. L., & Lazar, N. A. (2016). The ASA’s Statement on p-Values: Context, Process, and Purpose. The American Statistician, 70(2), 129–133. http://doi.org/10.1080/00031305.2016.1154108

February 2018, Research Talks

Time: 11am-12pm, February 15, 2018 (Thursday)
Location: Scarfe Room 2415
Moderator: Nathan Roberson (Ph. D. candidate, MERM program, UBC)
Speakers:
Ashley Pullman (Postdoctoral Fellow, Education Policy Research Initiative at the University of Ottawa)
Michelle Chen (Psychometrician, Paragon Testing Enterprises)
Joanna Zeng (PhD Student, Department of Language and Literacy Education, UBC)

A latent profile analysis approach to understanding science and technology attitudes in China, Japan, South Korea and the United States 
By Ashley Pullman and Michelle Chen
Abstract: The following presentation will provide an overview of a latent profile/class analysis approach to studying science and technology attitudes across four top countries on the Bloomberg’s 2015 list of high-tech centralization, including the United States, China, South Korea and Japan. Alongside describing the methodology and World Values Survey data, the main research findings will be presented.

The first language phonological interference and second language phonological mediation in bilingual visual word recognition
By Joanna Zeng
Abstract: This study explored the effects of the first language phonology on second language visual word recognition via a mixed design ANOVA approach. The study found that first language phonology phonological interference and second language phonological mediation were involved in bilingual visual word recognition.

March 2018, Power Analysis Workshop

Time: 10am-12pm, Thursday, March 22, 2018
Location: Education Library Block Room 278
Presenters:
Ryan Ji (Ph. D. student, MERM program, UBC)
Ben Hives (M.Sc. student, School of Kinesiology)

Outline of the workshop:
Power Analysis is used to determine an adequate sample size needed to detect a given effect size for a planned study. It can also be used to determine the power, given an effect size and a sample size.

In this workshop, we will approach power analysis conceptually other than mathematically, then we will provide demonstrations via GPower for t-test (independent samples and paired samples), ANOVA, Repeated-Measures ANOVA, Mixed-Design ANOVA, and Multiple Linear Regression. Finally, we will discuss the difference between prospective power analysis and retrospective power analysis, and why the retrospective power analysis should be avoided.

Download the Power Analysis Workshop presentation