The list of publications is organized by areas of scientific inquiry:
- Educational Intervention Science
- Fairness and Transparency in Applications of Educational Data Science
- Understanding Online Learner Behavior and Motivation
- Student Choice and Information Ecosystems at Universities
- Instructor Presence in Video Lectures
- Learning Analytics Education
- Social Influence in Networks
Electronic copies of papers are provided as a professional courtesy to ensure timely dissemination of academic work for individual, non-commercial purposes. Copyright resides with the respective copyright holders, as stated within each paper. These files may not be re-posted without permission.
Educational Intervention Science
Kizilcec, R. F., Mimno, J. A., & Karhan, A. J. (2022). Effects of Framing Professional Development as a Career Growth Opportunity on Course Completion. In Proceedings of the ACM Conference on Learning at Scale.
McCarthy, K. S., Crossley, S. A., Meyers, K., Boser, U., Allen, L. K., Chaudhri, V. K., Collins-Thompson, K., D’Mello, S., De Choudhury, M., Garg, K., Goel, A., Gosha, K., Heffernan, N., Hooper, M. A., Hyman, E., Jarratt, D. C., Khalil, D., Kizilcec, R. F., Litman, D., Malatinszky, A., Marks, K., McNamara, D. S., Menko, R., Palermo, C., Porcaro, D., Roscoe, R., Shapiro, S., Khanh-Phoung, T., Trumbore, A. M., White, C., Wong, W., Yang, D., & Zampieri, M. (2022). Toward more effective and equitable learning: Identifying barriers and solutions for the future of online education. Technology, Mind, & Behavior, 3(1).
Cho, J., Li, Y., Armstrong, A., Russ, A., Krasny, M. E., & Kizilcec, R. F. (2021). Using Social Norms to Promote Actions Beyond the Course. In Proceedings of the ACM Conference on Learning at Scale (L@S).
Cho, J., Li, Y., Krasny, M. E., Russ, A., & Kizilcec, R. F. (2021). Online Learning and Social Norms: Evidence from a Cross-Cultural Field Experiment in a Course for a Cause. Computer-based Learning in Context, 3(1), 18-36.
Cho, J. & Kizilcec, R. F. (2021). Applying the Behavior Change Taxonomy from Public Health Interventions to Education Research. In Proceedings of the ACM Conference on Learning at Scale (L@S).
Kizilcec, R. F., Reich, J., Yeomans, M., Dann, C., Brunskill, E., Lopez, D., Turkay, S., Williams, J., & Tingley, D. (2020). Scaling Up Behavioral Science Interventions in Online Education. Proceedings of the National Academy of Sciences (PNAS).
Chirikov, I., Semenova, T. Maloshonok, N., Bettinger, E., Kizilcec, R. F. (2020). Online Education Platforms Scale College STEM Instruction with Equivalent Learning Outcomes at Lower Cost. Science Advances, 6(15).
Kizilcec, R. F., Saltarelli, A. J., Bonfert-Taylor, P., Goudzwaard, M., Hamonic, E., & Sharrock, R. (2020). Welcome to the Course: Early Social Cues Influence Women’s Persistence in Computer Science. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). Honolulu, HI, USA.
Kizilcec, R. F. & Saltarelli, A. J. (2019). Can a diversity statement increase diversity in MOOCs? In Proceedings of the ACM Conference on Learning at Scale (L@S). Chicago, IL, USA.
Kizilcec, R. F. & Saltarelli, A. J. (2019). Psychologically Inclusive Design: Cues impact women’s participation in STEM education. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). Glasgow, Scotland.
Varanasi, R. A., Kizilcec, R. F., Dell, N. (2019) How Teachers in India Reconfigure their Work Practices around a Teacher-Oriented Technology Intervention. Proceedings of the ACM: Human-Computer Interaction.
Davis, D., Kizilcec, R. F., Hauff, C., & Houben, G.-J. (2018). Scaling Effective Learning Strategies: Retrieval Practice and Long-Term Knowledge Retention in MOOCs. Journal of Learning Analytics, 5(3), 21–41.
Davis, D., Kizilcec, R. F., Hauff, C., & Houben, G.-J. (2018). The Half-Life of MOOC Knowledge: A Randomized Trial Evaluating the Testing Effect in MOOCs. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (LAK). Sydney, Australia.
Kizilcec, R. F., Saltarelli, A. J., Reich, J., & Cohen, G. L. (2017). Closing global achievement gaps in MOOCs. Science, 355(6322), 251-252. (Supporting Materials)
r
Kizilcec, R. F. & Cohen, G. L. (2017). Eight-minute self-regulation intervention improves educational attainment at scale in individualist but not collectivist cultures. Proceedings of the National Academy of Sciences (PNAS), 114(17), 4348–4353.
Kizilcec, R. F., Davis, G. M., & Cohen, G. L. (2017). Towards Equal Opportunities in MOOCs: Affirmation Reduces Gender & Social-class Achievement Gaps in China. In Proceedings of the Fourth ACM Conference on Learning at Scale (L@S). Cambridge, MA. (Best Paper Award)
Davis, D., Jivet, I., Kizilcec, R. F., Chen, G., Hauff, C., & Houben, G.-J. (2017). Follow the Successful Crowd: Raising MOOC Completion Rates through Social Comparison at Scale. In Proceedings of the 7th International Conference on Learning Analytics and Knowledge (LAK). Vancouver, Canada.
Kizilcec, R. F. & Brooks, C. (2017). Diverse Big Data and Randomized Field Experiments in MOOCs.In C. Lang, G. Siemens, A. Wise, D. Gašević (Eds.), Handbook of Learning Analytics (pp. 211-222). Society for Learning Analytics Research.
Kizilcec, R. F., Schneider, E., Cohen, G. L., & McFarland, D. A. (2014). Encouraging Forum Participation in Online Courses with Collectivist, Individualist, and Neutral Motivational Framings.eLearning Papers, 37, 13-22. ISSN: 1887-1542.
Fairness and Transparency in Applications of Educational Data Science
Sabnis, S., Yu, R., & Kizilcec, R. F. (2022). Large-Scale Student Data Reveal Sociodemographic Gaps in Procrastination Behavior. In Proceedings of the ACM Conference on Learning at Scale.
Williamson, K. & Kizilcec, R. F. (2022). Review of Learning Analytics Dashboard Research in Higher Education: Implications for Justice, Equity, Diversity, and Inclusion. In Proceedings of the 12th International Conference on Learning Analytics and Knowledge (LAK).
Williamson, K. & Kizilcec, R. F. (2021). Effects of Algorithmic Transparency in Bayesian Knowledge Tracing on Trust and Perceived Accuracy. In Proceedings of the Conference on Educational Data Mining (EDM).
Yu, R., Lee, H., & Kizilcec, R. F. (2021). Should College Dropout Prediction Models Include Protected Attributes? In Proceedings of the ACM Conference on Learning at Scale (L@S).
Kizilcec, R. F. & Lee, H. (forthcoming). Algorithmic Fairness in Education. In W. Holmes & K. Porayska-Pomsta (Eds.), Ethics in Artificial Intelligence in Education, Taylor & Francis.
Lee, H. & Kizilcec, R. F. (2020). Evaluation of Fairness Trade-offs in Predicting Student Success. In Proceedings of the Conference on Educational Data Mining (EDM) Fairness, Accountability, and Transparency in Educational Data (FATED) Workshop.
Kizilcec, R. F. (2016). How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2016. San Jose, CA.
Understanding Online Learner Behavior and Motivation
Cho, J., Li, Y., Krasny, M. E., & Kizilcec, R. F. (2022). Measuring Cultural Dimensions of Learning in Online Courses. In Proceedings of the ACM Conference on Learning at Scale.
Williamson, K. & Kizilcec, R. F. (2022). Large-Scale Analysis of Discussion Networks in College Courses. In Proceedings of the ACM Conference on Learning at Scale.
Alon, L., Sung, S. & Kizilcec, R.F. (2021). How Does Active Learning Change Undergraduate Learning Experiences? A Case of a Large Technology Design Course. In T. Bastiaens (Ed.), Proceedings of Innovate Learning Summit 2021 (pp. 201-208).
Rizvi, S., Rienties, B., Rogaten, J., & Kizilcec, R. F. (2021). Beyond One-Size-Fits-All in MOOCs: Variation in Learning Design and Persistence of Learners in Different Cultural and Socioeconomic Contexts. Computers in Human Behavior, 126, 106973.
Kizilcec, R. F., Chen, M., Jasinska, K., Madaio, M., & Ogan, A. (2021). Mobile Learning During School Disruptions in Sub-Saharan Africa. AERA Open, 7.
Varanasi, R. A., Vashistha, A., Kizilcec, R. F., & Dell, N. (in press) Investigating Technostress Among Teachers in Low-IncomeIndian Schools. In Proceedings of the ACM on Human Computer Interaction.
Cho, J. & Kizilcec, R. F. (2021). Delivery Ghost: Effects of Language Immersion and Interactivity in a Language Learning Game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI).
Kizilcec, R. F., Makridis, C., & Sadowski, K. C. (2021). Pandemic Response Policies’ Democratizing Effects on Online Learning. Proceedings of the National Academy of Sciences (PNAS), 118(11).
Kizilcec, R. F. & Kambhampaty, A. (2020). Identifying course characteristics associated with sociodemographic variation in enrollments across 159 online courses from 20 institutions. PloS one, 15(10), e0239766.
Kizilcec, R. F. & Chen, M. (2020). Student Engagement in Mobile Learning via Text Message. In Proceedings of the ACM Conference on Learning at Scale (L@S). Virtual Event, USA.
Chen, Y. & Kizilcec, R. F. (2020). Examining Sources of Variation in Student Confusion in College Classes. In Proceedings of the ACM Conference on Learning at Scale (L@S). Virtual Event, USA.
Rizvi, S., Rienties, B., Rogaten, J., Kizilcec, R. F. (2019). Investigating Variation in Learning Processes in a FutureLearn MOOC. Journal of Computing in Higher Education.
Kizilcec, R. F. & Goldfarb, D. (2019). Growth Mindset Predicts Student Achievement and Behavior in Mobile Learning. In Proceedings of the ACM Conference on Learning at Scale (L@S). Chicago, IL, USA.
Maldonado-Mahauad, J., Pérez-Sanagustín, M., Kizilcec, R. F., Morales, N., & Munoz-Gama, J. (2018). Mining theory-based patterns from Big data: Identifying self-regulated learning strategies in Massive Open Online Courses. Computers in Human Behavior, 80, 179-196.
Kizilcec, R. F., Perez-Sanagustin, M., & Maldonado, J. J. (2017). Self-Regulated Learning Strategies Predict Learner Behavior and Goal Attainment in Massive Open Online Courses. Computers & Education, 104, 19-33.
Kizilcec, R. F., Perez-Sanagustin, M., & Maldonado, J. J. (2016). Recommending Self-Regulated Learning Strategies Does Not Improve Performance in a MOOC. In Proceedings of the Third ACM Conference on Learning at Scale, L@S 2016. Edinburgh, UK.
Kizilcec, R. F. & Schneider, E. (2015). Motivation as a Lens to Understand Online Learners. ACM Transactions on Computer-Human Interaction (TOCHI), 22(2).
Kizilcec, R. F., & Halawa, S. A. (2015). Attrition and Achievement Gaps in Online Learning. In Proceedings of the Second ACM Conference on Learning at Scale, L@S 2015. Vancouver, Canada.
Kizilcec, R. F., Piech, C., & Schneider, E. (2013). Deconstructing Disengagement: Analyzing Learner Subpopulations in Massive Open Online Courses. In Proceedings of the Third International Conference on Learning Analytics and Knowledge, LAK 2013. Leuven, Belgium. | Recording of conference talk.
Kizilcec, R. F. (2013). Collaborative Learning in Geographically Distributed and In-person Groups.Proceedings of the 16th International Conference on Artificial Intelligence in Education, AIED 2013. Memphis, TN.
Thille, C., Schneider, D. E., Kizilcec, R. F., Piech, C., Halawa, S. A., & Greene, D. K. (2014). The Future of Data–Enriched Assessment. Research & Practice in Assessment, 9(2), 5-16.
Student Choice and Information Ecosystems at Universities
Chen, Y., Fu, A., Lee, J., Wilkie Tomaski, I., & Kizilcec, R. F. (2022). Pathways: Exploring Academic Interests with Historical Course Enrollment Records. In Proceedings of the ACM Conference on Learning at Scale.
Williamson, K. & Kizilcec, R. F. (2022). Review of Learning Analytics Dashboard Research in Higher Education: Implications for Justice, Equity, Diversity, and Inclusion. In Proceedings of the 12th International Conference on Learning Analytics and Knowledge (LAK).
Williamson, K. & Kizilcec, R. F. (2021). Learning Analytics Dashboard Research Has Neglected Diversity, Equity, and Inclusion. In Proceedings of the ACM Conference on Learning at Scale (L@S).
Chaturapruek, S., Dalberg, T., Thompson, M. E., Giebel, S., Harrison, M., Johari, R., Stevens, M. L., & Kizilcec, R. F. (2021). Studying Undergraduate Course Consideration at Scale. AERA Open, 7.
Chaturapruek, S., Dee, T. S., Johari, R., Kizilcec, R. F., & Stevens, M. L. (2018). How a data-driven course planning tool affects college students’ GPA: Evidence from two field experiments. In Proceedings of the Fifth ACM Conference on Learning at Scale (L@S). London, UK. (Best Paper Award)
Instructor Presence in Video Lectures
Li, J., Kizilcec, R. F., Bailenson, J. N., & Ju, W. (2016). Social Robots and Virtual Agents as Lecturers for Video Instruction. Computers in Human Behavior, 55(B), 1222-1230.
Kizilcec, R. F., Bailenson, J. N., & Gomez, C. J. (2015). The Instructor’s Face in Video Instruction: Evidence from Two Large-Scale Field Studies. Journal of Educational Psychology, 107(3), 724-739.
Kizilcec, R. F., Papadopoulos, K., & Sritanyaratana, L. (2014). Showing Face in Video Instruction: Effects on Information Retention, Visual Attention, and Affect. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2014. Toronto, Canada.
Learning Analytics Education
Kizilcec, R. F. & Davis, D. (to appear). Learning Analyitcs Education: A case study, review of current programs, and recommendations for instructors. In Olga Viberg and Åke Grönlund (Eds.). Practicable Learning Analytics. Springer Nature.
Social Influence in Networks
Williams-Ceci, S., Grose, G. E., Pinch, A. C., Kizilcec, R. F., & Lewis, N. A. (2021). Combatting sharenting: Interventions to alter parents’ attitudes towards posting about their children online. Computers in Human Behavior.
Kizilcec, R. F., Bakshy, E., Eckles, D., & Burke, M. (2018). Social Influence and Reciprocity in Online Gift Giving. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). Montreal, Canada.
Eckles, D., Kizilcec, R. F., & Bakshy, E. (2016). Estimating peer effects in networks with peer encouragement designs. Proceedings of the National Academy of Sciences (PNAS), 113(27), 7316-7322. (Supporting Information)
Zhang, K. & Kizilcec, R. F. (2014). Anonymity in Social Media: Effects of Content Controversiality and Social Endorsement on Sharing Behavior. In Proceedings of the 8th International Conference on Weblogs and Social Media, ICWSM 2014. Ann Arbor, MI.