Juho Leinonen

All Stories

1. 
   From Prompts to Propositions: A Logic-Based Lens on Student-LLM Interactions

   Article • November 2025, ACM (Association for Computing Machinery)

   Juho Leinonen

2. 
   Prompts First, Precision Later: Reviving the Vision of Natural Language Programming for Computing Education

   Article • November 2025, ACM (Association for Computing Machinery)

   Juho Leinonen

3. 
   Adaptive Learning Curve Analytics with LLM-KC Identifiers for Knowledge Component Refinement

   Article • September 2025, ACM (Association for Computing Machinery)

   Juho Leinonen

4. 
   Howzat? Appealing to Expert Judgement for Evaluating Human and AI Next-Step Hints for Novice Programmers

   Article • Digital Threats Research and Practice, July 2025, ACM (Association for Computing Machinery)

   Juho Leinonen

5. 
   Koli Calling: Call for Participation

   Article • ACM SIGCSE Bulletin, July 2025, ACM (Association for Computing Machinery)

   Juho Leinonen

6. 
   The Role of Generative AI in Software Student CollaborAItion

   Article • June 2025, ACM (Association for Computing Machinery)

   Dr. Natalie Kiesler, Juho Leinonen

7. 
   Probing the Unknown: Exploring Student Interactions with Probeable Problems at Scale in Introductory Programming

   Article • June 2025, ACM (Association for Computing Machinery)

   Juho Leinonen

8. 
   Fostering Responsible AI Use Through Negative Expertise: A Contextualized Autocompletion Quiz

   Article • June 2025, ACM (Association for Computing Machinery)

   Juho Leinonen, Rahad Arman Nabid

9. 
   Exploring Iterative Enhancement for Improving Learnersourced Multiple-Choice Question Explanations with Large Language Models

   Article • Proceedings of the AAAI Conference on Artificial Intelligence, April 2025, Association for the Advancement of Artificial Intelligence (AAAI)

   Juho Leinonen

10. 
    Koli Calling 2025: Call for Submissions

    Article • ACM SIGCSE Bulletin, April 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

11. 
    Using Generative AI to Scaffold the Teaching of Software Engineering Team Skills

    Article • February 2025, ACM (Association for Computing Machinery)

    Dr José Antonio Parejo Maestre, Juho Leinonen

12. 
    Evaluating Language Models for Generating and Judging Programming Feedback

    Article • February 2025, ACM (Association for Computing Machinery)

    Charles Koutcheme, Syed Ashraf, Juho Leinonen

13. 
    Exploring Student Reactions to LLM-Generated Feedback on Explain in Plain English Problems

    Article • February 2025, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

14. 
    Breaking the Programming Language Barrier: Multilingual Prompting to Empower Non-Native English Learners

    Article • February 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

15. 
    LLM-itation is the Sincerest Form of Data: Generating Synthetic Buggy Code Submissions for Computing Education

    Article • February 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

16. 
    On the Opportunities of Large Language Models for Programming Process Data

    Article • February 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

17. 
    Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools

    Article • January 2025, ACM (Association for Computing Machinery)

    Sam Lau, Dr. Natalie Kiesler, Juho Leinonen

18. 
    Koli Calling 2024 Conference Recap

    Article • ACM SIGCSE Bulletin, January 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

19. 
    Integrating Natural Language Prompting Tasks in Introductory Programming Courses

    Article • December 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

20. 
    Experiences from Integrating Large Language Model Chatbots into the Classroom

    Article • December 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

21. 
    Synthetic Students: A Comparative Study of Bug Distribution Between Large Language Models and Computing Students

    Article • December 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

22. 
    "Sometimes You Just Gotta Risk It for the Biscuit": A Portrait of Student Risk-Taking

    Article • December 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

23. 
    2024 Working Group Reports on 1st ACM Virtual Global Computing Education Conference

    Article • December 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

24. 
    Post Primary Teachers' Perspectives on Machine Learning and Artificial Intelligence in the Leaving Certificate Computer Science Curriculum

    Article • November 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

25. 
    GenAI in education: the first step towards personalization

    Article • August 2024, ACM (Association for Computing Machinery)

    Juho Leinonen, Evanfiya Logacheva

26. 
    The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmers

    Article • August 2024, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

27. 
    How Instructors Incorporate Generative AI into Teaching Computing

    Article • July 2024, ACM (Association for Computing Machinery)

    Sam Lau, Juho Leinonen, Dr. Natalie Kiesler

28. 
    Analyzing Students' Preferences for LLM-Generated Analogies

    Article • July 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

29. 
    Explaining Code with a Purpose: An Integrated Approach for Developing Code Comprehension and Prompting Skills

    Article • July 2024, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

30. 
    Self-Regulation, Self-Efficacy, and Fear of Failure Interactions with How Novices Use LLMs to Solve Programming Problems

    Article • July 2024, ACM (Association for Computing Machinery)

    Lauren Margulieux, Brett A Becker, Juho Leinonen

31. 
    Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge

    Article • July 2024, ACM (Association for Computing Machinery)

    Charles Koutcheme, Juho Leinonen

32. 
    "Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students Using Large Language Models

    Article • July 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

33. 
    Koli Calling 2024: Call for Participation

    Article • ACM SIGCSE Bulletin, July 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

34. 
    On the comprehensibility of functional decomposition: An empirical study

    Article • April 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

35. 
    Koli Calling 2024: Call for Submissions

    Article • ACM SIGCSE Bulletin, April 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

36. 
    Using Large Language Models for Teaching Computing

    Article • March 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

37. 
    Discussing the Changing Landscape of Generative AI in Computing Education

    Article • March 2024, ACM (Association for Computing Machinery)

    Dr. Natalie Kiesler, Brett A Becker, Juho Leinonen

38. 
    AI in Computing Education from Research to Practice

    Article • March 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

39. 
    Detecting ChatGPT-Generated Code Submissions in a CS1 Course Using Machine Learning Models

    Article • March 2024, ACM (Association for Computing Machinery)

    Muntasir Hoq, Juho Leinonen

40. 
    Instructor Perceptions of AI Code Generation Tools - A Multi-Institutional Interview Study

    Article • March 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

41. 
    Solving Proof Block Problems Using Large Language Models

    Article • March 2024, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

42. 
    Prompt Problems: A New Programming Exercise for the Generative AI Era

    Article • March 2024, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

43. 
    Evaluating LLM-generated Worked Examples in an Introductory Programming Course

    Article • January 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

44. 
    Decoding Logic Errors: A Comparative Study on Bug Detection by Students and Large Language Models

    Article • January 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

45. 
    Computing Education in the Era of Generative AI

    Article • Communications of the ACM, January 2024, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

46. 
    Detecting Learning Behaviour in Programming Assignments by Analysing Versioned Repositories

    Article • IEEE Access, January 2024, Institute of Electrical & Electronics Engineers (IEEE)

    Valerio Terragni, Juho Leinonen

47. 
    The Robots Are Here: Navigating the Generative AI Revolution in Computing Education

    Article • December 2023, ACM (Association for Computing Machinery)

    Brett A Becker, Dr. Natalie Kiesler, Juho Leinonen

48. 
    Understanding Student Evaluation of Teaching in Computer Science Courses

    Article • December 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

49. 
    Leveraging Large Language Models for Analysis of Student Course Feedback

    Article • December 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

50. 
    The Forum Factor: Exploring the Link between Online Discourse and Student Achievement in Higher Education

    Article • December 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

51. 
    Could ChatGPT Be Used for Reviewing Learnersourced Exercises?

    Article • November 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

52. 
    Exploring the Interplay of Achievement Goals, Self-Efficacy, Prior Experience and Course Achievement

    Article • September 2023, ACM (Association for Computing Machinery)

    Hannu Pesonen, Juho Leinonen

53. 
    “It’s Weird That it Knows What I Want”: Usability and Interactions with Copilot for Novice Programmers

    Article • ACM Transactions on Computer-Human Interaction, August 2023, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

54. 
    Evaluating Distance Measures for Program Repair

    Article • August 2023, ACM (Association for Computing Machinery)

    Charles Koutcheme, Juho Leinonen

55. 
    Exploring the Responses of Large Language Models to Beginner Programmers’ Help Requests

    Article • August 2023, ACM (Association for Computing Machinery)

    Charles Koutcheme, Juho Leinonen

56. 
    Transformed by Transformers: Navigating the AI Coding Revolution for Computing Education: An ITiCSE Working Group Conducted by Humans

    Article • June 2023, ACM (Association for Computing Machinery)

    Dr. Natalie Kiesler, Brett A Becker, Juho Leinonen, Jaromir Savelka

57. 
    Evaluating the Performance of Code Generation Models for Solving Parsons Problems With Small Prompt Variations

    Article • June 2023, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

58. 
    Chat Overflow: Artificially Intelligent Models for Computing Education - renAIssance or apocAIypse?

    Article • June 2023, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

59. 
    Comparing Code Explanations Created by Students and Large Language Models

    Article • June 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

60. 
    Seeing Program Output Improves Novice Learning Gains

    Article • June 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

61. 
    Factors Affecting Compilable State at Each Keystroke in CS1

    Article • May 2023, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

62. 
    Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

63. 
    G is for Generalisation

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

64. 
    Using Large Language Models to Enhance Programming Error Messages

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen, Brett A Becker

65. 
    Automatically Generating CS Learning Materials with Large Language Models

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

66. 
    Computing Education Postdocs and Beyond

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

67. 
    The Implications of Large Language Models for CS Teachers and Students

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen, Brett A Becker

68. 
    Automated Questionnaires About Students’ JavaScript Programs: Towards Gauging Novice Programming Processes

    Article • January 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

69. 
    Experiences from Learnersourcing SQL Exercises: Do They Cover Course Topics and Do Students Use Them?

    Article • January 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

70. 
    Lessons Learned From Four Computing Education Crowdsourcing Systems

    Article • IEEE Access, January 2023, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

71. 
    Facilitating API lookup for novices learning data wrangling using thumbnail graphics

    Article • Foundations of Data Science, January 2023, American Institute of Mathematical Sciences (AIMS)

    Juho Leinonen

72. 
    Automated Program Repair Using Generative Models for Code Infilling

    Article • January 2023, Springer Science + Business Media

    Juho Leinonen

73. 
    Parsons Problems and Beyond

    Article • December 2022, ACM (Association for Computing Machinery)

    Rodrigo Duran, Assoc. Professor, Academic General Faculty Briana Baker Morrison, Juho Leinonen

74. 
    Finding Significant p in Coffee or Tea: Mildly Distasteful

    Article • November 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

75. 
    Experiences With and Lessons Learned on Deadlines and Submission Behavior

    Article • November 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

76. 
    Trends From Computing Education Research Conferences: Increasing Submissions and Decreasing Acceptance Rates

    Article • November 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

77. 
    Piloting Natural Language Generation for Personalized Progress Feedback

    Article • October 2022, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

78. 
    Speeding Up Automated Assessment of Programming Exercises

    Article • September 2022, ACM (Association for Computing Machinery)

    Charles Koutcheme, Juho Leinonen

79. 
    Automatic Generation of Programming Exercises and Code Explanations Using Large Language Models

    Article • August 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

80. 
    Planning a Multi-institutional and Multi-national Study of the Effectiveness of Parsons Problems

    Article • July 2022, ACM (Association for Computing Machinery)

    Rodrigo Duran, Juho Leinonen, Assoc. Professor, Academic General Faculty Briana Baker Morrison

81. 
    Can Students Review Their Peers?

    Article • July 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

82. 
    Who Continues in a Series of Lifelong Learning Courses?

    Article • July 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

83. 
    Digital Education For All: Multi-University Study of Increasing Competent Student Admissions at Scale

    Article • June 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

84. 
    Seeking flow from fine-grained log data

    Article • May 2022, ACM (Association for Computing Machinery)

    Benjamin Cowley, Juho Leinonen

85. 
    Time-on-task metrics for predicting performance

    Article • ACM Inroads, May 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

86. 
    Pausing While Programming: Insights From Keystroke Analysis

    Article • May 2022, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

87. 
    Seeking Flow from Fine-Grained Log Data

    Article • May 2022, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

88. 
    A Comparison of Immediate and Scheduled Feedback in Introductory Programming Projects

    Article • February 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

89. 
    Time-on-Task Metrics for Predicting Performance

    Article • February 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

90. 
    CodeProcess Charts: Visualizing the Process of Writing Code

    Article • February 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

91. 
    Methodological Considerations for Predicting At-risk Students

    Article • February 2022, ACM (Association for Computing Machinery)

    Charles Koutcheme, Juho Leinonen

92. 
    Visual recipes for slicing and dicing data: teaching data wrangling using subgoal graphics

    Article • November 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

93. 
    Persistence of Time Management Behavior of Students and Its Relationship with Performance in Software Projects

    Article • August 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

94. 
    Digital Education For All: Better Students Through Open Doors?

    Article • June 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

95. 
    Does the Early Bird Catch the Worm? Earliness of Students' Work and its Relationship with Course Outcomes

    Article • June 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

96. 
    Morning or Evening? An Examination of Circadian Rhythms of CS1 Students

    Article • May 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

97. 
    Exploring Personalization of Gamification in an Introductory Programming Course

    Article • March 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

98. 
    Promoting Early Engagement with Programming Assignments Using Scheduled Automated Feedback

    Article • February 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

99. 
    Exploring the Effects of Contextualized Problem Descriptions on Problem Solving

    Article • February 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

100. 
     Koli Calling '20: Proceedings of the 20th Koli Calling International Conference on Computing Education Research

     Article • November 2020, ACM (Association for Computing Machinery)

     Juho Leinonen

101. 
     Students’ Preferences Between Traditional and Video Lectures: Profiles and Study Success

     Article • November 2020, ACM (Association for Computing Machinery)

     Juho Leinonen

102. 
     Programming Versus Natural Language

     Article • August 2020, ACM (Association for Computing Machinery)

     Juho Leinonen

103. 
     Choosing Code Segments to Exclude from Code Similarity Detection

     Article • June 2020, ACM (Association for Computing Machinery)

     Juho Leinonen

104. 
     Selection of Code Segments for Exclusion from Code Similarity Detection

     Article • June 2020, ACM (Association for Computing Machinery)

     Juho Leinonen

105. 
     Crowdsourcing Content Creation for SQL Practice

     Article • June 2020, ACM (Association for Computing Machinery)

     Juho Leinonen

106. 
     A Study of Keystroke Data in Two Contexts

     Article • February 2020, ACM (Association for Computing Machinery)

     Juho Leinonen

107. 
     Comparing Pass Rates in Introductory Programming and in other STEM Disciplines

     Article • December 2019, ACM (Association for Computing Machinery)

     Juho Leinonen, Vangel Ajanovski

108. 
     Admitting Students through an Open Online Course in Programming

     Article • July 2019, ACM (Association for Computing Machinery)

     Juho Leinonen

109. 
     Non-restricted Access to Model Solutions

     Article • July 2019, ACM (Association for Computing Machinery)

     Juho Leinonen

110. 
     Pass Rates in STEM Disciplines Including Computing

     Article • July 2019, ACM (Association for Computing Machinery)

     Juho Leinonen, Vangel Ajanovski

111. 
     Does Creating Programming Assignments with Tests Lead to Improved Performance in Writing Unit Tests?

     Article • May 2019, ACM (Association for Computing Machinery)

     Juho Leinonen

112. 
     Exploring the Applicability of Simple Syntax Writing Practice for Learning Programming

     Article • February 2019, ACM (Association for Computing Machinery)

     Juho Leinonen

113. 
     Experimenting with Model Solutions as a Support Mechanism

     Article • January 2019, ACM (Association for Computing Machinery)

     Juho Leinonen

114. 
     Analysis of Students' Peer Reviews to Crowdsourced Programming Assignments

     Article • November 2018, ACM (Association for Computing Machinery)

     Juho Leinonen

115. 
     Crowdsourcing programming assignments with CrowdSorcerer

     Article • July 2018, ACM (Association for Computing Machinery)

     Juho Leinonen

116. 
     Predicting academic performance: a systematic literature review

     Article • July 2018, ACM (Association for Computing Machinery)

     Juho Leinonen, Vangel Ajanovski

117. 
     Taxonomizing features and methods for identifying at-risk students in computing courses

     Article • July 2018, ACM (Association for Computing Machinery)

     Juho Leinonen, Vangel Ajanovski

118. 
     A Study of Pair Programming Enjoyment and Attendance using Study Motivation and Strategy Metrics

     Article • February 2018, ACM (Association for Computing Machinery)

     Juho Leinonen

119. 
     Supporting Self-Regulated Learning with Visualizations in Online Learning Environments

     Article • February 2018, ACM (Association for Computing Machinery)

     Juho Leinonen

120. 
     Identification based on typing patterns between programming and free text

     Article • November 2017, ACM (Association for Computing Machinery)

     Juho Leinonen

121. 
     Thought crimes and profanities whilst programming

     Article • November 2017, ACM (Association for Computing Machinery)

     Juho Leinonen

122. 
     Predicting Academic Success Based on Learning Material Usage

     Article • September 2017, ACM (Association for Computing Machinery)

     Juho Leinonen

123. 
     Comparison of Time Metrics in Programming

     Article • August 2017, ACM (Association for Computing Machinery)

     Juho Leinonen

124. 
     Student Modeling Based on Fine-Grained Programming Process Snapshots

     Article • August 2017, ACM (Association for Computing Machinery)

     Juho Leinonen

125. 
     Plagiarism in Take-home Exams

     Article • June 2017, ACM (Association for Computing Machinery)

     Juho Leinonen

126. 
     Using and Collecting Fine-Grained Usage Data to Improve Online Learning Materials

     Article • May 2017, Institute of Electrical & Electronics Engineers (IEEE)

     Juho Leinonen

127. 
     Preventing Keystroke Based Identification in Open Data Sets

     Article • April 2017, ACM (Association for Computing Machinery)

     Juho Leinonen

128. 
     Adolescent and Adult Student Attitudes Towards Progress Visualizations

     Article • January 2017, Springer Science + Business Media

     Juho Leinonen

129. 
     Tracking Students' Internet Browsing in a Machine Exam

     Article • January 2017, ACM (Association for Computing Machinery)

     Juho Leinonen

130. 
     Performance and Consistency in Learning to Program

     Article • January 2017, ACM (Association for Computing Machinery)

     Juho Leinonen

131. 
     SHORT PAUSES WHILE STUDYING CONSIDERED HARMFUL

     Article • July 2016, IATED Academy, S.L.

     Juho Leinonen

132. 
     Automatic Inference of Programming Performance and Experience from Typing Patterns

     Article • February 2016, ACM (Association for Computing Machinery)

     Juho Leinonen, Juho Leinonen

133. 
     Pauses and spacing in learning to program

     Article • January 2016, ACM (Association for Computing Machinery)

     Juho Leinonen

134. 
     Typing Patterns and Authentication in Practical Programming Exams

     Article • January 2016, ACM (Association for Computing Machinery)

     Juho Leinonen

135. 
     Identification of programmers from typing patterns

     Article • January 2015, ACM (Association for Computing Machinery)

     Juho Leinonen