Analyzing Online Protocols to Characterize
Novice Java Programmers
Maria Mercedes T. Rodrigo1,*, Emily Tabanaoc, Ma. Beatriz E. Lahoz1, and Matthew C. Jadud2
1Department of Information Systems and Computer Science
Ateneo de Manila University, Loyola Heights, Quezon City, Philippines
2Department of Computer Science, Allegheny College, Meadville, PA
*This email address is being protected from spambots. You need JavaScript enabled to view it.
Flowchart showing the EQ calculation process.
ABSTRACT
Computer science educators are concerned and disappointed over students’ lack of programming comprehension. This concern has motivated investigations into areas that programming students do not understand, in an effort to provide students with the foundation they need in order to produce correct software. In this study, we built and used several tools to study the behavior of novice programmers—what edits they make, when they compile their programs, and how they respond to errors. The characterization enables computer science educators to identify at-risk students and determine specific interventions. These tools include summarization of student compilation errors, computation of time between compilations, computation of Error Quotients, and a browser that enables educators to view successive compilations. This paper describes how these tools are used and what implications educators can infer from the data that they present....
REFERENCES
BAKER RS, CORBETT AT, KOEDINGER KR. 2004. Lectures Notes in Computer Science. In: Intelligent Tutoring. Germany: Springer Berlin/Heidelberg. p. 531-540.
CHMIEL R, LOUI MC. 2004. Debugging: from novice to expert. In: SIGCSE ’04. Proceedings of the 35th SIGCSE Technical Symposium; 1-3 March 2004; Norfolk, Virginia, USA: Special Interest Group on Computer Science Education (SIGCSE). p. 17-21.
FITZGERALD S, SIMON B, THOMAS L. 2005. Strategies that students use to trace code: an analysis based in grounded theory. In: ICER ’05. Proceedings of the 1st International Workshop on Computing Education Research; 1-2 October 2005; Seattle, WA, USA: ACM. p. 69-80.
GARNER S, HADEN P, ROBINS A. 2005. My program is correct but it doesn’t run: a preliminary investigation of novice programmers’ problems. In: ACE ’05. Proceedings of the 7th Australasian Conference on Computing Education; 31 January - 4 February 2005; Newcastle, NSW, Australia: Australian Computer Society, Inc. p. 173-180.
JACKSON J, COBB M, CARVER C. 2005. Identifying top Java errors for novice programmers. In: Proceedings of the 35th ASEE/IEEE Frontiers in Education Conference; 19-22 October 2005; Indianapolis, Indiana: ASEE/IEEE. p. 24-27.
JADUD MC. 2005. A first look at novice compilation behavior using BlueJ. Computer Science Education 15(1): 25-40.
JADUD MC. 2006a. Methods and tools for exploring novice compilation behaviour. In: ICER ’06. Proceedings of the 2nd International Workshop on Computing Education Research; 9-10 September 2006; Canterbury, United Kingdom: ACM. p. 73-84.
JADUD MC. 2006b. Exploring novice compilation behavior in BlueJ. [Doctoral thesis]. Retrieved from http://www.jadud.com/people/mcj/files/20060408- jadud-dissertation.pdf.
LAHITNEN E, ALA-MUTKA K, JARVINEN HM. 2005. A study of the difficulties of novice programmers. In: ITiCSE ’05. Proceedings of the 10th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education; 27-29 June 2005; Caparica, Portugal: ACM. p. 14-18.
LANE CH, VANLEHN K. 2005. intention-based scoring: An approach to measuring success at solving the composition problem. In: SIGCSE ’05. Proceedings of the 36th SIGCSE Technical Symposium on Computer Science Education; 23-27 February 2005; St. Louis , Missouri, USA: Special Interest Group on Computer Science Education (SIGCSE). p. 373-377.
LISTER R, ADAMS ES, FITZGERALD S, FONE W, HAMER J, LINDHOLD, M, MCCARTNEY, R, MOSTROM JE, SANDERS K, SEPPALA O, SIMON B, THOMAS L. 2004. A multi-national study of reading and tracing skills in novice programmers. ACM SIGCSE Bulletin 36(4): 119-150.
MCCRACKEN M., ALMSTRUM V, DIAZ D, GUZDIAL M, HAGAN D, KOLIKANT YB-D, LAXER C, THOMAS L, UTTING I. 2001. A multi-national, multi-institutional study of assessment of programming skills of first-year CS students. ACM SIGCSE Bulletin 33(4):125-140.
PERKINS DN, SCHWARTZ S, SIMMONS R. 1988. Instructional strategies for the problems of novice programmers. Teaching and Learning Computer Programming: Multiple Research Perspectives. 153-178.
SISON RC, NUMAO M, SHIMURA M. 2000. Multistrategy discovery and detection of novice programmer errors, Machine Learning 38: 157-180.
SPOHRER JC, SOLOWAY E. 1989. Novice mistakes: Are the folk wisdoms correct? Communications of the ACM 29(7): 624-632.
TRUONG N, ROE P, BANCROFT P. 2004. Static analysis of students’ Java programs. In: ACE ’04. Proceedings of the 6th Conference on Australasian Computing Education; 18-22 January 2004; Dunedin, New Zealand: Australian Computer Society, Inc. p. 317-325.
