{"id":15735363,"url":"https://github.com/mikebarkmin/programming-assessments","last_synced_at":"2025-03-13T07:31:48.609Z","repository":{"id":53514797,"uuid":"252786710","full_name":"mikebarkmin/programming-assessments","owner":"mikebarkmin","description":" A curated list of assessments for programming","archived":false,"fork":false,"pushed_at":"2024-03-20T15:34:49.000Z","size":549,"stargazers_count":6,"open_issues_count":2,"forks_count":0,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-02-26T19:06:43.361Z","etag":null,"topics":["classifications","papers","programming-assessments"],"latest_commit_sha":null,"homepage":"http://www.barkmin.eu/programming-assessments/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mikebarkmin.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"contributing.md","funding":null,"license":"LICENSE","code_of_conduct":"code-of-conduct.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-04-03T16:40:14.000Z","updated_at":"2023-06-13T12:19:07.000Z","dependencies_parsed_at":"2024-10-25T00:17:55.648Z","dependency_job_id":"e3a4fb33-9a0d-4293-b140-519a3b68007f","html_url":"https://github.com/mikebarkmin/programming-assessments","commit_stats":{"total_commits":73,"total_committers":4,"mean_commits":18.25,"dds":0.2191780821917808,"last_synced_commit":"e0246f832546cd0340bdc52e1917f64581f95176"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikebarkmin%2Fprogramming-assessments","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikebarkmin%2Fprogramming-assessments/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikebarkmin%2Fprogramming-assessments/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikebarkmin%2Fprogramming-assessments/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mikebarkmin","download_url":"https://codeload.github.com/mikebarkmin/programming-assessments/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243361361,"owners_count":20278555,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["classifications","papers","programming-assessments"],"created_at":"2024-10-04T01:12:52.268Z","updated_at":"2025-03-13T07:31:48.259Z","avatar_url":"https://github.com/mikebarkmin.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"![Lint](https://github.com/mikebarkmin/awesome-programming-assessments/workflows/Lint/badge.svg)\n![Build](https://github.com/mikebarkmin/awesome-programming-assessments/workflows/Build/badge.svg)\n\n# Programming Assessments\n\n \u003e A curated list of assessments, classifications and papers regarding programming asssessments\n\n Visit http://www.barkmin.eu/programming-assessments/ for more details.\n\n## Contents\n\n- [Assessments](#assessments)\n- [Classifications](#classifications)\n- [Papers](#papers)\n\n\n## Assessments\n\n| Title | Authors | Related Papers |\n| ----- | ------- | -------------- |\n| [Ahadi 2013 - 1](https://www.barkmin.eu/programming-assessments/assessments/ahadi_2013_1.html) | Ahadi et.al | - [Ahadi et.al (2013) (O)](#ahadi_2013)- [Rosenstein et.al (2020) (M)](#rosenstein_2020)- [Patitsas et.al (2019) (M)](#patitsas_2019)- [Ahadi et.al (2019) (M)](#ahadi_2019)- [Fronza et.al (2019) (M)](#fronza_2019)- [Liao et.al (2019) (M)](#liao_2019)- [Lodi (2019) (M)](#lodi_2019)- [Alvarado et.al (2018) (M)](#alvarado_2018)- [Luxton-Reilly et.al (2018) (M)](#luxton-reilly_2018)- [Morrison (2017) (U)](#morrison_2017) |\n| [Ahadi 2013 - 2](https://www.barkmin.eu/programming-assessments/assessments/ahadi_2013_2.html) | Ahadi et.al | - [Ahadi et.al (2013) (O)](#ahadi_2013)- [Rosenstein et.al (2020) (M)](#rosenstein_2020)- [Patitsas et.al (2019) (M)](#patitsas_2019)- [Ahadi et.al (2019) (M)](#ahadi_2019)- [Fronza et.al (2019) (M)](#fronza_2019)- [Liao et.al (2019) (M)](#liao_2019)- [Lodi (2019) (M)](#lodi_2019)- [Alvarado et.al (2018) (M)](#alvarado_2018)- [Luxton-Reilly et.al (2018) (M)](#luxton-reilly_2018)- [Morrison (2017) (U)](#morrison_2017) |\n| [Basic Data Structures (BDSI)](https://www.barkmin.eu/programming-assessments/assessments/porter_2019.html) | Porter et.al | - [Porter et.al (2019) (O)](#porter_2019) |\n| [Benchmarked Exam Questions for Introductory Programming](https://www.barkmin.eu/programming-assessments/assessments/sheard_2014.html) | Sheard et.al | - [Sheard et.al (2014) (O)](#sheard_2014)- [Simon et.al (2016) (U)](#simon_2016) |\n| [Benchmarked Exam Questions for Introductory Programming](https://www.barkmin.eu/programming-assessments/assessments/simon_2016.html) | Simon et.al | - [Simon et.al (2016) (O)](#simon_2016)- [Jacková et.al (2019) (R)](#jacková_2019) |\n| [CS1 Assessment](https://www.barkmin.eu/programming-assessments/assessments/dierbach_2005.html) | Dierbach et.al | - [Dierbach et.al (2005) (O)](#dierbach_2005) |\n| [Concept Inventory (CI) for Introductory Programming in C](https://www.barkmin.eu/programming-assessments/assessments/caceffo_2016.html) | Caceffo et.al | - [Caceffo et.al (2016) (O)](#caceffo_2016)- [Bari et.al (2019) (U)](#bari_2019)- [Izu et.al (2019) (U)](#izu_2019)- [Xhakaj et.al (2018) (U)](#xhakaj_2018) |\n| [Developing Assessments to Determine Mastery of Programming Fundamentals](https://www.barkmin.eu/programming-assessments/assessments/luxton-reilly_2018.html) | Luxton-Reilly et.al | - [Luxton-Reilly et.al (2018) (O)](#luxton-reilly_2018) |\n| [Multiple Choice Exam for First Semester](https://www.barkmin.eu/programming-assessments/assessments/lister_2005.html) | Lister | - [Lister (2005) (O)](#lister_2005) |\n| [Second Computer Science 1](https://www.barkmin.eu/programming-assessments/assessments/parker_2016.html) | Parker | - [Parker et.al (2016) (O)](#parker_2016)- [Bockmon et.al (2020) (R)](#bockmon_2020)- [Xie et.al (2020) (U)](#xie_2020)- [Blanchard et.al (2019) (U)](#blanchard_2019)- [Bockmon et.al (2019) (R)](#bockmon_2019)- [Xie et.al (2019) (R)](#xie_2019)- [Joyner et.al (2019) (R)](#joyner_2019)- [Joyner (2018) (R)](#joyner_2018)- [Parker et.al (2018) (R)](#parker_2018)- [Joyner (2018) (R)](#joyner_2018_1)- [Timmermann et.al (2016) (R)](#timmermann_2016) |\n| [Second Computer Science 1 - Revised](https://www.barkmin.eu/programming-assessments/assessments/bockmon_2019.html) | Bockmon et.al | - [Bockmon et.al (2019) (O)](#bockmon_2019)- [Somerville et.al (2020) (U)](#somerville_2020)- [Bockmon et.al (2020) (U)](#bockmon_2020) |\n| [Self-Assessment Procedure XXIII: Programming Languages](https://www.barkmin.eu/programming-assessments/assessments/clifton_1995.html) | Clifton | - [Clifton (1995) (O)](#clifton_1995) |\n| [String Manipulation](https://www.barkmin.eu/programming-assessments/assessments/izu_2020.html) | Izu et.al | - [Izu et.al (2020) (O)](#izu_2020) |\n\n\n## Classifications\n\n- [Competency Structure Model for Programming (COMM_P)](https://www.barkmin.eu/programming-assessments/classificationscommp_model.html)\n\n\n## Papers\n\n- \u003ca id=\"ahadi_2013\"\u003eAhadi et.al (2013)\u003c/a\u003e: [Geek Genes, Prior Knowledge, Stumbling Points and Learning Edge Momentum: Parts of the One Elephant?](https://doi.org/10.1145/2493394.2493416)\n- \u003ca id=\"ahadi_2019\"\u003eAhadi et.al (2019)\u003c/a\u003e: [ArAl: An Online Tool for Source Code Snapshot Metadata Analysis](https://doi.org/10.1145/3286960.3286975)\n- \u003ca id=\"alvarado_2018\"\u003eAlvarado et.al (2018)\u003c/a\u003e: [The Persistent Effect of Pre-College Computing Experience on College CS Course Grades](https://doi.org/10.1145/3159450.3159508)\n- \u003ca id=\"bari_2019\"\u003eBari et.al (2019)\u003c/a\u003e: [{{EvoParsons}}: Design, Implementation and Preliminary Evaluation of Evolutionary {{Parsons}} Puzzle]()\n- \u003ca id=\"barkmin_2020\"\u003eBarkmin (2020)\u003c/a\u003e: [Competency Structure Model for Programming for the Transition from School to University](https://doi.org/10.1145/3421590.3421591)\n- \u003ca id=\"blanchard_2019\"\u003eBlanchard et.al (2019)\u003c/a\u003e: [Effects of Code Representation on Student Perceptions and Attitudes Toward Programming](https://ieeexplore.ieee.org/document/8818762)\n- \u003ca id=\"bockmon_2019\"\u003eBockmon et.al (2019)\u003c/a\u003e: [(Re)Validating Cognitive Introductory Computing Instruments](https://doi.org/10.1145/3287324.3287372)\n- \u003ca id=\"bockmon_2020\"\u003eBockmon et.al (2020)\u003c/a\u003e: [A CS1 Spatial Skills Intervention and the Impact on Introductory Programming Abilities](https://doi.org/10.1145/3328778.3366829)\n- \u003ca id=\"caceffo_2016\"\u003eCaceffo et.al (2016)\u003c/a\u003e: [Developing a Computer Science Concept Inventory for Introductory Programming](https://doi.org/10.1145/2839509.2844559)\n- \u003ca id=\"clifton_1995\"\u003eClifton (1995)\u003c/a\u003e: [Self-Assessment Procedure XXIII: Programming Languages](https://doi.org/10.1145/203356.203378)\n- \u003ca id=\"dierbach_2005\"\u003eDierbach et.al (2005)\u003c/a\u003e: [Experiences with a CS0 Course Targeted for CS1 Success](https://doi.org/10.1145/1047344.1047453)\n- \u003ca id=\"fronza_2019\"\u003eFronza et.al (2019)\u003c/a\u003e: [An Exploration of Cognitive Shifting in Writing Code](https://doi.org/10.1145/3300115.3309522)\n- \u003ca id=\"izu_2019\"\u003eIzu et.al (2019)\u003c/a\u003e: [Fostering Program Comprehension in Novice Programmers - Learning Activities and Learning Trajectories]()\n- \u003ca id=\"izu_2020\"\u003eIzu et.al (2020)\u003c/a\u003e: [Assessing CS1 Design Skills with a String Manipulation Task](https://doi.org/10.1145/3341525.3387382)\n- \u003ca id=\"jacková_2019\"\u003eJacková et.al (2019)\u003c/a\u003e: [Introductory Programming Exams and Their Benchmarking in Slovakia](https://ieeexplore.ieee.org/abstract/document/9039988)\n- \u003ca id=\"joyner_2018_1\"\u003eJoyner (2018)\u003c/a\u003e: [Toward CS1 at Scale: Building and Testing a MOOC-for-Credit Candidate](https://doi.org/10.1145/3231644.3231665)\n- \u003ca id=\"joyner_2018\"\u003eJoyner (2018)\u003c/a\u003e: [Intelligent Evaluation and Feedback in Support of a Credit-Bearing MOOC]()\n- \u003ca id=\"joyner_2019\"\u003eJoyner et.al (2019)\u003c/a\u003e: [Replicating and Unraveling Performance and Behavioral Differences between an Online and a Traditional CS Course](https://doi.org/10.1145/3300115.3309533)\n- \u003ca id=\"liao_2019\"\u003eLiao et.al (2019)\u003c/a\u003e: [A Robust Machine Learning Technique to Predict Low-Performing Students](https://doi.org/10.1145/3277569)\n- \u003ca id=\"lister_2005\"\u003eLister (2005)\u003c/a\u003e: [One Small Step toward a Culture of Peer Review and Multi-Institutional Sharing of Educational Resources: A Multiple Choice Exam for First Semester Programming Students]()\n- \u003ca id=\"lodi_2019\"\u003eLodi (2019)\u003c/a\u003e: [Does Studying CS Automatically Foster a Growth Mindset?](https://doi.org/10.1145/3304221.3319750)\n- \u003ca id=\"luxton-reilly_2018\"\u003eLuxton-Reilly et.al (2018)\u003c/a\u003e: [Developing Assessments to Determine Mastery of Programming Fundamentals](https://doi.org/10.1145/3174781.3174784)\n- \u003ca id=\"morrison_2017\"\u003eMorrison (2017)\u003c/a\u003e: [Dual Modality Code Explanations for Novices: Unexpected Results](https://doi.org/10.1145/3105726.3106191)\n- \u003ca id=\"parker_2016\"\u003eParker et.al (2016)\u003c/a\u003e: [Replication, Validation, and Use of a Language Independent CS1 Knowledge Assessment](https://doi.org/10.1145/2960310.2960316)\n- \u003ca id=\"parker_2018\"\u003eParker et.al (2018)\u003c/a\u003e: [Socioeconomic Status and Computer Science Achievement: Spatial Ability as a Mediating Variable in a Novel Model of Understanding](https://doi.org/10.1145/3230977.3230987)\n- \u003ca id=\"patitsas_2019\"\u003ePatitsas et.al (2019)\u003c/a\u003e: [Evidence That Computer Science Grades Are Not Bimodal](https://doi.org/10.1145/3372161)\n- \u003ca id=\"porter_2019\"\u003ePorter et.al (2019)\u003c/a\u003e: [BDSI: A Validated Concept Inventory for Basic Data Structures](https://doi.org/10.1145/3291279.3339404)\n- \u003ca id=\"rosenstein_2020\"\u003eRosenstein et.al (2020)\u003c/a\u003e: [Identifying the Prevalence of the Impostor Phenomenon Among Computer Science Students](https://doi.org/10.1145/3328778.3366815)\n- \u003ca id=\"sheard_2014\"\u003eSheard et.al (2014)\u003c/a\u003e: [Benchmarking a Set of Exam Questions for Introductory Programming]()\n- \u003ca id=\"simon_2016\"\u003eSimon et.al (2016)\u003c/a\u003e: [Benchmarking Introductory Programming Exams: Some Preliminary Results](https://doi.org/10.1145/2960310.2960337)\n- \u003ca id=\"somerville_2020\"\u003eSomerville et.al (2020)\u003c/a\u003e: [Addressing Mixed Levels of Prior Knowledge by Individualising Learning Pathways in a Degree Apprenticeship Summer School](https://doi.org/10.1145/3372356.3372370)\n- \u003ca id=\"timmermann_2016\"\u003eTimmermann et.al (2016)\u003c/a\u003e: [Evidence-based re-design of an introductory course “programming in C”](https://ieeexplore.ieee.org/document/7757492)\n- \u003ca id=\"xhakaj_2018\"\u003eXhakaj et.al (2018)\u003c/a\u003e: [Towards {{Improving Introductory Computer Programming}} with an {{ITS}} for {{Conceptual Learning}}]()\n- \u003ca id=\"xie_2019\"\u003eXie et.al (2019)\u003c/a\u003e: [An Item Response Theory Evaluation of a Language-Independent CS1 Knowledge Assessment](https://doi.org/10.1145/3287324.3287370)\n- \u003ca id=\"xie_2020\"\u003eXie et.al (2020)\u003c/a\u003e: [The Effect of Informing Agency in Self-Directed Online Learning Environments](https://doi.org/10.1145/3386527.3405928)\n\n\n## Contributors\n\n\n|  [\u003cimg alt=\"Mike Barkmin\" src=\"https://avatars1.githubusercontent.com/u/2592379?s=460\u0026u=d599a9f90b2c8e8b3d328d3f02bce36043bcfe76\u0026v=4\" width=\"100px\"\u003e](https://www.barkmin.eu) |\n|-------------- | \n| [Mike Barkmin](https://www.barkmin.eu) | \n\n\n\n## Contribute\n\nContributions welcome! Read the [contribution guidelines](contributing.md) first.\n\n\n## License\n\n[![CC BY-SA 4.0](https://mirrors.creativecommons.org/presskit/buttons/88x31/svg/by-sa.svg)](https://creativecommons.org/licenses/by-sa/4.0)\n\nYou are free to:\n- **Share** — copy and redistribute the material in any medium or format\n- **Adapt** — remix, transform, and build upon the material for any purpose, even commercially.\n\nUnder the following terms:\n\n- **Attribution** — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.\n- **ShareAlike** — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.\n- **No additional restrictions** — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.\n\nThe licensor cannot revoke these freedoms as long as you follow the license terms.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikebarkmin%2Fprogramming-assessments","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmikebarkmin%2Fprogramming-assessments","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikebarkmin%2Fprogramming-assessments/lists"}