Sharath H. Padmanabha
Fahad Shaikh
Amey Karkare
Purushottam Kar
ABSTRACT
We report the design, development and deployment of PRIORITY, an intelligent portal aimed at reducing the workload of instructors, tutors and teaching assistants in large programming courses of creating lab, assignment and exam problems every week. PRIORITY offers a scalable, user friendly and indexed repository of problems that can be queried to retrieve problems related to a particular programming concept, say for loops. PRIORITY accomplishes this by casting problem retrieval as a multi-label learning problem and using solving it using novel feature selection and AI-techniques. We also report the results of an A/B test and user survey, both conducted while PRIORITY was being used to offer a CS1 course taught at IIT Kanpur with over 500 students. PRIORITY has been in deployment at IIT Kanpur for almost 2 years now and our experience thus far suggests that it not only presents a valuable tool for course administrators, but also opens up several intriguing problems at the intersection of programming instruction, pedagogy, machine learning, semi-supervised learning and information retrieval. Code for PRIORITY is available at https://github.com/purushottamkar/priority/
- Umair Z. Ahmed, Renuka Sindhgatta, Nisheeth Srivastava, and Amey Karkare. 2019. Targeted Example Generation for Compilation Errors, In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE). In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE), 327–338. https://doi.org/10.1109/ASE.2019.00039Google Scholar
Digital Library
- Eli Bendersky [n. d.]. Pycparser: https://github.com/eliben/pycparser.Google Scholar
- Lijia Chen, Pingping Chen, and Zhijian Lin. 2020. Artificial Intelligence in Education: A Review. IEEE Access 8(2020), 75264–75278. https://doi.org/10.1109/ACCESS.2020.2988510Google ScholarCross Ref
- Rajdeep Das, Umair Z. Ahmed, Amey Karkare, and Sumit Gulwani. 2016. Prutor: A System for Tutoring CS1 and Collecting Student Programs for Analysis. arXiv:1608.03828 [cs.CY].Google Scholar
- Pablo A Estévez, Michel Tesmer, Claudio A Perez, and Jacek M Zurada. 2009. Normalized mutual information feature selection. IEEE Transactions on neural networks 20, 2 (2009), 189–201.Google ScholarDigital Library
- Xiaodong Gu, Hongyu Zhang, and Sunghun Kim. 2018. Deep Code Search. In Proceedings of the 40th International Conference on Software Engineering (ICSE).Google ScholarDigital Library
- Rahul Gupta, Soham Pal, Aditya Kanade, and Shirish Shevade. 2017. DeepFix: Fixing Common C Language Errors by Deep Learning, In 31st AAAI Conference on Artificial Intelligence (AAAI). In 31st AAAI Conference on Artificial Intelligence (AAAI), 1345–1351.Google ScholarCross Ref
- Srinivasan Iyer, Ioannis Konstas, Alvin Cheung, and Luke Zettlemoyer. 2016. Summarizing Source Code using a Neural Attention Model. In 54th Annual Meeting of the Association for Computational Linguistics (ACL).Google ScholarCross Ref
- Grigorios Tsoumakas, Ioannis Katakis, and Ioannis Vlahavas. 2009. Mining multi-label data. In Data mining and knowledge discovery handbook. Springer, 667–685.Google Scholar
- Ziyu Yao, Jayavardhan Reddy Peddamail, and Huan Sun. 2019. CoaCor: Code Annotation for Code Retrieval with Reinforcement Learning. In Proceedings of the 30th Web Conference (WebConf).Google ScholarDigital Library
- Michihiro Yasunaga and Percy Liang. 2020. Graph-based, Self-Supervised Program Repair from Diagnostic Feedback.. In Proceedings of the 37th International Conference on Machine Learning (ICML).Google ScholarDigital Library
Index Terms
- PRIORITY: An Intelligent Problem Indicator Repository
Recommendations
Towards an Intelligent Tutoring System Architecturethat Supports Remedial Tutoring
For successful teaching to take place an intelligent tutoring system has to be able to cope with any student errors that may occur during a tutoring interaction. Remedial tutoring is increasingly viewed as a central part of the overall tutoring process, ...
A machine learning approach for intelligent tutoring systems
ICS'05: Proceedings of the 9th WSEAS International Conference on SystemsThe combination of artificial intelligence (AI) technology and education results in different products of intelligent educational software for all tasks and domains. With AI methods new generation of intelligent tutoring systems (ITS) and intelligent ...
The ideology of intelligent tutoring systems
After approximately four decades of evolution, the attempt of using Intelligent Tutoring Systems (ITS) as extracurricular assistances is now widely accepted. As a rapid growing subarea of expert systems, their accomplishments are remarkable. During the ...
Comments