With the rapid advancement of information technology, education, particularly Computer-Assisted Instruction (CAI), has undergone significant transformation. CAI improves teaching efficiency, enhances educational content, and promotes student-teacher interaction while fostering students’ autonomous learning abilities. Despite its widespread adoption, the effectiveness of CAI varies depending on the implementation context. Evaluating CAI’s impact has become a critical challenge in educational reform. This study developed a comprehensive evaluation framework to assess the effectiveness of Computer-Assisted Instruction (CAI) by integrating the Analytic Hierarchy Process (AHP) with Fuzzy Comprehensive Evaluation (FCE) methods, providing a multidimensional approach for understanding technology-enhanced physical education teaching methods. The evaluation system covers multiple dimensions, including the teaching process, student learning outcomes, and resource availability. Using AHP, the importance of each factor is weighted, and the FCE method quantifies the data to derive an overall effectiveness score. The research highlights the need for a comprehensive evaluation system as previous studies often rely on qualitative analysis or single metrics. By adopting a multidimensional, quantitative approach, this study offers a more robust and scientifically grounded method for assessing CAI. The findings suggest that while CAI is effective in enhancing teaching outcomes, its success is contingent on resource availability and the technical capabilities of both teachers and students. This research provides valuable insights for educators and policymakers aiming to optimize CAI implementations and enhance the quality of education through better technological integration.