•  
  •  
 

DOI

10.22550/2174-0909.3932

Abstract

INTRODUCTION. In recent years, development of the ethical and civic competence (ECC) that service-learning promotes has aroused the interest of educational communities around the world, in line with the pursuit of a holistic humanist education that prepares students for the challenges of living and coexisting in society. However, research into the impact of the implementation of service-learning seems to show that assessment of this competence is not well developed. Therefore, the aim of this study is to provide a critical analysis of the most significant ECC assessment methods and instruments in order to develop lines for improvement to promote assessment in educational action and scientific knowledge of this essential aspect in SL projects. METHOD. To achieve this objective, we developed an assessment tool, the content of which was validated through expert judgement. This tool made it possible to analyse the ECC assessment methods selected owing to their importance in the area studied based on formal and content-related identifying criteria. RESULTS. In this analysis, we found methods mainly from Spain and the USA, generally designed for summative assessment in questionnaire format. These methods essentially focus on civic assessment of ECC, centring on assessing the development of social responsibility and interpersonal skills. Study of the developing reflexivity is dominant in the assessment of the ethical dimension. DISCUSSION AND CONCLUSIONS. A number of areas for improvement are presented, which are aimed at creating a mixed multifocal assessment method that makes it possible to assess the dimensions of ECC in all of their complexity. Thus, we hope to contribute to the consolidation of service-learning to promote a holistic education that is committed to society and to people’s well-being.

Referencias | References

Aiken, L. R. (1980). Content validity and reliability of single items or questionnaires. Educational and Psychological Measurement, 40 (4), 955-959. https://doi.org/10.1177/001316448004000419

Alexander, H. A. (2016). Assessing virtue: Measurement in moral education at home and abroad. Ethics and Education, 11 (3), 310-325. http://doi.org/10.1080/17449642.2016.1240385

Aramburuzabala, P., Gezuraga, M., & López de Arana, E. (2019). Cómo abordar la evaluación en los proyectos de aprendizaje-servicio [How to deal with evaluation in service-learning projects]. In M. Ruiz-Corbella, & J. García-Gutiérrez (Eds.), Aprendizaje-servicio. Los retos de la evaluación [Service-learning. The challenges of evaluation] (pp. 27-39). Narcea.

Arthur, J. (2005). The re-emergence of character education in British education policy. British Journal of Educational Studies, 53 (3), 239-254. https://doi.org/10.1111/j.1467-8527.2005.00293.x

Batlle, R. (Coord.) (2015). Avaluació dels aprenentatges en els projectes d’aprenentatge servei [Evaluation of learning in service-learning projects]. Fundació Jaume Bofill. https:// aprenentatgeservei.cat/wp-content/uploads/guies/aps_avaluacio_ aprenentatge-amb-annex.pdf

Bernal, A. (2020). Educación del carácter y de las emociones [Character and emotional education]. In C. Naval, A. Bernal, G. Jover, & J. L. Fuentes (Eds.), Perspectivas actuales de la condición humana y la acción educativa [Current perspectives on the human condition and educational action] (pp. 71-85). Dykinson.

Bernal, A., & Naval, C. (2023). El florecimiento como fin de la educación del carácter [Flourishing as the aim of character education]. Revista Española de Pedagogía, 81 (284), 17-32. https://doi.org/10.22550/REP81-1-2023-01

Blanco-Cano, E., & García-Martín, J. (2021). El impacto del aprendizaje-servicio (ApS) en diversas variables psicoeducativas del alumnado universitario: las actitudes cívicas, el pensamiento crítico, las habilidades de trabajo en grupo, la empatía y el autoconcepto. Una revisión sistemática [The impact of service-learning (SL) on various psychoeducational variables of university students: civic attitudes, critical thinking, group work skills, empathy and self-concept. A systematic review]. Revista Complutense de Educación, 32 (4), 639-649. https://doi.org/10.5209/rced.70939

Bringle, R. G., & Clayton, P. H. (2021). Civic learning: A sine qua non of service learning. Frontiers in Education, 6, 1-14. https://doi.org/10.3389/feduc.2021.606443

Campo, L. (2015). Una rúbrica para evaluar y mejorar los proyectos de aprendizaje servicio en la universidad [A rubric for evaluating and improving university service-learning projects]. RIDAS, Revista Iberoamericana de Aprendizaje-Servicio, (1), 91-111. https://doi.org/10.1344/RIDAS2015.1.6

Camps, V. (2005). El sentido del civismo [The sense of civility]. Los monográficos de Barcelona. Metròpolis Mediterrània, (6), 15-21. https://articulateusercontent.com/rise/courses/xaMgwqn-2LaChXgyZ3b12f2MZG31M8WOY/VR95WmZC9sNUT6RA-l-3-20-m-1-20-el-20-sentido-20-del-20-civismo.pdf

Chiva, Ò., Capella, C., & Pallarès, M. (2018). Investigación-acción sobre un programa de aprendizaje-servicio en la didáctica de la educación física [Action-research on a service-learning program in teaching physical education]. Revista de Investigación Educativa, 36 (1), 277-293. https://doi.org/10.6018/rie.36.1.270581

Curren, R., & Kotzee, B. (2014). Can virtue be measured? Theory and Research in Education, 12 (3), 266-282. https://doi.org/10.1177/1477878514545205

Deeley, S. J. (2016). El aprendizaje-servicio en educación superior. Teoría, práctica y perspectiva crítica [Service-learning in higher education. Theory, practice and critical perspective]. Narcea.

Escobar-Pérez, & Cuervo-Martínez (2008). Validez de contenido y juicio de expertos: una aproximación a su utilización [Content validity and expert judgement: an approach to their use]. Avances en Medición, 6, 27-36. https://www.researchgate.net/publication/302438451

Esteban, F. (2015). Wilhelm von Humboldt, cardinal John Henry Newman and José Ortega y Gasset. Some thoughts on character education for today’s university. Journal of Character Education, 11 (1), 1-20.

Etzioni, A. (2001). La tercera vía hacia una buena sociedad. Propuestas desde el comunitarismo [The third way to a good society. Proposals from communitarianism]. Trotta.

Eyler, J., Giles, D. E., & Braxton, J. (1997). The impact of service-learning on college students. Michigan Journal of Community Service Learning, 4 (1), 5-15. http://hdl.handle. net/2027/spo.3239521.0004.101

Fuentes, J. L. (2018). Educación del carácter en España: causas y evidencias de un débil desarrollo [Character education in Spain: Reasons and evidences of a weak development]. Estudios sobre Educación, 35, 353-371. https://doi.org/10.15581/004.35.353-371

Fuentes, J. L., Sirera, A., & Redondo-Corcobado, P. (2022). Toward a civically engaged teacher identity: Qualitative analysis of a service learning project in educators training. In A. Gromkowska-Melosik, B. Hordecki, & T. R. Szymczynski (Eds.), In search of academic excellence. Social sciences and humanities in focus (vol. I) (pp. 83-109). Peter Lang.

Furco, A. (2004). El impacto educacional del aprendizaje-servicio. ¿Qué sabemos a partir de la investigación? [The educational impact of service-learning. What do we know from research?] [PDF]. University of California-Berkeley. https://roserballe. files.wordpress.com/2009/02/resultats-investigacio-aps- furco-modo-de-compatibilidad.pdf

Furco, A., Brooks, S. O., Lopez, I., Matthews, P. H., Hirt, L. E., Schultzetenberg, A., & Anderson, B. N. (2023). Service-Learning Quality Assessment Tool (SLQAT). Journal of Higher Education Outreach and Engagement, 27 (2), 181-200. https://openjournals.libs.uga.edu/jheoe/article/view/3318/2954

García-Gutiérrez, J., Fuentes, J. L., & del Pozo, A. (2018). La promoción de la competencia ética y el compromiso cívico y su evaluación en los proyectos universitarios de aprendizaje-servicio [Promoting ethical competence and civic engagement and its assessment in university service-learning projects]. In M. Ruiz-Corbella, & J. García-Gutiérrez (Eds.), Aprendizaje-servicio: los retos de la evaluación [Service-learning: The challenges of evaluation] (pp. 118-133). Narcea.

González-Geraldo, J. L., Jover, G., & Martínez, M. (2017). La ética del aprendizaje servicio en la universidad: una interpretación desde el pragmatismo [The ethics of service learning at university: An interpretation from pragmatism]. Bordón. Revista de Pedagogía, 69 (4), 63-78. https://doi.org/10.13042/Bordon.2017.690405

Gregorová, A. B., Heinzová, Z., & Chovancová, K. (2016). The impact of service-learning on students’ key competences. International Journal of Research on Service-Learning and Community Engagement, 4 (1), 367-376. https://doi.org/10.37333/001c.29686

Harrison, T., Arthur, J., & Burn, E. (2016). Character education evaluation handbook for schools. Jubilee Centre for Character and Virtues.

Hébert, A., & Hauf, P. (2015). Student learning through service learning: Effects on academic development, civic responsibility, interpersonal skills and practical skills. Active Learning in Higher Education, 16 (1), 37-49. https://doi.org/10.1177/1469787415573357

Ibáñez-Martín, J. A. (2021). La enseñanza de la filosofía y el cultivo de la inteligencia. Una segunda mirada al sentido crítico y al adoctrinamiento [Teaching philosophy and cultivating intelligence. A second look at critical thinking and indoctrination]. Revista Española de Pedagogía, 79 (278), 33-50. https://doi.org/10.22550/REP79-1-2021-11

Kristjánsson, K. (2015). Aristotelian character education. Routledge. León-Carrascosa, V., Sánchez-Serrano, S., & Belando-Montoro, M.-R. (2020). Diseño y validación de un cuestionario para evaluar la metodología aprendizaje-servicio [Design and validation of a questionnaire to evaluate the service-learning methodology]. Estudios sobre Educación, 39, 247-266. https://doi.org/10.15581/004.39.247-266

López-de-Arana, E., Aramburuzabala, P., & Opazo, H. (2019). Diseño y validación de un cuestionario para la autoevaluación de experiencias de aprendizaje-servicio universitario [Design and validation of a questionnaire for self-assessment of university service-learning experiences]. Educación XX1, 23 (1), 319-347. https://doi.org/10.5944/educxx1.23834

Martínez, M. (2010). Aprendizaje servicio y construcción de ciudadanía activa en la universidad: la dimensión social y cívica de los aprendizajes académicos [Service learning and the construction of active citizenship at university: the social and civic dimension of academic learning]. In M. Martínez (Ed.), Aprendizaje servicio y responsabilidad social de las universidades [Service learning and the social responsibility of universities] (pp. 11-26). Octaedro.

Martínez-Odría, A. (2007). Service-learning o aprendizaje-servicio. La apertura de la escuela a la comunidad local como propuesta de educación para la ciudadanía [Service-learning. Linking school and local community as a proposal for citizenship education]. Bordón. Revista de Pedagogía, 59 (4), 627-640. https://recyt.fecyt.es/index.php/BORDON/article/view/36336

McLaughlin, T. H. (1992) Citizenship, diversity and education: A philosophical perspective. Journal of Moral Education, 21 (3), 235-250. https://doi.org/10.1080/0305724920210307

Merino, C., & Livia Segovia, J. (2009). Intervalos de confianza asimétricos para el índice la validez de contenido: un programa visual basic para la V de Aiken [Confidence intervals for the content validity: A visual basic computer program for the Aiken’s V]. Anales de Psicología, 25 (1), 169-171. https://www.redalyc.org/pdf/167/16711594019.pdf

Moely, B., Mercer, S., Ilustre, V., Miron, D., & McFarland, M. (2002). Psychometric properties and correlates of the Civic Attitudes and Skills Questionnaire (CASQ): A measure of students’ attitudes related to service-learning. Michigan Journal of Community Service Learning, 8 (2), 15-26. http://hdl.handle.net/2027/spo.3239521.0008.202

Opazo, H., Ramírez, C., García-Peinado, R., & Lorite, M. (2015). La ética en el aprendizaje-servicio (ApS): un metaanálisis a partir de Education Resources Information Center (ERIC) [Ethics in service-learning (SL): A meta-analysis from Education Resources Information Center (ERIC)]. Profesorado. Revista de currículum y formación del profesorado, 19 (1), 144-175. https://recyt.fecyt.es/index.php/profesorado/article/view/41027

Palape, I., Sepúlveda, G., Bizkarra, M. T., & Gamito, R. (2022). Luces y sombras del aprendizaje-servicio: dificultades y decisiones para poner en marcha los proyectos [Lights and shadows of the service-learning: difficulties and decisions to implement projects]. RIDAS, Revista Iberoamericana de Aprendizaje Servicio, 13, 1-19. https://doi.org/10.1344/RIDAS2022.13.1

Penfield, R. D., & Giacobbi, P. R. Jr. (2004). Applying a score confidence interval to Aiken’s item content-relevance index. Measurement in Physical Education and Exercise Science, 8 (4), 213-225. https://doi.org/10.1207/s15327841mpee0804_3

Pérez, C. (2016). Educación en valores para la ciudadanía. Estrategias y técnicas de aprendizaje [Education in values for citizenship. Learning strategies and techniques]. Desclée de Brouwer.

Pollack, S. S. (2015). Critical civic literacy as an essential component of the undergraduate curriculum. The case of California State University, Monterey Bay. In W. J. Jacob, S. E. Sutin, J. C. Weidman, & J. L. Yeager (Eds.), Community engagement in higher education (pp. 161-184). Sense Publishers. https://doi.org/10.1007/978-94-6300-007-9_10

Prentice, M., & Robinson, G. (2010). Improving student learning outcomes with service learning. American Association of Community Colleges. https://files.eric.ed.gov/fulltext/ED535904.pdf

Puig, J. M., Gijón, M., Martín, X., & Rubio. L. (2011). Aprendizaje-servicio y educación para la ciudadanía [Service-learning and citizenship education]. Revista de Educación, (n.º extraordinario), 45-67. https://www.ub.edu/GREM/wp-content/uploads/Aps-y-educación-para-la-ciudadan.pdf

Puig, J., Martín, X., & Rubio, L. (2017). ¿Cómo evaluar proyectos de aprendizaje servicio? [How to evaluate service learning projects?]. Voces de la Educación, 2 (4), 122-132. https://www.revista.vocesdelaeducacion.com.mx/index.php/voces/article/view/72

Quintana, J. M. (1988). Teoría de la educación. Concepción antinómica de la educación [Theory of education. Antinomic conception of education]. Dykinson.

Redondo-Corcobado, P., & Fuentes, J. L. (2020). La investigación sobre el aprendizaje-servicio en la producción científica española: una revisión sistemática [Research on service learning in Spanish scientific production: A systematic review]. Revista Complutense de Educación, 31 (1), 69-82. https://doi.org/10.5209/rced.61836

Redondo-Corcobado, P., & Fuentes J. L. (2022). Desarrollo ético-cívico en el aprendizaje-servicio: un análisis desde la filosofía de la educación a través del pensamiento comunitarista de Amitai Etzioni [Ethical-civic development in service-learning: An analysis from the philosophy of education through the communitarian thinking of Amitai Etzioni]. Estudios sobre Educación, 43, 29-46. https://doi.org/10.15581/004.43.002

Rodríguez-Izquierdo, R. M. (2018). Aprender a pensar críticamente a través de la metodología de aprendizaje-servicio (ApS) [Learning to think critically through service-learning (SL) methodology]. In L. Torres (Coord.), Innovación docente: nuevos planteamientos [Teaching innovation: new approaches] (pp. 55-63). Octaedro.

Rodríguez-Izquierdo, R. M. (2019). Validación de una escala de medida del impacto del aprendizaje-servicio en el desarrollo de las competencias profesionales de los estudiantes en formación docente [Validation of a scale to measure the impact of service-learning on development of professional competences in students in teacher training]. Revista Mexicana de Psicología, 36 (1), 63-73. https://www.redalyc.org/articulo.oa?id=243058940006

Ryle, G. (1971). Collected essays 1929-1968. Routledge.

Salam, M., Awang Iskandar, D. N., Ibrahim, D. H. A., & Farooq, M. S. (2019). Service learning in higher education: A systematic literature review. Asia Pacific Education Review, 20 (4), 573-593. https://doi.org/10.1007/s12564-019-09580-6

Santos-Rego, M. A., Lorenzo, M., & Mella, I. (2020). El aprendizaje-servicio y la educación universitaria. Hacer personas competentes [Service-learning and university education. Making competent people]. Octaedro.

Skjong, R., & Wentworth, B. (2001). Expert judgement and risk perception. In International Society of Offshore and Polar Engineers (Ed.), Proceedings of the Eleventh International Offshore and Polar Engineering Conference (Stavanger, Norway, June 17-22, 2001) (vol. IV) (pp. 537-544). https://www.researchgate.net/publication/265032303_Expert_Judgment_and_Risk_Perception

Smith, R. (2022). Character education and the instability of virtue. Journal of Philosophy of Education, 56 (6), 889-898. https://doi.org/10.1111/1467-752.12692

Snell, R. S., & Lau, K. H. (2020). The development of a Service-Learning Outcomes Measurement Scales (S-LOMS). Metropolitan Universities, 31 (1), 44-77. https://doi.org/10.18060/23258

Steinberg, K., Hatcher, J., & Bringle, R. G. (2011). Civic-minded graduate: A north star (assessment tools). Indiana University and Purdue University. https://scholarworks.iupui.edu/handle/1805/2667

Stith, M., Anderson, T., Emmerling, D., Malone, D., Sikes, K., Clayton, P., & Bringle, R. (2021). Designing service-learning to enhance social justice commitments: A critical reflection tool. Experiential Learning & Teaching in Higher Education, 4 (2), 9-17. https://nsuworks.nova.edu/elthe/vol4/iss2/6

Tapia, M. N. (2010). Calidad académica y responsabilidad social: el aprendizaje servicio como puente entre dos culturas universitarias [Academic quality and social responsibility: Service learning as a bridge between two university cultures]. In M. Martínez (Ed.), Aprendizaje servicio y responsabilidad social de las universidades [Service learning and the social responsibility of universities] (pp. 27-56). Octaedro.

Zayas, B., Gozálvez, V., & Gracia, J. (2019). La dimensión ética y ciudadana del aprendizaje servicio: una apuesta por su institucionalización en la educación superior [The ethical and civic dimension of service learning: A model for its institutionalization in higher education]. Revista Complutense de Educación, 30 (1), 1-15. https://doi.org/10.5209/RCED.55443

Author Biography

Paloma Redondo-Corcobado is a Doctoral Student in the education doctoral programme at the Universidad Complutense de Madrid and has a university teacher training (FPU) contract. She has studied Pedagogy and Research in Education at the same institution. She is a member of the Cultura Cívica y Políticas Educativas (Civic Culture and Educational Policies - CCyPE) research group and is coordinator of the Red de Jóvenes Investigadores/as de Posgrado en Teoría de la Educación (young postgraduate researchers in theory of education - RedIPTE). Her principal academic contributions focus on the theoretical-philosophical foundation and ethical and civic impact of service-learning.

https://orcid.org/0000-0002-3311-8385

Included in

Education Commons

Share

COinS

Palabras clave | Keywords

service-learning, assessment, competence, ethics, civics, moral education, character education, education for citizenship, community education, social justice, common good, expert judgement