This study discusses some challenges language teachers face, and how teacher cognition in intercultural contexts affects the learning outcome. A Japanese language teacher, teaching Japanese to Hungarian students, and a Hungarian language teacher, teaching English to Japanese students, reflected on their classroom practices in Hungary in the form of in-depth, semi-structured interviews. Narrative analysis revealed that the main challenges were language barriers, time constraints, and intercultural differences. Overcoming these challenges gave both teachers feelings of success: Japanese students were able to improve their speaking skills, whereas Hungarian students received scholarships to Japan due to enhanced Japanese language proficiencies.