This paper aims to study what native speakers pay attention to when speaking to non-native speakers in daily casual conversations. The 'native speakers' referred to in this paper are Japanese university students with no experience in teaching or learning Japanese Language as a Second/Foreign Language. In this study, the relation between intentional consideration and evaluation will be studied. For this purpose, we conduct the following qualitative research. After 10 minutes of free conversation with Japanese Language learners, 30 Japanese students were asked to elaborate on their opinions about the conversation and the Japanese Language spoken by their partners. They were also asked to list the items they paid attention to during the conversation. As a result, it was found that native speakers showed their concerns in 11 different aspects. Their consideration changed consciously according to the situation and the learners' output. It was obvious that native speakers were especially aware about 'speaking slowly' and 'choosing the right words'. Native speakers also thought that there was necessity for certain considerations in conversations with Japanese Language learners irrespective of their opinions about the learners' output and the conversation. Furthermore, it was determined that intentional consideration is closely related to the features of evaluation as indicated in precedent studies.