Listening has been playing a key role in daily communication and ELT.However,it's an obstacle for most non-English majors.Among affective factors the students encounter in listening,anxiety is the most usual one.In this paper,I will analyze the situation based on my observations on listening class and interviews with some students in terms of the relationship between students' anxiety and their listening performance and the characteristics of the listening materials.Subsequently,with the interviews with some students,some possible ways of improving listening ability are discussed.