Awwww... Sounds like someone got kicked in the balls by foreign stuff. Their poor pride.
I think it's more a matter of approach and application that determines the difficulty of a language, and also what your definition of "difficult" is. For instance, even though I haven't been able to learn it after ten years, I can't call it difficult since I haven't been able to put a lot of effort into the task. Beyond that each person has a method that works best for them: some may do well in classes and/or tutors, others in books and studying, and some who would do better being around (or living among) those who speak the language. And then it comes down to how long and how hard you are willing to learn.
But I do notice that a common problem that people tend to have with the language, is the different sentence structure. Which is why there are jokes about translating English into Japanese, and then back again. I think that's the case because a lot of people try to learn the language in the context of their native language, so they try to understand it in English, not in Japanese. If you understood Japanese as Japanese, the sentence structure and meaning would make sense. But if you don't, what you get is a messed-up English sentence and problems with such things as plurals and prefixes/suffixes and such.
I don't really think it has much to do with being from the West, or even your language. It's about how you think, and your oral skill. Personally, I'd find several other languages harder, such as the ones that rely a lot on proper phonetics and inflections. I honestly don't know how I'd be able to use phlegm properly, for example... To me, that would be hard. Just rolling an R in Spanish is something I haven't been able to do; which, to me, makes the whole language difficult, since it's required for proper speech in that language. I haven't encountered such a problem with Japanese, so... Not as hard, I guess. *Shrugs*