I'm talking rudely when i don't mean it?

Manners sometimes do not match well across cultures. When you speak in your first language, perhaps what would be polite in your second language is not polite in your first, and vice versa. If in doubt, think before you speak: not bad advice for any situation, native speaker or not.