Keyboard mixing languages

I'm having an issue where I can switch between languages like English and Chinese, but not entirely. Let me explain a typical case.

When I switch to Chinese (Simplified) and want to type a question mark ?, instead of getting that character, I get É (which would be correct if I switched to the Canadian French). However, I can still type other Chinese characters on the A-Z keys. It's very strange--my keyboard behaves like it's half Chinese and half French.

I have the following languages installed on my system. My keyboard has a JIS layout.

Has anyone experienced something similar or knows how to resolve the issue? Thanks in advance!