All of Raj's exes are spoken about as if they broke up with Raj. However Raj is the one who broke up with Emily Sweeney, and Deaf Emily was only dating him for his money so Raj might have ended things with her too.
When all of Raj's ex-girlfriends are in his apartment, explaining to him why each of them broke up with him, Lucy says, "Can I just say something?" In the next shot, the deaf Emily turns toward Lucy, as if she heard what Lucy said. A deaf person would not have looked toward a sound she couldn't hear.
When Amy takes off her glasses to demonstrate how she needs their help, she describes how she thusly sees him as "a cute pink smudge wearing a childish green smudge", referring to his green t-shirt. However, unlike most of Sheldon's shirts, this one is plain and unprinted, there's nothing childish about it, it's just green.