If you're imagining it, how can it be offensive? Just wondering.
Imagination is a wonderful thing. You've done nothing offensive. The only offensive thing would be to say something to the deaf or mute person along the lines of - your voice is really crappy so in my head, you talk like James Earl Jones - is that ok?
No...