An oxymoron is a figure of speech that is also an opposite in terms, i.e: a lonely crowd. "Alone in a crowd" does not strictly conform to oxymoron list.
oxymoron: a figure of speech by which a locution produces an incongruous, seemingly self-contradictory effect, as in "cruel kindness" or "to make haste slowly."