I quit drawing on this verse, because I had learned all the lyrics. Rosemary is the other main character in the song. She is Big Jim's wife, but is looking toward the Jack of Hearts. Lily is Big Jim's mistress, but has a thing with the Jack of Hearts. Big Jim and/or the Jack of Hearts could be a reference to the tarot card, The Magician. Rosemary and Lily are flowers that appear on the Magician tarot card. Other people speculate, Rosemary represents Dylan's ex-wife, Sara; and Lily is his rumored mistress Joan Baez. Dylan lets each of us make up our own meanings, as he never said what the song means to him.
Rosemary combed her hair, and
Took the carriage into town,
She slipped into the side door,
Lookin' like a queen without a crown.
She fluttered her false eyelashes and
Whispered in his ear,
"I'm sorry, darlin', that I'm late,"
But he didn't seem to hear.
He was starin' into space,
Over at the Jack of Hearts.