While it's often not difficult to identify tokens while parsing, having a separate stage for lexical analysis simplifies the structure of your compiler.

Mix the eggs and milk with the flour until the consistency is smooth.

Each evening the Yardmaster in charge of each yard prepares a list of the freight trains (booked and special) which he proposes to run next day.

tha wut spudlee out the Yemors, and screedle over mun