Algebraic topology, etc. for Mac Lane's "Categories for the Working Mathematician"
All condescension aside, my first thought was that, in fact, category theory is an incredibly useful tool and language. As such, many of us want to read CWM so that we can understand various constructions in other fields (for instance the connection between monadicity and descent, or the phrasing of various homotopy theory ideas as coends, not to mention just basic pullbacks, pushforwards, colimits, and so on). So it is in fact relevant WHY you want to read it.
As an undergraduate, I started reading CWM, with minimal success. The idea being primarily that, as you say, I had very few examples. I thought the notion of a group as a category with one element was rather neat, but I couldn't really understand adjunctions, over(under)-categories, colimits or some of the other real meat of category theory in any deep, meaningful fashion until I began to have some examples to apply.
In my opinion, it is not fruitful to read CWM straight up. It's like drinking straight liquor. You might get really plastered (or in this analogy, excited about all the esoteric looking notation and words like monad, dinatural transformation, 2-category) but the next day you'll realize you didn't really accomplish anything.
What is the rush? Don't read CWM. Read Hatcher's Algebraic Topology, read Dummit and Foote, read whatever the standard texts are in differential geometry, or lie groups, or something like that. Then, you will see that category theory is a lovely generalization of all the nice examples you've come to know and love, and you can build on that.
I started to read CWM with only few knowledge about algebraic topology and homological algebra. You don't really have to know much about these fields to benefit from CWM. Just read the basic definitions (fundamental group of a space, homology of a chain complex) and it will be enough. Of course you benefit even more when you have already some background in the areas where category theory has become one of the central corner point, but you can also learn both simultanously.
After all you also have to ask yourself: Why do I want to learn category theory? Any answer will make it clear which book you have to read first.