Tricks for getting lots of arrows?

Any tips or tricks for getting arrows (besides cheating)? Or tricks for finding a skeleton spawn?

I've tried farming chickens and gravel for feathers and flint, but it takes a ridiculously long time. How do people get enough arrows to make using a bow actually feasible?

Feathers

Method One: Go outside every morning around dawn.

Not only can you get a few arrows from burnt skeletons, but you can also get some feathers from chickens that happened to die in the night (from wolves, cactus).

Beta 1.7 and earlier: You can also get many feathers from burnt zombies by going out in the early morning.

Method Two: Explore

If you haven't fully explored at least one map, you're not doing enough. You should find many chickens on your travels. Kill ALL the chickens! Sometimes they'll drop more than one feather, meaning you can get a lot of arrows from just a few chickens.

Method Three: Build a chicken farm

This you say you've tried, but I'm adding it for completeness anyway. I have a very low maintenance farm. I place a single torch right outside my front door. That way, at night, that is the only place where passive mobs can spawn (it's the only place with both grass and light). I kill all the cows, chickens, and pigs that spawn right outside my door when I go out every morning at dawn.

Beta 1.9 and later: This should be considerably easier as you can use wheat to breed additional chickens.

Flint

Mine.

You should usually be doing a great deal of this anyway, but whenever you come across a gravel deposit underground, mine it. All of it. You should get a lot of flint from this, and the gravel you get can be used for other things¹ most of which will eventually return more flint.

Sticks are a no-brainer.

These methods (combined with the fact that you only need one of each to make 4 arrows), frequently allow me to have multiple stacks of arrows on hand in case a pesky Ghast should show up.

¹Such as descending a large sheer vertical drop. Drop gravel so that it falls into a tower, then you can stand on this tower and mine straight down safely. Bring more gravel than you need, because some will turn to more precious flint.

Hostile Mob Farms will cause you to have more arrows than you need.

I carry around 4 stacks of arrows at all times, and still have a double chest full of arrows sitting in my base, all from one 50 x 50 mob farm.

The key is to do it properly i.e. light up all the caves around you (and preferably build the farm underwater so that even at night mobs won't spawn) and have the trap within range (I think it's like 200 blocks or so) but not so close that mobs won't spawn.

Then you can either pop back every now and then while you're doing your thing, and you'll have a bunch of arrows waiting for you, or just afk for a while and you'll have stacks of arrows in your inventory when you get back.