How to have daily error and access logs on Apache (for Windows)?

What you're looking for is the rotatelogs program that comes with apache http://httpd.apache.org/docs/2.2/programs/rotatelogs.html

For instance, to rotate your logs daily at midnight:

CustomLog "|bin/rotatelogs -f /var/log/apache2/logfile.%Y.%m.%d.log 86400" common