Just chmod the dir, and to make sure rotated files are also readable, change /etc/logrotate.d/apache2. The mask is defined in there. 

/var/log/apache2/*.log {
        blablabla
        create 644 root adm
        blablabla
}