My first suggestion would be to exclude the VPN IP address pool from the acl, but then you have decided to use IP addresses from the inside.
To be honest - I see no reason why the acl would break, so I would change the IP addresses the remote users get assigned to say 10.10.2.0/24 and then re-test the acl and see what happens.
HTH>