Just use the '**' pattern with sfFileCache :

$frontend_cache_dir = sfConfig::get('sf_cache_dir').'/frontend/prod/template';
$cache = new sfFileCache(array('cache_dir' => $frontend_cache_dir)); // Use the same settings as the ones defined in the frontend factories.yml
$cache->removePattern('**'); // remove everything in the dir