For /media/ changes, generate a classic purge based on the URL. For anything tha'ts not templates *or* media, just don't generate any purges at all (of course).
This will integrate with the gitdeployer script to automatically purge pages using specific templates using the xkeys that were added some time ago.