This is rather unusual issue, you might want to file a bug against glassfish with a testcase attached.
Speaking of manual undeployment, it should involve removing application entries from instance's domain.xml file as well as removing actual application files and resources from instance's 'applications' directory.