remove the build.log too at exit, and also use the proper $pwd prefix

to find the files/dirs to remove so that it still works if we "die" after
having done a 'cd'