File/dir wont rm!!

As you may or may not know the 2.6.3 kernel came out today. While emergeing it I finally decided that its time to remove all the old kernels I dont use any more, pretty much the 2.4.x tree and all the rc I have. I removed them all but doing an emerge -C vanilla-sources it left the dir so I went into /usr/src/ and did a rm -rf linux-2.4.xx on the stuff it left. Then I went to /lib/modules and do rm -rf 2.4.xx but the problem is when I got to my last dir 2.4.23-burner it wont let me remove it. Doing rm -rf 2.4.23-burner it goes like everything is kool but its still there same thing with rm -f rmdir gives me rmdir: `2.4.23-burner': No such file or directory and when I try to cd into it I get -bash: cd: 2.4.23-burner: No such file or directory. Can someone please tell me how to get rid of this?

Thanks

nuke