If I type in the above and do Ctrl + Space to lookup the rest of the file VAX correctly shows the full header file name headerfile.h. Accepting this (with return) appends the include file name rather than replacing it so I end up with the following
#include "HeaderFileHeaderFile.h"
Note that I can only reproduce this when the . is present.