出かけるとき憑いてきます。誤字ではないです

Possesses me when I head out. Not a typo.
付く can mean "to tag along with", but 憑く means "to possess". Naturally, they're read the same way (tsuku). Also the title is based on her PCB title, 幽冥楼閣の亡霊少女