All of your alternatives work fine except for last.
For all intents and purposes, lastly, at last, and finally mean the same thing.
One thing, though: As far as common usage, you'll probably hear finally more frequently than the others, with at last coming in second. Lastly is not heard often and seems to be a more literary kind of word than conversational.
When you block a person, they can no longer invite you to a private message or post to your profile wall. Replies and comments they make will be collapsed/hidden by default. Finally, you'll never receive email notifications about content they create or likes they designate for your content.
Note: if you proceed, you will no longer be following .