Nope not at all unless the memo is removable by the time you reach your client.

If you REALLY need to remember something, why not use post its? Just stick it on your invoice and when you are done, remove it.