Log in as admin
Banners > New Banner
Fill in banner text
Press "Create Banner"
Click the × to dismiss the banner
Navigate to another page
The banner probably reappears on the next page due to full page caching.
The banner should not reappear.
Refer to for the gist of how to approach this.