There are two ways to close a chat on Guest Chat when you are finished with it.
Click on the black tick next to the chat to Mark as Closed.