Click on the options icon in the top right corner of the screen (inside the channel).
Select Manage Participants.
Simply click on the member name to add them to the channel. Clicking on them again will remove them.
Note: This process only works for channels that are not tied to a project.