If you’ve created the Space, you can add or remove someone from your Space, unless you’ve downgraded to Basic after having created the Space.
Here's how to do it:
Open the Space and tap on the three dots in the top left corner of the screen.
Tap on "Manage members".
Tap on the "minus" symbol to remove existing members, and on "Invite new" to invite new ones.