if the designer is reputable you have nothing to worry about. All they should need for SEO work is ftp access. Create a new ftp account that only allows access to the folder you site is in.
Alternatively send them a copy of your website and upload it yourself when they are done.