You can start an online dating site for next to nothing. There are plenty of free scripts around. Of course... this sector is very very competitive. Realisitcally you would need a big investment in marketting to have any chance of making a profit.
As for hosting, you could start with a cheap shared hosting package then scale as your requirements change.