When you meet someone new, you just need to realize that you are in control. If you don’t feel comfortable, go slow. You do not have to have sex with anyone if you don't want to. You don't have to give out your phone number. You are in control. On the other hand, it's perfectly fine if you meet someone and decide that you want to try casual sex.
You definitely should not give up your toys. Those are fun, too. Toys are a great way to meet your sexual needs if you don't meet someone that you want to explore with. There's absolutely nothing wrong with having toys.
You don't have to make a choice between going out and meeting people and staying home and using your toys. You can have the best of both worlds.
I think going out and playing the field is exactly what you need, though. It's good for you to go out and meet new people and have new experiences.