I just moved from Cincinnati to Cleveland about a month ago and I can tell you the one thing I miss about it the most is Findlay Market. I used to live about a 15 minute walk from there and I was always going early saturday morning. People will tell you that it's a dangerous neighborhood ect but as a relatively short white female I never had any problems. Herbs and spice in findlay market is an excellent place to get pretty much any herb you could ever want.
As for restaurants I'd say Indigo in hyde park is a wonderful option as is JeanRo Bistro downtown (fourth and vine I think it's on). Both are on the pricey side but the food is wonderful as are the winelists.
If you are aiming for something that wont hurt your pocketbook I would suggest Melt in Northside. Tons of vegan and vegetarian foods as well as the most kick butt Brunch on Sundays. There is also, as somebody mentioned, Cilantro which is good.
I'm surprised nobody has mentioned Blackstone. I'm pretty much in love with the 2005 Merlot. It's about $8 a bottle.