Even as some venture-capital firms have become skittish after the disappointing initial public offerings of Facebook, Groupon Inc. and Zynga Inc., a number of hedge funds, private-equity firms and other asset-management firms are pouring money into closely held startups.