Pensions and sovereign wealth funds with many billions to invest are finding the diversification they once relied on is an illusion.