Fast way to get things from a std::map?

Is there a quick way to collect all the first or second elements of a std::map into a std::set?