Merck & Co. is in advanced talks to acquire Acceleron Pharma Inc., according to people familiar with the matter, in a move that would bolster the pharmaceutical giant’s rare-disease business.