Consumer confidence fell in November for the fourth month in a row as Americans expressed more worries about the U.S. labor market, but they remained generally upbeat about the economy heading into the holiday season.