Portland residents surveyed about the city’s downtown said they plan to visit less frequently, mainly citing homelessness and rioting that has plagued the area in the last year, according to a new poll.