Bobby Van's Steakhouse owner Joseph Smith said that soaring inflation and a rise in crime has caused him to lose millions in business between all his restaurants.