Residents living on houseboats and yachts in the San Francisco Bay resorted to physically fighting off seafaring bandits who are ransacking their ships, former harbor master Brock de Lappe said.