You can go kayaking near Utica at Lock 20 in Marcy, NY. The facilities have bathrooms and water, but the first-come, first-serve camping is quite small, so try to arrive early. You can also explore different options for camping near Utica on Hipcamp.