The next day the horsemen went with Paul to Caesarea. But the other soldiers went back to the army building in Jerusalem.