There were still people left from the Hittites, Amorites, Perizzites, Hivites and Jebusites (these people were not Israelites).