The movement of thousands of people has raised concerns over potential war crimes and the role of the UN refugee agency.