At least 54 migrants died when a boat carrying around 150 people sank off Yemen's coast in bad weather on Sunday, with dozens still unaccounted for, health officials said.