Possible Clues:

• Decline
• Take a bad turn
• Migrate for the winter, perhaps
• Start to tank
• Migrate, maybe
• Take a turn for the worse
• Deteriorate, slangily
• Leave for the winter, say
• Turn bad