For a premature baby with breathing difficulty and cyanosis, oxygen therapy is typically the first step in managing the condition. Oxygen supplementation helps improve oxygen saturation levels and may prevent further complications related to respiratory distress in premature infants.