The acceleration of the system is given by:
\[ a = \frac{m_2 - m_1}{m_1 + m_2} g \]
Given \(a = \frac{g}{\sqrt{2}}\), substitute in the equation:
\[ \frac{g}{\sqrt{2}} = \frac{m_2 - m_1}{m_1 + m_2} g \]
Simplifying:
\[ \frac{1}{\sqrt{2}} = \frac{m_2 - m_1}{m_1 + m_2} \]
Cross-multiplying:
\[ \sqrt{2}(m_2 - m_1) = m_1 + m_2 \]
Rearranging:
\[ m_1(\sqrt{2} + 1) = m_2(\sqrt{2} - 1) \]
The ratio of masses is:
\[ \frac{m_1}{m_2} = \frac{\sqrt{2} - 1}{\sqrt{2} + 1} \]