Spectral Regularization

Think Wider: Mitigating Latent Rank Collapse in Implicit Chain-of-Thought Reasoning featured image

Think Wider: Mitigating Latent Rank Collapse in Implicit Chain-of-Thought Reasoning

A spectral regularization method for improving latent-token diversity and mitigating rank collapse in implicit reasoning.

avatar
Yuwen Hao
•