Topic cluster

research

10 sources grouped by AFBytes in Tech

AFBytes briefing

Open resources for legal text processing may gradually support more efficient analysis of regulatory documents affecting businesses and compliance costs.

Key entities

  • Abstract
Tech arxiv.org · Jun 1, 2026 04:00 UTC

Structured Generalized Linear Token Mixing Tradeoffs

The authors investigate structured generalized linear approaches to token mixing as a way to balance complexity against expressivity. The focus is architectural tradeoffs in sequence modeling.

Tech arxiv.org · Jun 1, 2026 04:00 UTC

Softsign Optimizer for Parameter Heterogeneity

Softsign is introduced as a smooth alternative to the sign function within optimizers. The goal is improved handling of heterogeneous parameter scales during training.