Opt.Gear Technical Report

We introduce Opt.Gear, a foundation model designed for efficient on-device deployment, real-tim inference, and strong task capability.

We introduce Opt.Gear, a foundation model designed for efficient on-device deployment, real-tim inference, and strong task capability. It includes a dense model (1M, 270M, and 1B) with a context length of 64K. We designed a new hybrid architecture that combines a convolutional…