Thinking Machines releases Inkling 2 Mini, a small open-weights model for local use
Thinking Machines released Inkling 2 Mini, an open-weights model that it says is small enough to run on a laptop. The model is a looped transformer that runs its middle layers three times for each token, which the company says lets it reach answers with fewer tokens. It has 26.4B total parameters, 3.4B active, and a total memory footprint of ~20GB. The company says it leads open-weights models with less than 100B total parameters on DeepSWE v1.1 (48.2%) and Vals Index v2.2 (46.5%).
Link to this story