James MacGlashan: An open model with this performance is great, but perhaps more striking is it looks like it's a hybrid model with 3/4th linear attention and 1/4 standard attention. This kind of performance with a …
Tim Kellogg: no most models have been hybrid for the last, oh probably the whole last year
Open the thread →