Multiple readings
Opportunity & adoption · 1
Questions & unknowns · 1
Liz Fong-Jones (方禮真): the cache read price decrease is nice at least for those of us who are locked into big A\ contracts
Liz Fong-Jones (方禮真): I gotta ask though, why does higher tok/sec matter? I find I go horizontal with concurrent work rather than trying to power through any 1 thing at LLM token generation speed, plus you eventually bo…
Open the thread →