Small-scale study: 16 law professors were asked to judge short-answer Q&A practice materials written by one of the other 15 professors, or generated by an LLM (Gemini 2.5 Pro). They preferred the LLM materials in 75% of cases, with fairly strong inter-rater agreement. Has some…
Mark J. Nelson
Researcher with public evidence across AI research.
- AI signals
- 6 past 30d
- Sources
- 6 distinct domains
- Discusiones
- 48 past 30d
- Latest signal
- 9h ago
Articles & links
finally some off-the-grid local AI
- CrankGPT runs a full voice-interactive AI pipeline on a Raspberry Pi 5 with 8GB RAM, powered solely by a 20W hand-crank generator.
- Cold-start to functional conversation takes roughly 30 seconds; time to first token ranges from 0.8 to 2.9 seconds depending on model size.
- Memory bandwidth, not raw compute, is the primary bottleneck for on-device LLM inference, with DDR5 hardware achieving 29-58% faster token generation than DDR4.
did you see this one a few months ago?
Kind of reassuring to read that one of the biggest current problems in ML for drug discovery isn't any kind of exotic new AI/ML problem but just, still, the difficulty of preventing data leakage from the test set.
Dealing with too many submissions to TMLR by deriving "a Generalized Harmonic Quota Rule, a framework that subsumes the Harmonic Quota Rule and other natural quota rules" in a 12-page paper is a very The Machine Learning Community solution to this particular problem.
Many openings for Assistant Professors in Computer Science at Maastricht University! Areas of interest include Programming Languages and AI+PL/SE (among others). Deadline August 16.
Assistant/Associate Professor opening at the University of Southern Denmark in games & interactive technologies; focus areas Human-Computer/AI Interaction, data science, and AI. Deadline August 1.
Recent commentary
Underreported thing about Gemini (more than other LLMs I think) is that it's an ok replacement for Google Books, and fluidly multilingual. Like I can ask a question and request answers be based only on books by a specific academic (which are in Greek) and it will dig up relevant passages.
A reason I've pulled back from reviewing for big AI conferences is a feeling that I'm doing unpaid supervision of other people's PhD students. Too many ppl submitting 10+ papers to a single conference where I doubt the prof whose name is on the paper has done a thorough review & revision themselves.
Not a strongly held opinion, but I'm a little skeptical of the recent LLM math results not really being compared against baseline search methods with similar compute budgets. Some of them are using pretty huge compute budgets!
An interesting thing about LLMs in Python is that they seem to broadly push code towards some kind of conventional wisdom about best practices, as judged maybe by whoever is setting up the posttraining recipes (I say "in Python" mostly because I notice that more strongly in Python).
A thing LLM coding sort of makes more feasible is making *smaller* personalized apps. Like instead of WMATA's big and annoying to use transit app, I'm trying out a custom little thing that just shows me the 2 bus lines I take. Lines hardcoded; stops hardcoded; no configuration; barely any interface.
Asked Gemini something about DC apartment logistics, and it recommended I "pop down to the front desk" to verify. Takeover of Google AI by DeepMind Londoners confirmed.
Isabelle/Isar has a nicely named proof method, blast, that tries to brute force, letting you concisely prove simple but tedious lemmas by just writing 'thus "Q" by blast', which'll go through if in fact blast can prove it. In good cases, LLMs feel kind of like that for me now: pip install by blast.
A pop AI book where the two people contributing blurbs were Al Gore and Sam Altman. A little microcosm of 2018.
In Mark J. Nelson's orbit
Center = Mark J. Nelson. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.