Small-scale study: 16 law professors were asked to judge short-answer Q&A practice materials written by one of the other 15 professors, or generated by an LLM (Gemini 2.5 Pro). They preferred the LLM materials in 75% of cases, with fairly strong inter-rater agreement. Has some…
Mark J. Nelson
Articles & links
finally some off-the-grid local AI
Assistant/Associate Professor opening at the University of Southern Denmark in games & interactive technologies; focus areas Human-Computer/AI Interaction, data science, and AI. Deadline August 1.
Intriguing-looking postdoc on human-centric reinforcement learning, part of "an interdisciplinary project between artificial intelligence, social sciences, and societal partners". At TU Eindhoven with Hendrik Baier, deadline July 9. www.tue.nl/en/working-a...
Recent commentary
A reason I've pulled back from reviewing for big AI conferences is a feeling that I'm doing unpaid supervision of other people's PhD students. Too many ppl submitting 10+ papers to a single conference where I doubt the prof whose name is on the paper has done a thorough review & revision themselves.
An interesting thing about LLMs in Python is that they seem to broadly push code towards some kind of conventional wisdom about best practices, as judged maybe by whoever is setting up the posttraining recipes (I say "in Python" mostly because I notice that more strongly in Python).
A thing LLM coding sort of makes more feasible is making *smaller* personalized apps. Like instead of WMATA's big and annoying to use transit app, I'm trying out a custom little thing that just shows me the 2 bus lines I take. Lines hardcoded; stops hardcoded; no configuration; barely any interface.
Asked Gemini something about DC apartment logistics, and it recommended I "pop down to the front desk" to verify. Takeover of Google AI by DeepMind Londoners confirmed.
Isabelle/Isar has a nicely named proof method, blast, that tries to brute force, letting you concisely prove simple but tedious lemmas by just writing 'thus "Q" by blast', which'll go through if in fact blast can prove it. In good cases, LLMs feel kind of like that for me now: pip install by blast.
A pop AI book where the two people contributing blurbs were Al Gore and Sam Altman. A little microcosm of 2018.
In Mark J. Nelson's orbit
Center = Mark J. Nelson. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.