Mark J. Nelson

Why they matter

Researcher with public evidence across AI research.

AI signals
6
past 30d
Sources
6
distinct domains
Discussions
48
past 30d
Latest signal
8h ago
View every signal from Mark J. Nelson →
Comp. sci. prof. @ American University, Washington DC. AI & games researcher with miscellaneous other interests. https://www.kmjn.org/

Articles & links

Small-scale study: 16 law professors were asked to judge short-answer Q&A practice materials written by one of the other 15 professors, or generated by an LLM (Gemini 2.5 Pro). They preferred the LLM materials in 75% of cases, with fairly strong inter-rater agreement. Has some…

law.stanford.edu
View on Bluesky · ♥ 3 ↻ 1 ↩ 1 · 3 from the directory shared this · 56d ago
Mark J. Nelson reposted
Ai2 @ai2.bsky.social

Our fully open releases give researchers the data, code, checkpoints, and methods they need to inspect claims, reproduce findings, and advance new science. Read more about why that’s so important to us. ⬇️ allenai.org/blog/who-get...

Who gets to understand AI? | Ai2 allenai.org
AI Weekly's analysis
  • Ai2 argues meaningful AI transparency requires not just open weights but training data, code, methods, checkpoints, evaluations, and documentation.
  • Post cites three studies enabled by open Olmo releases, covering clinical demographic bias, benchmark inflation, and how models reason about drug names.
  • Without that access, Ai2 warns, technical direction of the field risks becoming concentrated inside a small number of companies.
Read full analysis →
View on Bluesky →

finally some off-the-grid local AI

CrankGPT — fully offline, human-powered local AI squeezlabs.github.io
AI Weekly's analysis
  • CrankGPT runs a full voice-interactive AI pipeline on a Raspberry Pi 5 with 8GB RAM, powered solely by a 20W hand-crank generator.
  • Cold-start to functional conversation takes roughly 30 seconds; time to first token ranges from 0.8 to 2.9 seconds depending on model size.
  • Memory bandwidth, not raw compute, is the primary bottleneck for on-device LLM inference, with DDR5 hardware achieving 29-58% faster token generation than DDR4.
Read full analysis →
View on Bluesky · ♥ 35 ↻ 8 ↩ 3 · 7 from the directory shared this · 49d ago
Mark J. Nelson reposted
Raphaël Millière @raphaelmilliere.com

Now published in open access! Your one-stop shop for the philosophy of language models. It's the spiritual descendant of our two-part preprint from 2024, fully updated. This should be particularly useful for anyone looking for an entry point into this rapidly growing field.

compass.onlinelibrary.wiley.com View on Bluesky →

Kind of reassuring to read that one of the biggest current problems in ML for drug discovery isn't any kind of exotic new AI/ML problem but just, still, the difficulty of preventing data leakage from the test set.

science.org
View on Bluesky · ♥ 6 ↻ 0 ↩ 0 · 2d ago
Mark J. Nelson reposted
@aiide.bsky.social

Consider sponsoring the AAAI AIIDE conference in Belo Horizonte, Brazil! Your support will help motivate cutting-edge advancements in Game AI and creative technologies while giving you access to the best global talent in the field. Get involved: sites.google.com/view/aiide20...

AIIDE 2026 - Sponsors sites.google.com View on Bluesky →

Recent commentary

Underreported thing about Gemini (more than other LLMs I think) is that it's an ok replacement for Google Books, and fluidly multilingual. Like I can ask a question and request answers be based only on books by a specific academic (which are in Greek) and it will dig up relevant passages.

View on Bluesky · ♥ 37 ↻ 4 ↩ 1 · 32d ago

A reason I've pulled back from reviewing for big AI conferences is a feeling that I'm doing unpaid supervision of other people's PhD students. Too many ppl submitting 10+ papers to a single conference where I doubt the prof whose name is on the paper has done a thorough review & revision themselves.

View on Bluesky · ♥ 15 ↻ 0 ↩ 1 · 60d ago

An interesting thing about LLMs in Python is that they seem to broadly push code towards some kind of conventional wisdom about best practices, as judged maybe by whoever is setting up the posttraining recipes (I say "in Python" mostly because I notice that more strongly in Python).

View on Bluesky · ♥ 11 ↻ 0 ↩ 2 · 46d ago

Not a strongly held opinion, but I'm a little skeptical of the recent LLM math results not really being compared against baseline search methods with similar compute budgets. Some of them are using pretty huge compute budgets!

View on Bluesky · ♥ 9 ↻ 0 ↩ 1 · 5h ago

A thing LLM coding sort of makes more feasible is making *smaller* personalized apps. Like instead of WMATA's big and annoying to use transit app, I'm trying out a custom little thing that just shows me the 2 bus lines I take. Lines hardcoded; stops hardcoded; no configuration; barely any interface.

View on Bluesky · ♥ 9 ↻ 0 ↩ 1 · 50d ago

Asked Gemini something about DC apartment logistics, and it recommended I "pop down to the front desk" to verify. Takeover of Google AI by DeepMind Londoners confirmed.

View on Bluesky · ♥ 8 ↻ 0 ↩ 0 · 60d ago

Isabelle/Isar has a nicely named proof method, blast, that tries to brute force, letting you concisely prove simple but tedious lemmas by just writing 'thus "Q" by blast', which'll go through if in fact blast can prove it. In good cases, LLMs feel kind of like that for me now: pip install by blast.

View on Bluesky · ♥ 5 ↻ 0 ↩ 0 · 65d ago

A pop AI book where the two people contributing blurbs were Al Gore and Sam Altman. A little microcosm of 2018.

View on Bluesky · ♥ 3 ↻ 0 ↩ 0 · 70d ago

In Mark J. Nelson's orbit

Center = Mark J. Nelson. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.