Pasquale Minervini

Why they matter

Researcher with public evidence across Models & releases, AI business, AI research.

AI signals
3
past 30d
Sources
1
distinct domains
Discussions
0
past 30d
Latest signal
6d ago
View every signal from Pasquale Minervini →
Researcher in ML/NLP at the University of Edinburgh (faculty at Informatics and EdinburghNLP), Co-Founder/CTO at www.miniml.ai, ELLIS (@ELLIS.eu) Scholar, Generative AI Lab (GAIL, https://gail.ed.ac.uk/) Fellow -- www.neuralnoise.com, he/they

Articles & links

3/5 Which heads retrieve answers that aren't literally in the context? LOCOS, led by @aryopg.bsky.social, with @beatricealex.bsky.social, measures what each head writes toward the answer token, rather than just where it attends. https://arxiv.org/abs/2607.01002

Logit-Contribution Scoring Identifies Non-Literal Retrieval Heads arxiv.org
AI Weekly's analysis →
  • LOCOS scores each attention head by projecting its OV-circuit output onto the answer-token unembedding direction in a single forward pass.
  • On Qwen3-8B, ablating the top 50 LOCOS heads drove NoLiMa ROUGE-L from 0.401 to 0.000; the strongest baseline still retained 0.292.
  • The same ablation dropped MuSiQue from 0.55 to 0.08 and BABI-Long from 0.62 to 0.20 while parametric recall and arithmetic stayed at baseline.
Read full analysis →
View on Bluesky · ♥ 1 ↻ 0 ↩ 1 · 6d ago

New blog post on our {ICML, ACL} 2026 papers, plus some new interesting results on open-ended learning and multi-modal retrieval! neuralnoise.com/2026/icml-ac...

{ICML, ACL} 2026 neuralnoise.com
View on Bluesky · ♥ 4 ↻ 0 ↩ 0 · 100d ago

Recent commentary

1/5 My colleagues and collaborators will present a few papers at NeurIPS later this year! 🚀 Self-play for open-ended tasks, non-literal retrieval heads, shortcuts in multimodal benchmarks, and a psychophysics-based approach to AI evaluation. A quick tour below. Blog post underway!

View on Bluesky · ♥ 1 ↻ 0 ↩ 1 · 6d ago

In Pasquale Minervini's orbit

Center = Pasquale Minervini. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.

Are you Pasquale Minervini? Show it.

Add the Who’s Who of AI badge to your site or bio. It links back to this profile.

Listed in AI Weekly's Who's Who of AI

Markdown: [![Listed in AI Weekly's Who's Who of AI](https://aiweekly.co/modules/custom/aiweekly_whoswho/images/whoswho-badge.svg)](https://aiweekly.co/whos-who/person/neuralnoise-com)