Juan Diego Rodriguez

Why they matter

Researcher with public evidence across AI research, NLP & language.

AI signals
5
past 30d
Sources
5
distinct domains
Discussions
32
past 30d
Latest signal
5d ago
View every signal from Juan Diego Rodriguez →
CS PhD student at UT Austin in #NLP Interested in language, reasoning, semantics and cognitive science. One day we'll have more efficient, interpretable and robust models! Other interests: math, philosophy, cinema https://www.juandiego-rodriguez.com/

Articles & links

Juan Diego Rodriguez reposted
@zoltanv.bsky.social

wow, the Huggingface guys made an annotated version of Magnifica Humanitas huggingface.co/spaces/socie...

The Annotated Encyclical - a Hugging Face Space by society-ethics huggingface.co
AI Weekly's analysis
  • Hugging Face's society-ethics team added 105 scholarly AI ethics citations to Pope Leo XIV's May 2026 encyclical Magnifica Humanitas.
  • The encyclical declares technology 'is never neutral' and warns that 'never has humanity had such power over itself.'
  • The annotation project is open for community contributions linking academic AI ethics research to the papal document.
Read full analysis →
View on Bluesky →

2) Characterizing Narrative Content in Web-scale LLM Pretraining Data, by @teagrjohnson.bsky.social, @elliottash.bsky.social, @andrewpiper.bsky.social, @mariaa.bsky.social arxiv.org/abs/2606.19468 Why: annotation and analysis of narrative features across the pretraining data (…

Characterizing Narrative Content in Web-scale LLM Pretraining Data arxiv.org
AI Weekly's analysis
  • A new arXiv preprint introduces NarraBERT, a RoBERTa-based classifier, and applies it to 3 million passages from the 3-trillion-token Dolma corpus.
  • The framework operationalizes three narrative elements, agency, setting, and events, across 11 interpretable dimensions, trained on 400 annotated passages.
  • The authors report narrative qualities are unequally distributed across pretraining sources and topics in ways current curation practices do not measure.
Read full analysis →
View on Bluesky · ♥ 4 ↻ 1 ↩ 1 · 3 from the directory shared this · 69d ago
Juan Diego Rodriguez reposted
Frank Pasquale @frankpasquale.bsky.social

Those “who own our algorithms, who own our cable news networks . . . they and their platforms are engineering our emotions so they can profit off our pain. They are selling us conflict, and they’re calling it connection.” www.ft.com/content/63e8...

ft.com View on Bluesky →

An incomplete list: 1) Explaining Attention with Program Synthesis, by Amiri Hayes, @belindazli.bsky.social and arxiv.org/abs/2606.19317 Why: LMs can generate code that can explain/replace attention heads! 🤯 (Program synthesis 🤝 Interpretability)

[2606.19317] Explaining Attention with Program Synthesis arxiv.org
AI Weekly's analysis
  • Under 1,000 LM-generated programs reproduce attention patterns in GPT-2, TinyLlama-1.1B and Llama-3B with above 75% average IoU on TinyStories.
  • Replacing 25% of attention heads with the synthesized programs raised average perplexity by only 16% while keeping downstream question-answering performance.
  • The pipeline computes a head's attention matrices, prompts a pretrained LM to write Python that reproduces them, then re-ranks by held-out accuracy.
Read full analysis →
View on Bluesky · ♥ 0 ↻ 0 ↩ 1 · 3 from the directory shared this · 69d ago
Juan Diego Rodriguez reposted
Eugene Vinitsky @eugenevinitsky.bsky.social

Does physical modeling matter or should we just do data-driven stuff? I feel like this paper characterizes things perfectly: arxiv.org/abs/2410.23179. Physics-based modeling is always helpful but the relative gain closes at scale

Does equivariance matter at scale? arxiv.org
AI Weekly's analysis
  • In rigid-body interaction experiments with transformers, equivariant models beat non-equivariant ones at every tested compute budget.
  • Non-equivariant networks trained with data augmentation can close the data-efficiency gap, but only given sufficient training epochs.
  • Optimal compute allocation between model size and training steps differs significantly between equivariant and non-equivariant architectures.
Read full analysis →
View on Bluesky →

4) Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention arxiv.org/abs/2605.29548

Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention arxiv.org
AI Weekly's analysis
  • The paper argues power-law scaling already implies a larger model will learn parts of the data distribution a smaller model cannot, even with infinite training data.
  • Pretraining experiments on OLMo models from 4M to 4B parameters found only the larger models learned the infrequent and complex tasks.
  • The proposed mechanism is reduced gradient interference: weaker common-task updates leave rare-task features intact in larger models.
Read full analysis →
View on Bluesky · ♥ 1 ↻ 0 ↩ 1 · 2 from the directory shared this · 69d ago

"I do not understand why anyone who believes that AI will eliminate most jobs and much of humanity’s relevance would rush to build that future." Really???? The answer is money about.fb.com/news/2026/08...

about.fb.com
View on Bluesky · ♥ 4 ↻ 0 ↩ 1 · 9 from the directory shared this · 28d ago

Does anyone know why MASS (arxiv.org/pdf/1905.02450) didn't take off, while BART did? (OK maybe no one remembers BART today, but it was popular around 2019-2022)

arxiv.org
View on Bluesky · ♥ 6 ↻ 1 ↩ 1 · 2 from the directory shared this · 70d ago

Recent commentary

Tip on reviewing ARR papers in 2026: - Check the references FIRST. I wasted 40 minutes reviewing a paper before realizing the references were LLM-generated.

View on Bluesky · ♥ 31 ↻ 12 ↩ 5 · 77d ago

So much academic writing is bland and uninspiring. And LLMs will make it worse. What your favorite examples of *good* writing?

View on Bluesky · ♥ 13 ↻ 1 ↩ 6 · 22d ago

Excited to teach my first ML class tomorrow!

View on Bluesky · ♥ 22 ↻ 0 ↩ 2 · 13d ago

If we over-rely on LLMs for science, I fear we will remain stuck in the convex hull of what already exists. Is anyone studying this?

View on Bluesky · ♥ 16 ↻ 0 ↩ 5 · 22d ago

I'm so tired of seeing LLM-generated reviews. They just wasting all our time. If this continues, "peer review" will mean nothing

View on Bluesky · ♥ 11 ↻ 1 ↩ 3 · 75d ago

It was a pleasure to moderate the panel at the ACL 2026 SRW: "The next big questions in NLP: What should students work on?" Huge thanks to our panelists, @boydgraber.bsky.social, @igurevych.bsky.social, Preslav Nakov and Yulia Tsvetkov for their thoughtful answers and helpful advice! Takeaways 👇

View on Bluesky · ♥ 12 ↻ 2 ↩ 1 · 49d ago

I wish I could just go to an island, no internet, no deadlines, no AI. Just a library, a coffeeshop, and people to collaborate with.

View on Bluesky · ♥ 11 ↻ 0 ↩ 2 · 28d ago

Claude keeps making the stupidest mistakes, mistakes no person would make. The problem with AI is it’s so hard to form a mental model to predict or understand its failures, the way we do with other people.

View on Bluesky · ♥ 12 ↻ 0 ↩ 1 · 18d ago

I asked GPT 5.6 Sol to solve the Collatz conjecture. Why is it searching the NOAA fisheries website??

View on Bluesky · ♥ 4 ↻ 0 ↩ 5 · 44d ago

It's crazy to think it took only 4 years to go from "LLMs are only good for generating misinformation at scale" to them proving new theorems, writing code, and writing (mostly) accurate literature surveys.

View on Bluesky · ♥ 10 ↻ 0 ↩ 1 · 35d ago

In Juan Diego Rodriguez's orbit

Center = Juan Diego Rodriguez. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.

Are you Juan Diego Rodriguez? Show it.

Add the Who’s Who of AI badge to your site or bio. It links back to this profile.

Listed in AI Weekly's Who's Who of AI

Markdown: [![Listed in AI Weekly's Who's Who of AI](https://aiweekly.co/modules/custom/aiweekly_whoswho/images/whoswho-badge.svg)](https://aiweekly.co/whos-who/person/juand-r-bsky-social)