Marzena Karpinska

Why they matter

Researcher with public evidence across AI research, Culture, work & education, Evaluation & benchmarks.

AI signals
5
past 30d
Sources
5
distinct domains
Discussions
1
past 30d
Latest signal
13d ago
View every signal from Marzena Karpinska →
#nlp researcher interested in evaluation including: multilingual models, long-form input/output, processing/generation of creative texts previous: postdoc @ umass_nlp phd from utokyo https://marzenakrp.github.io/

Articles & links

One more thing @tuhinchakr.bsky.social 's post reminded me of... people tend to rationalize and see things not there. We saw it already in GPT-2 stories - we *expect* things to *mean* something, so we tend to see things that are not there... (link to this old paper: aclantholo…

aclanthology.org
View on Bluesky · ♥ 2 ↻ 2 ↩ 0 · 2 from the directory shared this · 149d ago

and of course you get all the usual: Paper: arxiv.org/abs/2610.06778 Models & Datasets: hf.co/collections/... Github: github.com/RishanthRaje... PyPi: pypi.org/project/idea... + You can test both detectors on Tinker API for as low as $1 for 1K documents.

IdeaLens: Detecting AI Ideas in Long-form Writing arxiv.org
AI Weekly's analysis →
  • IdeaLens reframes AI detection around idea provenance by representing each document as an outline of discourse-role plus paraphrased content.
  • On 50 stories humans wrote from AI-generated plans, IdeaLens flagged 68% as AI versus 8% for Pangram 4, a prose-level detector.
  • The system was trained on 1M FineWeb documents with silver labels from Pangram and tested across 19 existing detection benchmarks.
Read full analysis →
View on Bluesky · ♥ 1 ↻ 0 ↩ 1 · 2 from the directory shared this · 13d ago

and of course you get all the usual: Paper: arxiv.org/abs/2610.06778 Models & Datasets: hf.co/collections/... Github: github.com/RishanthRaje... PyPi: pypi.org/project/idea... + You can test both detectors on Tinker API for as low as $1 for 1K documents.

Client Challenge pypi.org
View on Bluesky · ♥ 1 ↻ 0 ↩ 1 · 13d ago

Slop-eds are on the rise and seem to remain undisclosed. Please check out update to our audit of AI in news: ainewsaudit.github.io This work will be presented next week at #ACL2026 (Sunday 4:00-5:30 oral session)

AI News Audit - Search Articles ainewsaudit.github.io
View on Bluesky · ♥ 0 ↻ 0 ↩ 1 · 2 from the directory shared this · 116d ago

Recent commentary

Can you tell whether the #ideas in a piece of writing came from a human or an AI? As AI writing becomes common, policies on AI use focus on who came up with the ideas in the text rather than who wrote it. AI detectors answer the latter, not the former. We release #IdeaLens, a detector of AI ideas.

View on Bluesky · ♥ 41 ↻ 14 ↩ 2 · 13d ago

I think I will be posting this after each #ARR cycle: Please 🥺🙏 let's prohibit AI review writing. Otherwise, we will get lazy reviewers claiming they wrote bullet points and used AI only to put that in prose.

View on Bluesky · ♥ 19 ↻ 4 ↩ 1 · 103d ago

Great message from @barbaraplank.bsky.social unifying CL & NLP

View on Bluesky · ♥ 3 ↻ 1 ↩ 0 · 105d ago

In the spirit of #paperoverflow looking for emergency reviewers: - aspect-based summarization - hallucination detection - evaluation invariance - evaluation, evaluation bias - fine-grained evaluation for some, the reviewers filled in delay but became unresponsive later HELP, this house is on fire 🔥

View on Bluesky · ♥ 0 ↻ 2 ↩ 0 · 105d ago

In Marzena Karpinska's orbit

Center = Marzena Karpinska. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.

Are you Marzena Karpinska? Show it.

Add the Who’s Who of AI badge to your site or bio. It links back to this profile.

Listed in AI Weekly's Who's Who of AI

Markdown: [![Listed in AI Weekly's Who's Who of AI](https://aiweekly.co/modules/custom/aiweekly_whoswho/images/whoswho-badge.svg)](https://aiweekly.co/whos-who/person/markar-bsky-social)