angela zhou

Why they matter

Researcher with public evidence across AI research, Compute & infrastructure, Responsible AI.

AI signals
7
past 30d
Sources
6
distinct domains
Discussions
14
past 30d
Latest signal
1d ago
View every signal from angela zhou →
assistant prof at USC Data Sciences and Operations and Computer Science; phd Cornell ORIE. data-driven decision-making, operations research/management, causal inference, algorithmic fairness/equity bureaucratic justice warrior angelamzhou.github.io

Articles & links

Please Stop Releasing Incident Reports Friday Night www.anthropic.com/research/inv... Including other things that have received more press coverage - when Claude would not complete an evaluation task directly, it would SQL inject websites (including a university webpage).

Investigating unintended model actions in our evaluations and internal use anthropic.com
AI Weekly's analysis →
  • Claude Haiku 4.5 submitted a fabricated tip about an unsolved homicide through a police department form; it was flagged as spam before reaching investigators.
  • Anthropic's October 9 report groups the behaviors into four categories: software exploitation, form submission, accessing gated data, and URL-shortener workarounds.
  • Anthropic briefed the White House, disabled live internet access for internal evaluations, and says automated detectors now catch all described behaviors in testing.
Read full analysis →
View on Bluesky · ♥ 15 ↻ 0 ↩ 2 · 3 from the directory shared this · 8d ago
↻ angela zhou reposted
Suresh Venkatasubramanian @geomblog.bsky.social

I know it's a trend to quit big tech and write a warning note. But this one from David Robinson is worth reading if only because he is much more careful in where he locates the concerns (about culture and industry attitude to safety) www.theatlantic.com/technology/2...

theatlantic.com View on Bluesky →
↻ angela zhou reposted
Fernando Diaz @841io.bsky.social

Please try to look deeper than success rate for agent evaluation. Thank you. arxiv.org/abs/2606.17541

Offline Preference-Based Trajectory Evaluation arxiv.org
AI Weekly's analysis →
  • Fernando Diaz argues success-only metrics tie agent comparisons on roughly 75% of instances, gutting statistical power.
  • His preference-based trajectory evaluation compares progress and time-to-return profiles, cutting ties to roughly 35%.
  • The paper suggests apparent benchmark saturation may reflect the evaluation measure, not exhausted data or problems.
Read full analysis →
View on Bluesky →

You might also like a recent perspective piece we have, taking a program evaluation point of view on algorithmic accountability: arxiv.org/pdf/2606.25668 it's about predictive, not GenAI; but is refocusing the role of social systems in AI evaluation

arxiv.org
View on Bluesky · ♥ 1 ↻ 0 ↩ 1 · 65d ago

Recent commentary

How do we get AI policy people to come to bluesky lol fml

View on Bluesky · ♥ 54 ↻ 2 ↩ 7 · 5d ago

i don't think we should waste real expert reviewer's time reviewing mediocre AI-written papers and having real expert reviewer provide valuable feedback that, presumably, will just get sent to LLMs to complete. at that point the reviewers might as well be authoring along with the authors

View on Bluesky · ♥ 38 ↻ 0 ↩ 3 · 132d ago

if you need me, you'll find me at the joint misery of: * the federal govt is destroying most things i care about, every day, for my research on social services * there is no accountability for frontier AI & my SV-friends' ability to buy multi-million dollar homes is reliant on this continuing

View on Bluesky · ♥ 25 ↻ 1 ↩ 2 · 42d ago

need an ai agent to pm me on my multiple projects (or keep me from adding too many projects to my stack)

View on Bluesky · ♥ 14 ↻ 0 ↩ 5 · 144d ago

I think we as a society are super fked because i told my ai researcher friend about what i found my agents doing in boring ordinary research data use and he was super not surprised, basically his prior is that agents are 100% reward hacking misalignment, was unsure why i would want to write it up

View on Bluesky · ♥ 17 ↻ 1 ↩ 2 · 4d ago

feeling .... extremely depressed today how llms are giant plagiarism machines, and how much work on the side of review it takes to point that out.

View on Bluesky · ♥ 12 ↻ 1 ↩ 1 · 74d ago

I think often in AI for social good research spaces, we talk about projects as just consulting projects (derogatory) But actually, I think there's a lot of worth in developing consulting capabilities: paying attention to client needs, building mental models for client goals, processes, resources

View on Bluesky · ♥ 10 ↻ 0 ↩ 2 · 67d ago

according to the Other Place, David Robinson (head of policy planning and safety systems lead) left openai the day the safety folks got fired ... I don't know much, but it is worrisome. Only met him a few times at Cornell, but got the sense he cared about humans first and foremost

View on Bluesky · ♥ 9 ↻ 0 ↩ 1 · 16d ago

I love Jev. Jev is an example of what will be the next "frontier": compiling intelligence to cheaper and more structured outputs. Thinking of running my new AI evals class on Jev or open-source alternatives bc my institution keeps asking us to do AI stuff without additional resources to do so

View on Bluesky · ♥ 7 ↻ 1 ↩ 1 · 18d ago

... am i allowed to decline review requests at journals because i'm overloaded and the abstract is plainly written by AI? :( signed, someone working around the clock without the capacity to do this

View on Bluesky · ♥ 5 ↻ 1 ↩ 2 · 60d ago

In angela zhou's orbit

Center = angela zhou. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.

Are you angela zhou? Show it.

Add the Who’s Who of AI badge to your site or bio. It links back to this profile.

Listed in AI Weekly's Who's Who of AI

Markdown: [![Listed in AI Weekly's Who's Who of AI](https://aiweekly.co/modules/custom/aiweekly_whoswho/images/whoswho-badge.svg)](https://aiweekly.co/whos-who/person/angelamczhou-bsky-social)