Reddit - The heart of the internet

[D] Some thoughts about an elephant in the room no one talks about

Using a throwaway account for obvious reasons.

I am going to say something uncomfortable. A large fraction of senior researchers today care almost exclusively about publications, and they have quietly outsourced their educational/mentorship responsibility to social media. This year’s ICLR has been a bit of a mess, and while there are multiple reasons, this is clearly part of it. The issue is not just OpenReview leak or AC overload. It is that we have systematically failed to train researchers to reason, and the consequences are now visible throughout the system.

I have been on both sides of the process for so many times, submitting and reviewing, and the same problems appear repeatedly. Many junior researchers, even those with strong publication records, have never received systematic research training. They are not trained in how to think through design choices, reason about tradeoffs, frame contributions, or evaluate ideas in context. Instead, they are trained to optimize outcomes such as acceptance probability, benchmarks, and reviewer heuristics. There is little shared logic and no long-term vision for the field, only throughput.

This vacuum is why social media has become a substitute for mentorship. Every day I see posts asking how to format rebuttals, how the review process works, how to find collaborators, or what reviewers expect. These are reasonable questions, but they should be answered by advisors, not by Reddit, X, or Rednote. And this is not a cultural issue. I read both Chinese and English. The patterns are the same across languages, with the same confusion and surface-level optimization.

The lack of research judgment shows up clearly in reviews. I often see authors carefully argue that design choice A is better than design choice B, supported by evidence, only to have reviewers recommend rejection because performance under B is worse. I also see authors explicitly disclose limitations, which should be encouraged, and then see those limitations used as reasons for rejection. This creates perverse incentives where honesty is punished and overclaiming is rewarded. As a reviewer, I have stepped in more than once to prevent papers from being rejected for these reasons. At the same time, I have also seen genuinely weak papers doing incoherent or meaningless things get accepted with positive reviews. This inconsistency is not random. It reflects a community that has not been trained to evaluate research as research, but instead evaluates artifacts competing for acceptance.

What makes this especially concerning is that these behaviors are no longer limited to junior researchers. Many of the people enabling them are now senior. Some never received rigorous academic training themselves. I have seen a new PI publicly say on social media that they prefer using LLMs to summarize technical ideas for papers they review. That is not a harmless trick but an unethical violation. I have heard PIs say reading the introduction is a waste of time and they prefer to skim the method. These are PIs and area chairs. They are the ones deciding careers.

This is how the current situation emerged. First came LLM hallucinations in papers. Then hallucinations in reviews. Now hallucinations in meta-reviews. This progression was predictable once judgment was replaced by heuristics and mentorship by informal online advice.

I am not against transparency or open discussion on social media. But highly specialized skills like research judgment cannot be crowdsourced. They must be transmitted through mentorship and training. Instead, we have normalized learning research through social media, where much of the advice given to junior researchers is actively harmful. It normalizes questionable authorship practices, encourages gaming the system, and treats research like content production.

The most worrying part is that this has become normal.

We are not just failing to train researchers. We are training the wrong incentives into the next generation. If this continues, the crisis will not be that LLMs write bad papers. The crisis will be that few people remember what good research judgment looks like.

We are not there yet.

But we are close.