Researchers Question Transparency of X Algorithm Code Release

X's recent release of its recommendation algorithm code has drawn criticism from researchers, who describe it as heavily redacted and of limited transparency. Despite claims of openness, experts highlight the absence of key decision-making details and the growing opaqueness resulting from neural network-based ranking. The lack of access to training data and model weightings leaves substantial gaps for those seeking to evaluate or reproduce X’s system.

ShareShare

X, the social media platform, recently released portions of the source code behind its 'For You' recommendation algorithm, claiming to promote unprecedented transparency among major platforms. Elon Musk, the owner of X, framed the move as a significant step forward for openness in social media: “At least you can see us struggle to make it better in real-time and with transparency.”

However, leading AI researchers and computer scientists have raised doubts about the usefulness of the disclosure. John Thickstun, assistant professor of computer science at Cornell University, characterized the publication as a “redacted” version that does not enable meaningful independent analysis. “What troubles me about these releases is that they give you a pretense that they’re being transparent... and the fact is that that’s not really possible at all,” Thickstun told Engadget.

After the code’s publication, users on X began sharing speculative guides on how to optimize their posts, suggesting strategies such as prioritizing conversation or video content. Yet researchers caution against drawing conclusions from the release, as the code omits substantial operational detail. Visible rules, such as filtering out posts older than one day, offer only a limited glimpse into the system’s workings.

A major structural change from the 2023 algorithm is that post ranking now hinges on a large language model, described as "Grok-like," instead of explicit, hard-coded interaction metrics. Previously, likes, shares, and replies had fixed values influencing rankings; now, the model predicts user engagement based on neural network outputs. Neural networks, a type of AI model loosely inspired by the brain, learn decision patterns from data but often lack transparency because of their complex internal structures.

This shift has increased the opacity of the system, even for the platform’s engineers. “More and more of the decision-making power... is shifting not just out of public view, but actually really out of view or understanding of even the internal engineers,” Thickstun commented. Details that were previously explicit—such as the exact weight of a reply compared to a retweet—are now absent, redacted for "security reasons."

Another significant omission is any information about the training data used for the model, a concern raised by Mohsen Foroughifar, assistant professor at Carnegie Mellon University. “If the data that is used for training this model is inherently biased, then the model might... end up still being biased, regardless of what kind of things that you consider within the model.” Without insight into training data, meaningful auditing for fairness or bias is severely limited.

For European researchers like Ruggero Lazzaroni at the University of Graz, who works on EU-funded simulations of social media recommendation systems, the release is insufficient. Lazzaroni notes that while the code to run the algorithm is available, the underlying trained model is not, making independent reproduction impossible.

The move by X is emblematic of larger challenges in AI and generative systems. Thickstun draws parallels between social recommendation algorithms and next-generation generative AI platforms, highlighting recurring transparency concerns.

Some researchers, including Lazzaroni, also warn that current platform priorities optimize user engagement, not user well-being or truthfulness, which could exacerbate negative social impacts.

User reactions on X show a strong appetite for decoding algorithmic systems, but experts emphasize that the current redacted release neither advances genuine transparency nor enables productive oversight. As the shift toward AI-based recommendation systems accelerates, the debate over transparency, auditability, and accountability is likely to grow.

Reference: dataconomy.com

Related Posts

Understanding Explainability in Large Language Models

A new primer examines the growing need for explainability in large language models (LLMs). The article outlines key challenges and emerging methods for understanding how these advanced AI systems generate responses. As LLMs become more influential, comprehensible explanations are essential for trust and responsible use.

Meta Turns to Outsider Leadership in AI Push Amid Internal Challenges

Meta has appointed Alexandr Wang, a young start-up founder, to reinvigorate its artificial intelligence initiatives. Under his leadership, Meta has released Muse Spark, seen as its most competitive AI model to date. The move reflects a strategic shift aimed at accelerating AI innovation through unconventional leadership.

Five Papers Offer Clear Insights Into Large Language Models

A recent roundup highlights five research papers that effectively explain large language models (LLMs) to a broad audience. The papers cover core concepts underpinning LLMs and help demystify their operations, making advanced AI topics more accessible.

The Essential Weekly Update

Stay informed with curated insights delivered weekly to your inbox.