AI doesn’t just answer questions – it legitimises bad ones
AI's capacity to quickly generate answers can inadvertently legitimize poorly framed questions, potentially obscuring deeper truths. Decision-makers must prioritize formulating the right questions before consulting AI.
Intelligence analysis by Gemini 2.5 Flash
This opinion piece highlights a critical challenge with AI: its ability to provide answers, even to flawed questions, can give undue credibility to weak ideas. The author argues that the quality of AI's output is inherently tied to the quality of the input questions, urging users to prioritize thoughtful inquiry over immediate AI-generated responses.
Imagine you have a super-smart robot that can answer any question. But if you ask it a silly question, like 'What's the best way to eat a shoe?', it will give you a silly answer, even if it sounds very smart. The robot doesn't know if your question is good or bad, it just answers. So, it's really important to think hard and ask the *right* questions first, so the robot can give you truly helpful advice.
Analysis
Toomas Plunt's Insight
Toomas Plunt, an Estonian entrepreneur with a background in statistical modeling, presents a compelling argument about the often-overlooked pitfalls of relying on AI for analysis. His core contention is that AI's efficiency in generating responses can inadvertently validate poorly conceived questions, thereby obscuring deeper truths. This perspective challenges the common perception of AI as a neutral, objective tool, suggesting instead that its utility is heavily dependent on the critical thinking applied by its human operators.
Plunt illustrates this point with a vivid anecdote from a car insurance focus group. Initially, participants prioritized price and deductibles, with reputation being unmentioned. However, a rephrased question about switching insurers for a discount revealed that for one participant, no discount was sufficient to overcome the importance of a prestigious insurer, a factor previously unarticulated. This highlights how the framing of a question can profoundly alter the perceived importance of various factors, a lesson directly applicable to AI interactions.
The "AI Slop" Phenomenon
The article touches upon a broader societal concern regarding the proliferation of low-quality, AI-generated content, exemplified by LinkedIn's introduction of an "AI slop" reporting button. The fact that over a million users reportedly utilized this feature within two weeks underscores a growing public fatigue with superficial or unoriginal AI-produced material. This phenomenon reinforces Plunt's argument that while AI can generate content rapidly, its output often lacks the nuance, depth, or genuine insight that comes from well-posed questions and human critical evaluation.
The "AI slop" issue is not merely an aesthetic problem; it points to a deeper challenge in discerning valuable information from readily available, yet potentially hollow, AI-generated analyses. If AI is used to answer questions that are themselves poorly formulated or designed to elicit superficial responses, the resulting "slop" can further dilute the quality of information available, making it harder for decision-makers to identify truly relevant insights.
Decision-Makers' Imperative
Plunt's central message is a call to action for decision-makers: the imperative to "get the question right before reviewing the answer." This principle is crucial in an era where AI tools are increasingly accessible and powerful. Without a clear, well-defined, and critically examined question, AI's analytical capabilities risk being misdirected, producing outputs that, while technically correct in answering the posed question, fail to address the underlying problem or reveal crucial insights.
The article implicitly advocates for a more thoughtful and deliberate approach to integrating AI into decision-making processes. It suggests that the true value of AI lies not just in its ability to process information and generate answers, but in its capacity to augment human intelligence when guided by rigorous inquiry. This requires users to cultivate a deeper understanding of the problem space and to formulate questions that probe beyond the obvious, ensuring that AI's powerful analytical engine is directed towards meaningful and impactful objectives.
Key points
- AI's ability to answer questions can inadvertently legitimize poorly formulated inquiries.
- The way a question is framed significantly impacts the nature and depth of the answer received.
- Decision-makers must prioritize asking the right questions before relying on AI-generated analyses.
- The "AI slop" phenomenon on platforms like LinkedIn indicates a public fatigue with low-quality AI content.
- Critical human evaluation of questions is essential to harness AI's true potential effectively.
By understanding AI's tendency to legitimize bad questions, users can develop more critical thinking skills, leading to more thoughtful and precise inquiries. This could foster a symbiotic relationship where human ingenuity in question formulation enhances AI's analytical power, yielding deeper insights and better decision-making.
If decision-makers fail to heed this warning, the widespread adoption of AI could lead to a proliferation of superficial analyses and flawed conclusions, as weak ideas gain unearned credibility. This could erode trust in AI-generated insights and hinder genuine progress by misdirecting resources and attention.
