Why AI is failing at giving good advice

🌈 Abstract

The article discusses why AI, specifically ChatGPT, is failing at providing good advice. It explains that ChatGPT generates responses based on the highest mathematical probabilities derived from existing texts on the internet, which often results in generic or unhelpful advice.

🙋 Q&A

[01] Why AI is Failing at Giving Good Advice

1. What is the key issue with how ChatGPT generates responses?

• ChatGPT generates responses based on the highest mathematical probabilities derived from existing texts on the internet, rather than providing unique, empathetic, and applicable advice.
• The responses are essentially a mash-up of the most common or popular advice found online, which may not be good or uniquely applicable.

2. Why is the advice from ChatGPT often unhelpful or shallow?

• The advice is based on the most propagated and popular content on the internet, which may not be founded on actual experience or provide in-depth, actionable guidance.
• For example, if most internet texts said the sky was yellow, ChatGPT would also say so, even though it is factually incorrect.

3. What is an example of ChatGPT failing to provide good, step-by-step advice?

• The article cites a tweet where a user tried to have ChatGPT generate a business plan to make money with a $100 budget. While ChatGPT did generate some income, the project was ultimately unsuccessful and short-lived, not demonstrating a sustainable or effective approach.

4. What is the key limitation of AI language models like ChatGPT in providing advice?

• They are good at explaining things and providing information, but they lack the ability to give truly good, uniquely applicable, and empathetic advice that a human teacher or mentor can provide.

[02] The Value of Information vs. Advice

1. What is the current state of the internet regarding educational information and advice?

• There is already a vast amount of educational information and advice freely available on the internet, more than anyone could ever take action on in their lifetime.

2. What is the key difference between just providing information and providing the right information to the right people in the right way?

• The value is not just in delivering information, but in delivering the right information to the right people in the right way. This is something that AI language models like ChatGPT currently struggle with.

3. What is the key takeaway about the current capabilities of AI in providing advice?

• AI is not yet capable of providing the same level of good, uniquely applicable, and empathetic advice that a human teacher or mentor can provide. It is much better at explaining things than giving truly helpful advice.