Can You Trust AI Chatbots for Sports Nutrition Advice?
Share
Artificial intelligence (AI) chatbots have quickly become popular tools for answering everyday questions. From helping with homework to writing emails, these chatbots seem to do it all. But what about something more specific like sports nutrition? Can athletes rely on AI chatbots for accurate and useful advice?
A recent study published in PLOS ONE took a close look at this question. Researchers tested six different AI chatbots to see how well they answered questions about sports nutrition. Here's what they found and what it means for anyone trying to use AI to fuel their fitness journey.
What Did the Study Test?
The researchers evaluated chatbots from OpenAI (ChatGPT), Google (Gemini), and Anthropic (Claude) using two types of questions:
- Simple prompts, like “What are the sports nutrition guidelines for training?”
- Detailed prompts, where the chatbot was given more background and asked for expert-level, science-based responses.
They tested each chatbot on how well it met five key areas:
- Accuracy (how correct the information was)
- Completeness (did it include all necessary points?)
- Clarity (was it easy to understand?)
- Evidence quality (were the answers backed by real research?)
- Consistency (did the chatbot give the same answer if asked again?)
How Did the Chatbots Perform?
Accuracy
Most chatbots gave moderately accurate answers. On average, they covered more than half of the expected information. However, none were perfect. ChatGPT-4o and Gemini 1.5 Pro performed better than Claude models, especially with simple prompts.
Completeness
Only ChatGPT-4o consistently provided complete answers. The others often left out important details, which could be risky for athletes trying to follow science-based nutrition advice.
Clarity
This was one area where all chatbots did fairly well. Their answers were generally easy to read and understand.
Evidence Quality
When asked simple questions, most chatbots failed to provide strong, research-backed sources. But when detailed prompts were used, the quality of references improved. Still, some answers lacked proper citations or used made-up references.
Consistency
The good news is that most chatbots gave similar answers when asked the same question twice. This shows that they’re generally reliable in how they respond.
Where Do AI Chatbots Fall Short?
Even though the chatbots scored okay in many areas, there were some clear gaps:
- Many did not mention key nutritional strategies, like managing daily energy or post-workout recovery.
- Information about supplements, like caffeine or iron, was often missing or incorrect.
- Some chatbots failed to advise users to consult a registered dietitian, which is a key piece of advice in any nutrition-related conversation.
Should Athletes Use AI for Nutrition Advice?
AI chatbots can be helpful for general guidance. They’re fast, easy to use, and can give you a decent starting point. But this study shows they are not yet ready to replace expert human advice.
Here are a few takeaways if you’re thinking about using a chatbot for sports nutrition:
- Use it for basic ideas, not detailed plans.
- Always double-check advice with trusted sources or professionals.
- Don’t rely on AI for personalized recommendations like supplement dosages or fueling strategies for race day.
- Look for answers that include references to real research—and verify them.
Final Thoughts
AI chatbots are getting smarter, but they still have a long way to go when it comes to giving high-quality sports nutrition advice. If you’re a serious athlete or coach, it’s best to work with a qualified sports dietitian. Use AI as a tool, not a replacement. After all, your health and performance deserve advice you can trust.