AI chatbots were tasked with estate planning queries; here's how they scored

AI chatbots were tasked with estate planning queries; here's how they scored
New research tested four of the best known bots to find out how good they are
SEP 23, 2025

As artificial intelligence becomes a bigger part of client conversations, advisors need to be aware of the capabilities of chatbots such as ChatGPT and Google AI, whether that’s good or bad.

New research shines a light on these tools that are becoming mainstream for consumers and slowly gaining traction in the wealth management industry to find out if clients and even advisors can rely on the technology in a key area of advisory practices.

The study, published today (9/23), reveals that AI tools can be unreliable when used for estate planning, leaving users at risk of inaccurate information in a field where accuracy and nuance are non-negotiable. It highlights how human advisors remain key to estate planning advice.

The EncorEstate Plans study assessed four widely used platforms (ChatGPT, Claude, Perplexity, and Google AI Mode) by asking each of them 46 estate planning questions drawn from the most frequent client inquiries that the firm’s planning team has fielded over the past 45 years.

Answers were scored on a traditional A–F scale and the results are sobering. The top performer, Claude, achieved 69% of answers graded A or B, while Perplexity followed closely at 63% A or B responses.

Probably the best-known AI chatbot, ChatGPT, performed significantly worse than the two top-rated options tested, with nearly half of its answers earning only a D or F.

Meanwhile, Google AI Mode performed worst of all with 61% of responses failing, before it stopped after question 19, leaving 28 questions unanswered.

That means that a client who relies on an AI chatbot for guidance could end up with a trust riddled with errors or omissions and EncorEstate CEO Matt Morris says that his team has seen clients attempt to finalize AI-generated documents containing “nonsense POA powers” or questionable clauses that would never hold up in practice.

Even when chatbots do provide complete answers, they often fail to account for client-specific context. That gap is where professional oversight is essential.

The takeaway from the study is not that advisors should ignore AI, but rather that they should set boundaries for its use. Tools like Claude and Perplexity may offer reasonable starting points for basic education, but they cannot replace professional review.

For advisors, the opportunity lies in reinforcing their value and impressing on clients that estate planning is not just about documents, it’s about judgment, context, and guiding families through complex choices.

Latest News

SEC fines Zoe Financial $450K over undisclosed referral conflict
SEC fines Zoe Financial $450K over undisclosed referral conflict

Salespeople at the firm often went beyond the matching algorithm to recommend network advisors on its Zoe Wealth platform, according to the regulator.

Senate vote on NIL bill could reshape college athletes' paydays
Senate vote on NIL bill could reshape college athletes' paydays

The Protect College Sports Act would cap school payments and codify NIL rights, with implications for advisors guiding young athletes.

'I'm done': Pandemic memories push business owners toward the exit
'I'm done': Pandemic memories push business owners toward the exit

"I know the number that I want to be able to retire on, and now I just want out," says Wilmington Trust's Marguerite Weese, describing a common refrain among business-owner clients.

Northern Trust bulks up family office team with New York hires
Northern Trust bulks up family office team with New York hires

Bessemer and Brown Brothers Harriman veteran Robert Ludricks III and private markets specialist Olof Akesson join the ultra-high-net-worth push on the East Coast.

SEC accuses trucking operator of running $127 million Ponzi scheme
SEC accuses trucking operator of running $127 million Ponzi scheme

765 investors were promised 260% annual returns on truck leases

SPONSORED In the Age of AI, Trust Becomes the Advisor's Greatest Asset

As AI makes financial information more accessible than ever, Lana Hock explains why human judgment, trust, and empathy remain the qualities clients value most in a financial advisor

SPONSORED Direct indexing webinar targets tax-loss harvesting amid market swings

Northern Trust’s Ken Lassner shows advisors how to convert volatility into after-tax portfolio gains