AI chatbots were tasked with estate planning queries; here's how they scored

AI chatbots were tasked with estate planning queries; here's how they scored
New research tested four of the best known bots to find out how good they are
SEP 23, 2025

As artificial intelligence becomes a bigger part of client conversations, advisors need to be aware of the capabilities of chatbots such as ChatGPT and Google AI, whether that’s good or bad.

New research shines a light on these tools that are becoming mainstream for consumers and slowly gaining traction in the wealth management industry to find out if clients and even advisors can rely on the technology in a key area of advisory practices.

The study, published today (9/23), reveals that AI tools can be unreliable when used for estate planning, leaving users at risk of inaccurate information in a field where accuracy and nuance are non-negotiable. It highlights how human advisors remain key to estate planning advice.

The EncorEstate Plans study assessed four widely used platforms (ChatGPT, Claude, Perplexity, and Google AI Mode) by asking each of them 46 estate planning questions drawn from the most frequent client inquiries that the firm’s planning team has fielded over the past 45 years.

Answers were scored on a traditional A–F scale and the results are sobering. The top performer, Claude, achieved 69% of answers graded A or B, while Perplexity followed closely at 63% A or B responses.

Probably the best-known AI chatbot, ChatGPT, performed significantly worse than the two top-rated options tested, with nearly half of its answers earning only a D or F.

Meanwhile, Google AI Mode performed worst of all with 61% of responses failing, before it stopped after question 19, leaving 28 questions unanswered.

That means that a client who relies on an AI chatbot for guidance could end up with a trust riddled with errors or omissions and EncorEstate CEO Matt Morris says that his team has seen clients attempt to finalize AI-generated documents containing “nonsense POA powers” or questionable clauses that would never hold up in practice.

Even when chatbots do provide complete answers, they often fail to account for client-specific context. That gap is where professional oversight is essential.

The takeaway from the study is not that advisors should ignore AI, but rather that they should set boundaries for its use. Tools like Claude and Perplexity may offer reasonable starting points for basic education, but they cannot replace professional review.

For advisors, the opportunity lies in reinforcing their value and impressing on clients that estate planning is not just about documents, it’s about judgment, context, and guiding families through complex choices.

Latest News

What wine culture can teach investors about decision-making
What wine culture can teach investors about decision-making

Choice anxiety, prestige bias, and the temptation to make selections based on outsourced confidence are just some of the parallels between investing and the world of wine tasting.

Merrill Lynch, BofA's brokerage arm, hit with $7.5M SEC fine over missed suspicious activity reports
Merrill Lynch, BofA's brokerage arm, hit with $7.5M SEC fine over missed suspicious activity reports

Regulators found Bank of America's monitoring software had a known flaw Merrill left uncorrected for years.

AI is changing how investors research, not who they trust
AI is changing how investors research, not who they trust

While AI has become a go-to research tool for affluent investors, new HSBC research suggests human advisors remain the deciding voice when investment decisions are made.

Supreme Court blocks Trump's bid to fire Fed Governor Lisa Cook
Supreme Court blocks Trump's bid to fire Fed Governor Lisa Cook

A 5-4 ruling preserves the Federal Reserve's independence for now, but the legal fight over presidential removal power is far from settled.

Morgan Stanley boosts returns on client cash, analyst says
Morgan Stanley boosts returns on client cash, analyst says

For years, large firms have been facing penalties and questions from regulators over interest rates for clients’ cash accounts.

SPONSORED Who builds the income when the pension disappears?

Dan Biagini of American Equity says the steady decline of pensions, longer lifespans and a reset in interest rates are rewriting how advisors build retirement income

SPONSORED Why direct indexing stopped being optional

Direct indexing is on pace to outgrow ETFs and mutual funds. Northern Trust's Ken Lassner explains why the advisors who get it wish they had started sooner.