AI chatbots were tasked with estate planning queries; here's how they scored

AI chatbots were tasked with estate planning queries; here's how they scored
New research tested four of the best known bots to find out how good they are
SEP 23, 2025

As artificial intelligence becomes a bigger part of client conversations, advisors need to be aware of the capabilities of chatbots such as ChatGPT and Google AI, whether that’s good or bad.

New research shines a light on these tools that are becoming mainstream for consumers and slowly gaining traction in the wealth management industry to find out if clients and even advisors can rely on the technology in a key area of advisory practices.

The study, published today (9/23), reveals that AI tools can be unreliable when used for estate planning, leaving users at risk of inaccurate information in a field where accuracy and nuance are non-negotiable. It highlights how human advisors remain key to estate planning advice.

The EncorEstate Plans study assessed four widely used platforms (ChatGPT, Claude, Perplexity, and Google AI Mode) by asking each of them 46 estate planning questions drawn from the most frequent client inquiries that the firm’s planning team has fielded over the past 45 years.

Answers were scored on a traditional A–F scale and the results are sobering. The top performer, Claude, achieved 69% of answers graded A or B, while Perplexity followed closely at 63% A or B responses.

Probably the best-known AI chatbot, ChatGPT, performed significantly worse than the two top-rated options tested, with nearly half of its answers earning only a D or F.

Meanwhile, Google AI Mode performed worst of all with 61% of responses failing, before it stopped after question 19, leaving 28 questions unanswered.

That means that a client who relies on an AI chatbot for guidance could end up with a trust riddled with errors or omissions and EncorEstate CEO Matt Morris says that his team has seen clients attempt to finalize AI-generated documents containing “nonsense POA powers” or questionable clauses that would never hold up in practice.

Even when chatbots do provide complete answers, they often fail to account for client-specific context. That gap is where professional oversight is essential.

The takeaway from the study is not that advisors should ignore AI, but rather that they should set boundaries for its use. Tools like Claude and Perplexity may offer reasonable starting points for basic education, but they cannot replace professional review.

For advisors, the opportunity lies in reinforcing their value and impressing on clients that estate planning is not just about documents, it’s about judgment, context, and guiding families through complex choices.

Latest News

Advisor moves: Atlas tops $1B as Wells Fargo, UBS add bank veterans
Advisor moves: Atlas tops $1B as Wells Fargo, UBS add bank veterans

Wells Fargo adds two bank-channel recruits, UBS lands a JPMorgan Chase veteran, and a multi-family office lifts Atlas past $1B

Advisor mom’s son used her password to log into clients’ accounts, sell deal with conflicts, according to Washington state
Advisor mom’s son used her password to log into clients’ accounts, sell deal with conflicts, according to Washington state

“The state comes down on you in years when you make 40% returns for clients,” said Bill Swayne, the advisor and son of Candace Swayne.

Osaic in talks with Anthropic as AI reshapes advisor workforce
Osaic in talks with Anthropic as AI reshapes advisor workforce

The Independent broker-dealer giant has had “active conversations” with the Claude maker, which is days away from its expected IPO

The retirement milestone advisors aren't tracking
The retirement milestone advisors aren't tracking

For Gen X clients entering life after work, answering the financial question isn't enough to solve the entire retirement equation.

Wealthtech firms target stock pay, pensions and heirs for advisors
Wealthtech firms target stock pay, pensions and heirs for advisors

Tools from Grantd, Income Lab and Healthspan Wealth aim to keep RIAs involved in clients’ biggest money decisions

SPONSORED Best Practices for Engaging Women Around Alternatives

Growing wealth, evolving priorities, and untapped opportunities are reshaping how women approach long-term investing.

SPONSORED Built on insurance experience to deliver on long-term promises

Knighthead Life entered the market with a competitive MYGA. A strong launch earned advisor confidence and paved the way for FIAs.