The AI overviews that appear at the top of Google searches are often incorrect.
It is important to view information from the source, and to see the whole document/website the information is from in order to understand the context, as opposed to citing information from an AI overview.
You can hide them by including "-ai" (minus AI) in your search.
The first search brings up an AI overview which may be incorrect:

When you search without the AI overview, it may lead you to a more authoritative source with correct information:

There are extensions you can add to your browser to remove these AI overviews, such as Chrome's "Hide Google AI Overviews".