Key points: Artificial intelligence (AI)'s dual functionalities in scholarly publishing raise ethical and practical concerns.Chatbots, much more than AI‐driven search engines, have the potential to distort information and disseminate false truths and flawed science.The role of AI in scholarly publishing needs to be critically examined.