Hello, I would like to ask a question. I currently have nearly one million text data, but there is a lot of duplicate data in it. I wonder which database built-in algorithm supports duplicate detection. For example, if the similarity reaches 0.5, it is regarded as two data duplications. Currently, the database is in MySQL. I want to achieve rapid weight-judgment. What should I do?