如何从数组PHP中删除类似的条目

Question

So i have array like this and sometimes it has very similar entries:

Array
(
    [0] => greys anatomy
    [1] => element 3d
    [2] => interstellar
    [3] => monster ball
    [4] => scorpion
    [5] => taken 3
    [6] => the flash
    [7] => wild card
    [8] => big bang theory
    [9] => the big bang theory
    [10] => fredrik kempe vincero
    [11] => fredrik kempe vicero
)

I would like to remove similar entries that are longer ones. So for example in this array: [9] => the big bang theory and [10] => fredrik kempe vincero entries should be removed. as they are similar to 8th and 11th entry, but longer.

EDIT: So if anyone needs, I made working solution out of two answers below:

function check_similar($first, $second)
{
    similar_text($first, $second, $percent);
  if ($percent >= 80) { //needed percent value
    return true;
  }
  else {
    return false;
  }
}

for ($i = 0; $i < count($array); $i++) {
   for ($j = $i; $j < count($array); $j++) {
      if ($j > $i && check_similar($array[$i],$array[$j]) == true) {
         $array[$j] = null;
      }
   }
}
// filter array to remove null values and reindex
$array = array_values(array_filter($array));
print_r($array);

Answer 1

String similarity is a very difficoult problem that cannot be solved easily. There are several complex approaches, but none can be effective as if it was made by a human being.

Take a look on php soundhex and levenshtein which could be an easy solution for your particular case.

In any case, given a custom function that defines or not if a string is similar to another, to make your array unique you have to do something like:

// set to null all subsequent similar strings
for ($i = 0; $i < count($array); $i++) {
   for ($j = $i; $j < count($array); $j++) {
      if ($j > $i && similar($array[$i],$array[$j])) {
         $array[$j] = null;
      }
   }
}
// filter array to remove null values
$array = array_filter($array);

Answer 2

Take a look at the similar_text function.

similar_text('the big bang theory','big bang theory', $percent);
echo $percent; // 88%

This is obviously more difficult than it seems, but can do this check while making this array.

See this link for an alternate implementation.