Search fails for authors with non-Latin1 characters

[tfmorris]

or perhaps it's that AKA names aren't being indexed.

For whatever reason, neither of these searches return anything, when they should:

Æschylus https://openlibrary.org/search/authors?q=%C3%86schylus&mode=everything
Αἰσχύλος https://openlibrary.org/search/authors?q=%CE%91%E1%BC%B0%CF%83%CF%87%CF%8D%CE%BB%CE%BF%CF%82&mode=everything

They should both return, at a minimum, https://openlibrary.org/authors/OL74434A/Aeschylus

Unicode folding would take care of (or workaround) the first, but wouldn't help with the second.

[tfmorris]

A couple more Unicode searches that don't work:

• Kālidāsa https://openlibrary.org/search/authors?q=Ka%CC%84lida%CC%84sa&mode=everything
  should return https://openlibrary.org/authors/OL528A/Kālidāsa
• Āśāpūrṇā Debī https://openlibrary.org/search/authors?q=A%CC%84s%CC%81a%CC%84pu%CC%84rn%CC%A3a%CC%84+Debi%CC%84&mode=everything
  should return https://openlibrary.org/authors/OL821A

[LeadSongDog]

It's odd that searching for Αἰσχύλος using
https://openlibrary.org/search/authors?q=%CE%91%E1%BC%B0%CF%83%CF%87%CF%8D%CE%BB%CE%BF%CF%82&mode=everything gets no hits while
https://openlibrary.org/search?q=%CE%91%E1%BC%B0%CF%83%CF%87%CF%8D%CE%BB%CE%BF%CF%82&mode=everything
gets 954 hits. The Greek spelling is listed in the alternative names for https://openlibrary.org/authors/OL74434A/Aeschylus

[tfmorris]

That's an interesting observation and good clue. It sounds like the alternate names aren't included in the default author search.

[tfmorris]

The different results from the different search end points is a red herring.

The non-author search is returning works records, not author records. Those works have Αἰσχύλος in the author_alternative_name field where it got copied from the author's alternate_name field.

I've confirmed that author alternate_names doesn't appear to be indexed at all. It's not restricted to non-Latin characters. Neither https://openlibrary.org/search/authors?q=AEschyle nor https://openlibrary.org/search/authors?q=alternate_names%3AEschyle return any results. The general query syntax with field names in the query does work, because https://openlibrary.org/search/authors?q=name%3A%22Aeschylus%22+AND+work_count%3A%5B5+TO+*%5D returns the expect results.

I think the alternate_names issue is separate from the non-Latin characters issue because https://openlibrary.org/search/authors?q=Ka%CC%84lida%CC%84sa&mode=everything doesn't return the desired record even though that's the exact name string from the author record cut & paste into the search field. Of course, this could be confounded by the search index update issues, so who knows how many problems are really here.

[LeadSongDog]

Whether this is due to #848 or #714, the author dropdown when editing the work also fails to see the alternate names, so when Αἰσχύλος is entered, the dropdown offers to create a new author record rather than suggesting https://openlibrary.org/authors/OL74434A