Making Search Smarter with Analyzers

Full-Text Search with Analyzers in Elasticsearch

Standard, custom, and language analyzers explained

By Sharanmeet Singh
Tags:ElasticsearchOpenSearchAnalyzersFull-Text Search

Search Query Generator

Generate search queries and filters

Try Generator

Full-Text Search with Analyzers

Analyzers are the heart of full-text search.


Standard Analyzer

{
  "analyzer": "standard"
}

Splits text by language rules.


Custom Analyzer Example

{
  "analysis": {
    "analyzer": {
      "my_custom": {
        "tokenizer": "standard",
        "filter": ["lowercase", "asciifolding"]
      }
    }
  }
}

Language Analyzers

  • english
  • french
  • german

Tips

  • Use .keyword fields for exact matches
  • Choose analyzer based on content language
  • Reindexing is needed if analyzer changes

Mistake: Using standard analyzer for product SKUs → they get split into wrong tokens.