view article Article How We Built a Semantic Highlight Model To Save Token Cost for RAG zilliz • Jan 15 • 67
view reply Can this highlight approach be used on final answer generated by LLM? Most of the times I find LLM generated final answer too verbose. Highlighting within answer will give user ability to see areas which actually matter.