Haystack? ???? ??? ?? ? ? ????? Stack Building ?? ?? ?? ??? ?? ?? ??? ??? Question-Aangswer Rag ????

. ??? ??
• ??? ?? ??? ??
  ???? ??? ??
  ?? ?? ??? ?? ??
> ?? ??? ?? ??? ???
• ??
  • ???? LLM?? ??????
  • ???? LLM? ????? ??? ??? ??? ?? ??? ???? ??? ?? ??? AI ??????. ?? ??? ??? ???? ?? LLM? ?? ???? LLM? ? ?? ?? ? ? ????. ???? ?? ???? ???? ???? ?? ? ? ????. ? ?? ?? ? ?? ??? ?????? ????? ??? ?????. ???? LLMS
  ?? ??? ? ?? ??? ???? ?? ?? ??? ??? ??? ???? ???? ??? ?????. ? ??? ???? ??? ??? ??? ??? ?? ????. ??? ????? ??? ????? ??? ??? ??????? ??? ? ????. ???? ?????? ?? ??? ??? ??? ???? ????? ???? ????? ??, ?? ? ?? ?? ???? ??? ????. agr vs ???? ?? ???? ?? ???? ?? ????? ????. ??? ???? ???? ?? ?? ?? ?? ??? ?????. ?? ?? ?? ??? ???? ??? ??? ???? ? ????? ?? ??? ?????. ?? ?? ?? ???? ???? ?????? ???? ?? ?? ??? ?? ??? ?????. ?? ??????? ????? ?? ??? ? ????.
  ?? ???? ?? ????? ??? ??? ?? ??????

  ?? ?? ?? ?? ?? ?? ?? ??? ?? ?? ???? ??? ?? ? ? ???? ?? ??? ?? ?? ?? ?? ?? ?? ??

  • ?? ???? ?? ? ?? ?? ??? ??? ?? ??? ???? ??? ?? ???? ??? ?? ??? ???? ??? ????. ?? ?? ??? ?? ?? ?? ?? Haystack? ?? ?? AI, LLM ?? ????, RAG ??? ?? ? ?? ???? ?????? ?? ?? ??? ?????. LLM ?????? ????? ???? ??? ??? ??? ?????. Huggingface, OpenAi, Cohere, Mistral ? Local Ollama? ?? ??? ???? ??? ?? ? ? ????. AWS Sagemaker, Bedrock, Azure ? GCP? ?? ???? ???? ??? ?? ? ?? ????.
  Haystack? ???? ??? ????? ??? ?? ???? ?????. ?? ??????? ?? ???? ??? ??? ???? ??, ???? ? ??? ????? ??? ? ?? ??? ?????. ?? ??? ??? ?? ??? ??? ??? ??? ????? ??? ???? ??? ???? ????.

  ?? ??? ???? ??? ?? ? ?????

  ??? ?? ? ?? ??? ???? ????? ??? ????? ?????. chatbot ? gpt-4, llama3.2, deepseek-r1? ?? ?? Genai ??? ???? ????. ?? ?? (???, ???, ??? ? ???)? ?? ?? ?? ?? ?? ?? ?? ??. ?? ?? ?? ??? ???? ?? ??

  ?? ?? ?? Haystack?? ???? ? ??? ?? (?? ?? ? ??? ??)? ??? ???? Genai LLM ???? ?????? ? ?? ?? ??? ????. ?? ????? ???? ?? ??? ??? ?? ??? ??? ???

  ?? ??

  ?? ??? Haystack? ?? ?? ?????. ?? ??, ?? ??, ??? ?? ? ???? ?? ??? ?? ? ? ????. Haystack?? ?? ??? ??? ??? ?? ?? ??? ??? ??? ???? ???? ?? ?? ??? ??? API? ?????. ??? ??? ????? ?? ??? ????.

  ?????? ???? Ollama

  ? ??????
  ?? ?? ??? ?????

  ?? ? ?? ???? ????

  ??? ?? ??? ??? Haystack? ??? ??? ?????. ?? ?? ?? ?? ??? ??? ?????. ??? ??? ????? ?? ? acyclic ??? (DAG)???. ?? ????? ?? ?? ??? ?? ???? ?? ?? ?? ??? ??? ? ????. ??? ? ?? ??? ??? ?? ? ? ????

  $ pip install haystack-ai ollama-haystack
  
  # On you system download Ollama and install LLM
  
  ollama pull llama3.2:3b
  
  ollama pull nomic-embed-text
  
  
  # And then start ollama server
  ollama serve

  ??? ??? ??? ? ? ????

  ??? ??? ??? ????? ?? ? ?? ?? ?? ??? ?? ?? ?? ?? ??? ? ???? ?? ??? ?? ????

  ?? ??? ??? ??? ??? ??? ?? ?? ?????.? ??? ?? ??? ???? ?? ?????. ? ??? ??? ??? ?

  from haystack import Document, Pipeline
  from haystack.components.builders.prompt_builder import PromptBuilder
  from haystack.components.retrievers.in_memory import InMemoryBM25Retriever
  from haystack.document_stores.in_memory import InMemoryDocumentStore
  from haystack_integrations.components.generators.ollama import OllamaGenerator

  ?? ??? ConnectionGraph? ?? ??? ?? ???? ??? ????? ?? ??? ???? ?? ???? ??? ? ? ????.

  .

  document_store = InMemoryDocumentStore()
  documents = [
      Document(
          content="Naruto Uzumaki is a ninja from the Hidden Leaf Village and aspires to become Hokage."
      ),
      Document(
          content="Luffy is the captain of the Straw Hat Pirates and dreams of finding the One Piece."
      ),
      Document(
          content="Goku, a Saiyan warrior, has defended Earth from numerous powerful enemies like Frieza and Cell."
      ),
      Document(
          content="Light Yagami finds a mysterious Death Note, which allows him to eliminate people by writing their names."
      ),
      Document(
          content="Levi Ackerman is humanity’s strongest soldier, fighting against the Titans to protect mankind."
      ),
  ]

  ????? ??? ??? ?? ???

  <: :>? ??? ?? :

  ?? ?? ?? ??? ??? ????? ??/?? ??? ????? ??? ?? ?? ??? ?????? ? ??? ?? ??? ????

  ?? ????? ???? ????? ?? ??? ?? ? ? ??????.

  ???? ???? ????

  pipe = Pipeline()
  
  pipe.add_component("retriever", InMemoryBM25Retriever(document_store=document_store))
  pipe.add_component("prompt_builder", PromptBuilder(template=template))
  pipe.add_component(
      "llm", OllamaGenerator(model="llama3.2:1b", url="http://localhost:11434")
  )
  pipe.connect("retriever", "prompt_builder.documents")
  pipe.connect("prompt_builder", "llm")

  ? ????? ?? ???? ????? ??? ?????. Prompt ? Retriever? ??? Query

  image_param = {
      "format": "img",
      "type": "png",
      "theme": "forest",
      "bgColor": "f2f3f4",
  }
  pipe.show(params=image_param)

  ?? :
  ? ??? ????? ????? ?? ? ????? ??? ????. ?? ??? Haystack ??? ??? ???? ?? ???? ?? ????? ?? ??? ? ????. ??? ?? ??? ?? ?? ???????.
  • ?? 2 ? ?????? Question-Aangwer Rag ???? ??? ??????? NCERT Physics Books ?? ?? ??? ?? ????. NCERT ??? ??? ?? ?? ??? ?? ??? ?? ? ???, ??? ??? ?? ??? ?? ?? ?? ?????. ?? llama3.2 : 3b ?? llama3.2 : 1b

    ?? ????? ChromADB ?? ?????? nomic embed ??? ?? DuckDuckgo ? ?? ?? tavily ?? (?? ??) ? ?????

    ?? ??? ??? ? ?? ???? ????? ??? ?? ?? ??? Conda Env Python 3.12 ? ?????
  • ??? ???? ??????
  ?? Qagent ????? ?? Python ??? ??? ? ????. ?? ??? ??? ???????.
  • ???? ???? ??? ???? ??? ????? ?? ??
  ??? ??? Core Haystack ?? ??
  • ??? ??????? ChromADB ?? ??? ?? ollama ?? ??
  ? ????? ? Duckduckgo
  ?? ??? ??? ?? ???? ??? ?? ?????. ??? ??? ??? ?? ??? ???? ??? ???, ??? ?? ????

  $ pip install haystack-ai ollama-haystack
  
  # On you system download Ollama and install LLM
  
  ollama pull llama3.2:3b
  
  ollama pull nomic-embed-text
  
  
  # And then start ollama server
  ollama serve

  ChromADB

  ? ?????. ?? ??? ? ? ???, ??? ?? ??? InmemoryDocumentStore? ???? ?? ??? ?? ?????. ???? ??? ???? ??? ??? ???? ??? ???? ???? ?? ????. ???? ??????. ???? Pinecode, Weaviate, Postgres ?? DB ?? ChromADB? ?? ?? ?????????. ?? ??, ?? ??, ???? ?? ???? ??? ChromADB? ?????.

  persist_path

  from haystack import Document, Pipeline
  from haystack.components.builders.prompt_builder import PromptBuilder
  from haystack.components.retrievers.in_memory import InMemoryBM25Retriever
  from haystack.document_stores.in_memory import InMemoryDocumentStore
  from haystack_integrations.components.generators.ollama import OllamaGenerator

  ? ??? ????? ???? PDF ?? ??

  PDF ??? ??? ??? ???? ?? ??? ?????. ?? ??? ?? ?? ??? Cleaner, Splitter ? File Converter? ?? Haystack? ?? ?? ? ???? ??? ?? ??? ???? ???? ??? ?????. ??? :

  ???? ??? ??, ?? ?, ? ? ?? ?????.

  document_store = InMemoryDocumentStore()
  documents = [
      Document(
          content="Naruto Uzumaki is a ninja from the Hidden Leaf Village and aspires to become Hokage."
      ),
      Document(
          content="Luffy is the captain of the Straw Hat Pirates and dreams of finding the One Piece."
      ),
      Document(
          content="Goku, a Saiyan warrior, has defended Earth from numerous powerful enemies like Frieza and Cell."
      ),
      Document(
          content="Light Yagami finds a mysterious Death Note, which allows him to eliminate people by writing their names."
      ),
      Document(
          content="Levi Ackerman is humanity’s strongest soldier, fighting against the Titans to protect mankind."
      ),
  ]

  ???? :

  ??? ??, ??, para, ???? ?? ??? ???? ??? ?????.

  ?? ??? :

  ? pypdf? ???? pdf? ??? ?????.

  $ pip install haystack-ai ollama-haystack
  
  # On you system download Ollama and install LLM
  
  ollama pull llama3.2:3b
  
  ollama pull nomic-embed-text
  
  
  # And then start ollama server
  ollama serve

  ?? :

  ? ??? ????? ??? ???? ?? ??? ?? ??? ?? ???. ?? ?? ???? ?? ???? ????? imentder : nomic embed text ??? ?? ????? ?? ? ?? ??? Ollama ? Nomic-embed-Text Embedder? ??? ????. ??? ??? ??? ???? ?? ???? ?? ??? ???? Ollama ?? ????? Nomic-embed-text ? llama3.2 : 3B ??? ???? ??? ??????.

  ??? ?? from haystack import Document, Pipeline from haystack.components.builders.prompt_builder import PromptBuilder from haystack.components.retrievers.in_memory import InMemoryBM25Retriever from haystack.document_stores.in_memory import InMemoryDocumentStore from haystack_integrations.components.generators.ollama import OllamaGenerator
  ? ???? Ollama? ??????. ?? ??? ?? ??

  ??? ??? ????? ?? ollamadocumentembedder

  ?? ??? ????? ??? ???? ?? ????

  ollamatextembedder? ???????.

  ??? ??? ?? ?? ?? ??? ?? ?? ????? ??? ?? ???? ???? ?????.

  document_store = InMemoryDocumentStore()
  documents = [
      Document(
          content="Naruto Uzumaki is a ninja from the Hidden Leaf Village and aspires to become Hokage."
      ),
      Document(
          content="Luffy is the captain of the Straw Hat Pirates and dreams of finding the One Piece."
      ),
      Document(
          content="Goku, a Saiyan warrior, has defended Earth from numerous powerful enemies like Frieza and Cell."
      ),
      Document(
          content="Light Yagami finds a mysterious Death Note, which allows him to eliminate people by writing their names."
      ),
      Document(
          content="Levi Ackerman is humanity’s strongest soldier, fighting against the Titans to protect mankind."
      ),
  ]

  ?? ??? ?? ??? ??? ??? ??? ?????.

  ??? ??? ?? ??? ???? ?? ??? ?? ?? ???? ?? ???? ?? ??? ?? ? ? ????. ??? ??? ?????. ?? ??? ??? ?? ??? ? ????? ???, ??? ?????. ?? ??? ???? ??? ??? ??? ???? ??? ??? ?? ??? ??? ?????. ?? ???? ?? ??? ???? ???? ???? ??? ?? ??? ??? ?? ?? ? ??? ?????. ???? PDF? ???? ??? ?? ????? ????. ?? ?? ???? ?? ??? ????? ????. ?? ?? ?? ??? ???? ?? ????? ???? ??? ?????? ??? ??? ?? ???? ?? ? ????.

  ??! ?, ??? ??? ?? ? ? ??? ???? ??? ???? ?? ??????.

  . ??? ??? ??? ?????

  ?, ?? ?? ??? ???? ?? ?? ???? ?? ?? ? ????.

  pipe = Pipeline()
  
  pipe.add_component("retriever", InMemoryBM25Retriever(document_store=document_store))
  pipe.add_component("prompt_builder", PromptBuilder(template=template))
  pipe.add_component(
      "llm", OllamaGenerator(model="llama3.2:1b", url="http://localhost:11434")
  )
  pipe.connect("retriever", "prompt_builder.documents")
  pipe.connect("prompt_builder", "llm")

  ??? ??? ??? ???

  ?? ?? ?? ??? ?? ?? ????? ??? ????? ?????. ????? ?????. ??? ?? ?? ?? ??? ?? ???? ?????? ???? ???????. ? ?? ?? ???? ??? ??? ???? ??? ???? ?????. ??? ???? ?? ?? ??? ?? ??? ?????. ?? ?? ??? ?????? ?? ??? ?? ??? ?? ??? ??? ?????. ?? ??? ?? ??? ????

  $ pip install haystack-ai ollama-haystack
  
  # On you system download Ollama and install LLM
  
  ollama pull llama3.2:3b
  
  ollama pull nomic-embed-text
  
  
  # And then start ollama server
  ollama serve

  ???? ?? ? ?? ?????? no_answer ??? ??? ????? ?? ???? ???? ?? ? ?? ??? ?????. ? ??? ?? Duckduckgo API ?? Tavily? ?????. ??? Duckduckgo? ??????.

  ??, ???? ??? ???? ???????. ?? ???? ????? ?? ???? ???? ???? ??? ????? ????? ???? ?? Haystack Promptbuilder ?? ??? ?????. ??, qa

  ? ?? ????? ?? ????

  ? ???? ????? ?? ?? ??? ????????. ??? ???? ?? ????? ?? ??? no_answer? ??????. ?? LLM?? NO_ANSWER? ?? ? ? ?? ?????? ???? ????? ????? ???? ?? ? ?? ??? ?????.

  from haystack import Document, Pipeline
  from haystack.components.builders.prompt_builder import PromptBuilder
  from haystack.components.retrievers.in_memory import InMemoryBM25Retriever
  from haystack.document_stores.in_memory import InMemoryDocumentStore
  from haystack_integrations.components.generators.ollama import OllamaGenerator

  Duckduckgo ???? ???
  ? ???? ? ???? ???? ??? ????? ?????.

  .

  Haystack?? ???? ??? ???? ????? ?????

  ??? Haystack ???? ???? ???? ????? ??? ?????.

  ?? ??? ?? ??

  ?? ??? ??? ????? ?? ???? ???? LLM ?? ? ?? ??? ???? ??? ???? ??? ?????. ??? ??? ??? ????? ??? ?? ??

  ?? ??? ??? ?? ?? ??

  document_store = InMemoryDocumentStore()
  documents = [
      Document(
          content="Naruto Uzumaki is a ninja from the Hidden Leaf Village and aspires to become Hokage."
      ),
      Document(
          content="Luffy is the captain of the Straw Hat Pirates and dreams of finding the One Piece."
      ),
      Document(
          content="Goku, a Saiyan warrior, has defended Earth from numerous powerful enemies like Frieza and Cell."
      ),
      Document(
          content="Light Yagami finds a mysterious Death Note, which allows him to eliminate people by writing their names."
      ),
      Document(
          content="Levi Ackerman is humanity’s strongest soldier, fighting against the Titans to protect mankind."
      ),
  ]

  ??? LLM ??? ?? LLAMA3.2 : 3B ?? 1B ?? ?? ??? ??? LLM? ???? ?? ???? ?? Ollamagenerator ?? ??? ?????. ?? ?? ? ?? ??? ?? ?? ?? ??? ?? ??

  ?? ?? ?? :

  ??? _embedder? ???? ????? ?? ????? ?????. ????? ???? Prompt_Builder? ??? ???? ???? ??? ???? ???? ???? ?? ????? ?????. ???? ???? ???? ??? ?? LLM?? ????? no_answer

  ? ??? ?????? .if ??? ? ?? ??? ?????. ? ??? ???? ??? ? ?? ????? ????. ? ?? ?? ? ?? ??? ???? ????.

  ? ?? ????? ???? ???? ???? ????. ??? ???? ??? ?? ??? ?? ???? LLM?? ????.

  pipe = Pipeline()
  
  pipe.add_component("retriever", InMemoryBM25Retriever(document_store=document_store))
  pipe.add_component("prompt_builder", PromptBuilder(template=template))
  pipe.add_component(
      "llm", OllamaGenerator(model="llama3.2:1b", url="http://localhost:11434")
  )
  pipe.connect("retriever", "prompt_builder.documents")
  pipe.connect("prompt_builder", "llm")

  ? ??? ?? ?????? ?? ??? ?? ???

  ?? ???

  ?? ??? ??? ????? ?? ?? ??? ??? ???? ?? ?? ???? ??? ??? ??? ????.

  ?? ??? ??? ??? ?? ?????.

  ?? ????? ??? ????

  ?? ????? ??? ?????.

  ?? NCERT ?? ?? ??????? ?? ????? ??????.
  ??? ??? ?????. ??? ??? ? ???? ?? ??? ??????. ??? ??? ?? ?? ???? ?????.

  . ? ??? ??? ??? ?? ???? ??? ???.

  ? ?? ???? ??? ?? MCQ

  $ pip install haystack-ai ollama-haystack
  
  # On you system download Ollama and install LLM
  
  ollama pull llama3.2:3b
  
  ollama pull nomic-embed-text
  
  
  # And then start ollama server
  ollama serve

  ???? ? ?? ??

  ??

  from haystack import Document, Pipeline
  from haystack.components.builders.prompt_builder import PromptBuilder
  from haystack.components.retrievers.in_memory import InMemoryBM25Retriever
  from haystack.document_stores.in_memory import InMemoryDocumentStore
  from haystack_integrations.components.generators.ollama import OllamaGenerator

  ? ?? ??? ??? ???.

  ??? ?????! ??? ? ?? ???? ?? ??? ?? ? ???? ?? ? ?? ???, ? ?? PDF? ??? ? ????. ?? GPT-4O, Anthropic 's Claude ?? ?? ???? LLM? ?? LLM? ??? ? ? ?? ? ????.

  document_store = InMemoryDocumentStore()
  documents = [
      Document(
          content="Naruto Uzumaki is a ninja from the Hidden Leaf Village and aspires to become Hokage."
      ),
      Document(
          content="Luffy is the captain of the Straw Hat Pirates and dreams of finding the One Piece."
      ),
      Document(
          content="Goku, a Saiyan warrior, has defended Earth from numerous powerful enemies like Frieza and Cell."
      ),
      Document(
          content="Light Yagami finds a mysterious Death Note, which allows him to eliminate people by writing their names."
      ),
      Document(
          content="Levi Ackerman is humanity’s strongest soldier, fighting against the Titans to protect mankind."
      ),
  ]

  ?? ??? ???? ?? ???? ?? ??? ??? ??? ?? ? ??? ?? ?? ?? ??? ??? ???? ???? ?????. ? ??? ? ??? ???? ???? OpenAI ? Nthropic? ?? ? ?? ?? LLM? ???? ?? ??? ? ? ????. ? ?? ??? ??? ?? Streamlit ?? React ?? ? ??? ???? UI? ?? ? ? ????. ??? ?? ? ?? ??? ?? ? ????. ? ??? ??

  ???? ?? ???? ???? ???? ? ????? ??? ??? ?????.

  Haystack? ??? ?? ????? ??? ?? ? ?? ??? ??????? ???? ?? ???? ?? ?? ??? ??????? ?? ???? ???? ?? ?? ??? ?? ?? ?? ??? ????? ?? ?? ??? ??? ?? ??? ??????

  ? ??? ???? ???? Analytics Vidhya? ???? ??? ??? ??? ?? ?????. ?? ?? ??

  q1. ???? ? ??? ??? ??? ??????

  a. ? ???? ??? ?? ??? ???? ?? ??? ??? ? ? ? ???? ???? ???? ??? ? ??? ?????. ??? ?? ????? ?? ??? ??????

  Q3. ?? ???? ??? ??? ??? ?? ????? a. ?? ???? ??? ??? ??? ?? ??? ?????? ??? ??? ??? ?? ? ? ??? ???? ???? ??????. ?? LLM API? ??? ? ?????

  .