Exploring Haystack Basics

Introduction

Hello and welcome! I'm excited to have you join us for the very first lesson of our course path, Building a Smart Code Translator with Haystack, FastAPI, and Gradio . In this journey, we'll learn how to create an intelligent application that can translate code from one programming language to another. This course path is divided into three main parts. In this first course, titled " Laying the Foundations for Code Translation with Haystack ", we'll explore Haystack, a powerful framework for building applications powered by large language models (LLMs), and establish a solid pipeline for code translation. Next, we'll use FastAPI to create a backend for our translator. Finally, we'll build an interactive user interface with Gradio . In this initial lesson, we'll kickoff by introducing Haystack. We'll get hands-on experience with its basic building blocks and see how it can help us create smart, flexible pipelines for language tasks. Let's get started!

What Is Haystack and Why Use It?

Haystack is an open-source Python framework designed to help developers build applications powered by large language models (LLMs), like those from OpenAI. It's especially good at tasks that involve understanding, generating, or transforming text — such as answering questions, searching documents, or, as we'll see later, translating code. Some reasons why we use Haystack: Modular Pipelines: We can connect different components (like prompt builders and LLMs) in a flexible way. Prompt Templating: It helps us create and manage prompts for LLMs easily. Production-Ready: Haystack is designed for real-world applications, so it's reliable and scalable. In this lesson, we'll use Haystack to build a simple pipeline that translates English text into French. This will help us understand the basics before we move on to code translation in the next lessons.

Understanding Haystack Pipelines

Let's talk about one of the most important concepts in Haystack: the Pipeline . A pipeline in Haystack is like an assembly line. Each component in the pipeline does a specific job, and the output of one component becomes the input for the next. This makes it easy to build complex workflows by connecting simple building blocks. For our first example, our pipeline in this lesson will have two main components: PromptBuilder: Prepares the prompt for the language model. OpenAIGenerator: Sends the prompt to an LLM (like GPT-4) and gets the response. Here's a simple diagram of what we'll build: Input Text \to PromptBuilder \to OpenAIGenerator \to Output (French Translation) By the end of this lesson, we'll have a working pipeline that translates a sentence from English to French using these components. This modular approach is what makes Haystack so powerful — you can swap components or add new ones to create increasingly sophisticated applications.

Join the 1M+ learners on CodeSignal

Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal

Python

from haystack.components.builders import PromptBuilder

# Create a prompt template for translation
prompt_builder = PromptBuilder(
    template="Translate the following text to French: {{text}}",  # Jinja2 template with a variable
    required_variables=["text"]  # The variable that must be provided
)

from haystack.components.builders import PromptBuilder

# Create a prompt template for translation
prompt_builder = PromptBuilder(
    template="Translate the following text to French: {{text}}",  # Jinja2 template with a variable
    required_variables=["text"]  # The variable that must be provided
)

Python

from haystack.components.generators.openai import OpenAIGenerator

# Initialize the OpenAIGenerator with a specific model
generator = OpenAIGenerator(model="gpt-4o-mini")  # Using a smaller, efficient model

from haystack.components.generators.openai import OpenAIGenerator

# Initialize the OpenAIGenerator with a specific model
generator = OpenAIGenerator(model="gpt-4o-mini")  # Using a smaller, efficient model

Shell

export OPENAI_API_KEY=your-openai-api-key

export OPENAI_API_KEY=your-openai-api-key

Python

from haystack import Pipeline

# Build the pipeline
pipeline = Pipeline()  # Create an empty pipeline
pipeline.add_component("prompt_builder", prompt_builder)  # Add our prompt component
pipeline.add_component("llm", generator)  # Add our language model component
pipeline.connect("prompt_builder.prompt", "llm.prompt")  # Connect the components

from haystack import Pipeline

# Build the pipeline
pipeline = Pipeline()  # Create an empty pipeline
pipeline.add_component("prompt_builder", prompt_builder)  # Add our prompt component
pipeline.add_component("llm", generator)  # Add our language model component
pipeline.connect("prompt_builder.prompt", "llm.prompt")  # Connect the components

Python

# Provide input data
input_data = {"text": "Hello, how are you?"}  # The English text we want to translate

# Run the pipeline
result = pipeline.run(data=input_data)  # Execute the pipeline with our input
print("Pipeline output:", result["llm"]["replies"][0])  # Display the translation

# Provide input data
input_data = {"text": "Hello, how are you?"}  # The English text we want to translate

# Run the pipeline
result = pipeline.run(data=input_data)  # Execute the pipeline with our input
print("Pipeline output:", result["llm"]["replies"][0])  # Display the translation

text

Pipeline output: Bonjour, comment allez-vous?

Pipeline output: Bonjour, comment allez-vous?

Python

from haystack.components.builders import PromptBuilder

# Create a prompt template for translation
prompt_builder = PromptBuilder(
    template="Translate the following text to French: {{text}}",  # Jinja2 template with a variable
    required_variables=["text"]  # The variable that must be provided
)

Python

from haystack.components.generators.openai import OpenAIGenerator

# Initialize the OpenAIGenerator with a specific model
generator = OpenAIGenerator(model="gpt-4o-mini")  # Using a smaller, efficient model

Shell

export OPENAI_API_KEY=your-openai-api-key

Python

from haystack import Pipeline

# Build the pipeline
pipeline = Pipeline()  # Create an empty pipeline
pipeline.add_component("prompt_builder", prompt_builder)  # Add our prompt component
pipeline.add_component("llm", generator)  # Add our language model component
pipeline.connect("prompt_builder.prompt", "llm.prompt")  # Connect the components

Python

# Provide input data
input_data = {"text": "Hello, how are you?"}  # The English text we want to translate

# Run the pipeline
result = pipeline.run(data=input_data)  # Execute the pipeline with our input
print("Pipeline output:", result["llm"]["replies"][0])  # Display the translation

text

Pipeline output: Bonjour, comment allez-vous?

Introduction

What Is Haystack and Why Use It?

Understanding Haystack Pipelines

Join the 1M+ learners on CodeSignal

Building a Prompt with PromptBuilder

Connecting to a Large Language Model with Generators

Creating the Translation Pipeline

Running the Translation Pipeline

Conclusion and Next Steps