Visual and Web Context

So far, you've learned how to use Codex to write, edit, and organize code through natural language and session commands. You've seen how it can refactor files, create new ones, and automatically follow your project's rules.

Now, it's time to go a step further. In this lesson, you'll explore how Codex can see what you see and find what you need — by interpreting visual inputs and connecting to real-time web information. You'll discover how to give Codex visual context with images and diagrams, and how to use web search integration to bring in the latest knowledge.

These capabilities make Codex a truly adaptive assistant that understands your work in full context — both on your screen and beyond it.

GPT-5-Codex can process both text and images, allowing it to understand the visual side of your development work. When you attach a screenshot, diagram, or chart, Codex analyzes it and combines what it sees with your text prompt to provide a more accurate response.

This makes it easier to troubleshoot errors, interpret visual outputs, or even translate diagrams into code structures.

Example prompts:

• "Here's a screenshot of my terminal — can you explain the error at the bottom?"
• "Look at this system diagram and tell me how the data flows."
• "Analyze this chart — what's causing the spike in response time?"

Visual context helps Codex act like a true collaborator — one that can "see" what's on your screen. When you share a terminal error, a data visualization, or a wireframe, Codex can reason about what's happening and guide you to a solution.

You might upload a stack trace image, ask Codex to identify the root cause, and get a fix ready in seconds. Or you could show a UI mockup and have Codex generate matching TypeScript interface definitions or class structures.

Example prompts:

• "Here's my chart — what can you tell about the performance trend?"
• "This is my UI wireframe — generate TypeScript interfaces that match this data structure."
• "Analyze this screenshot of test results and suggest what to fix first."

Codex can also connect to the web to access real-time information through its search integration feature. This means it can look up current documentation, the newest command syntax, or recent best practices — all within your coding session.

How Web Search Works in Codex:

When you ask Codex a question that requires current information, it can automatically search the web and retrieve relevant, up-to-date content. You'll see search results integrated directly into Codex's response, with citations to the sources it found.

For example, if you ask: "What are the latest TypeScript features?" — Codex will search for recent TypeScript release notes and documentation, then summarize what's new with proper attribution to the sources.

When to Use Web Search:

Web search is most helpful when you need:

• Current information that may have changed since Codex's training (library versions, API changes, recent best practices)
• Specific documentation for new tools or frameworks
• Latest syntax or configuration options for packages you're using
• Recent solutions to common problems or errors

Example prompts that trigger web search:

• "Search for the latest Express.js version and show what changed in middleware handling."
• "Find current best practices for async TypeScript functions and refactor my code."
• "Look up the most recent TypeScript configuration options and update my tsconfig.json file."
• "What are the latest security recommendations for Node.js applications?"

Understanding Search Results:

When Codex uses web search, it will:

1. Search for relevant, current information
2. Analyze multiple sources
3. Synthesize the findings into a clear answer
4. Cite the sources it used

This integration lets Codex combine what it already knows about your project with the newest information available online — keeping you current and efficient.

In this lesson, you discovered how GPT-5-Codex can use both visual and web context to understand your work more deeply. You can now show Codex images or diagrams to give it visual awareness, and leverage its web search integration when you need the latest information. When you ask questions that require current data, Codex will automatically search the web and provide cited, up-to-date answers.

Next, you'll practice using these features in action — attaching visuals and using live search to debug, design, and improve your projects with Codex.