agents-course/pr_693/en/unit3/agentic-rag/agentic-rag.html

<meta charset="utf-8" /><meta name="hf:doc:metadata" content="{&quot;title&quot;:&quot;Agentic Retrieval Augmented Generation (RAG)&quot;,&quot;local&quot;:&quot;agentic-retrieval-augmented-generation-rag&quot;,&quot;sections&quot;:[],&quot;depth&quot;:1}">
		<link href="/docs/agents-course/pr_693/en/_app/immutable/assets/0.e3b0c442.css" rel="modulepreload">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/entry/start.e12ac9b3.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/chunks/scheduler.505acc25.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/chunks/singletons.09161e8f.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/chunks/index.001f95d5.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/chunks/paths.11a73501.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/entry/app.fc405f77.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/chunks/preload-helper.7112d566.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/chunks/index.fbb49fb4.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/nodes/0.b8cee527.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/chunks/each.e59479a4.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/nodes/68.2c171e15.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/chunks/CopyLLMTxtMenu.2fa0472a.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/chunks/MermaidChart.svelte_svelte_type_style_lang.3a1211b0.js">
		<link rel="modulepreload" href="/docs/agents-course/pr_693/en/_app/immutable/chunks/Heading.511e0027.js"><!-- HEAD_svelte-u9bgzb_START --><meta name="hf:doc:metadata" content="{&quot;title&quot;:&quot;Agentic Retrieval Augmented Generation (RAG)&quot;,&quot;local&quot;:&quot;agentic-retrieval-augmented-generation-rag&quot;,&quot;sections&quot;:[],&quot;depth&quot;:1}"><!-- HEAD_svelte-u9bgzb_END -->      <p></p>  <div class="items-center shrink-0 min-w-[100px] max-sm:min-w-[50px] justify-end ml-auto flex" style="float: right; margin-left: 10px; display: inline-flex; position: relative; z-index: 10;"><div class="inline-flex rounded-md max-sm:rounded-sm"><button class="inline-flex items-center gap-1 h-7 max-sm:h-7 px-2 max-sm:px-1.5 text-sm font-medium text-gray-800 border border-r-0 rounded-l-md max-sm:rounded-l-sm border-gray-200 bg-white hover:shadow-inner dark:border-gray-850 dark:bg-gray-950 dark:text-gray-200 dark:hover:bg-gray-800" aria-live="polite"><span class="inline-flex items-center justify-center rounded-md p-0.5 max-sm:p-0 hover:text-gray-800 dark:hover:text-gray-200"><svg class="sm:size-3.5 size-3" xmlns="http://www.w3.org/2000/svg" aria-hidden="true" fill="currentColor" focusable="false" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 32 32"><path d="M28,10V28H10V10H28m0-2H10a2,2,0,0,0-2,2V28a2,2,0,0,0,2,2H28a2,2,0,0,0,2-2V10a2,2,0,0,0-2-2Z" transform="translate(0)"></path><path d="M4,18H2V4A2,2,0,0,1,4,2H18V4H4Z" transform="translate(0)"></path><rect fill="none" width="32" height="32"></rect></svg></span> <span>Copy page</span></button> <button class="inline-flex items-center justify-center w-6 max-sm:w-5 h-7 max-sm:h-7 disabled:pointer-events-none text-sm text-gray-500 hover:text-gray-700 dark:hover:text-white rounded-r-md max-sm:rounded-r-sm border border-l transition border-gray-200 bg-white hover:shadow-inner dark:border-gray-850 dark:bg-gray-950 dark:text-gray-200 dark:hover:bg-gray-800" aria-haspopup="menu" aria-expanded="false" aria-label="Open copy menu"><svg class="transition-transform text-gray-400 overflow-visible sm:size-3.5 size-3 rotate-0" width="1em" height="1em" viewBox="0 0 12 7" fill="none" xmlns="http://www.w3.org/2000/svg"><path d="M1 1L6 6L11 1" stroke="currentColor"></path></svg></button></div> </div>  <h1 class="relative group"><a id="agentic-retrieval-augmented-generation-rag" class="header-link block pr-1.5 text-lg no-hover:hidden with-hover:absolute with-hover:p-1.5 with-hover:opacity-0 with-hover:group-hover:opacity-100 with-hover:right-full" href="#agentic-retrieval-augmented-generation-rag"><span><svg class="" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" aria-hidden="true" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 256 256"><path d="M167.594 88.393a8.001 8.001 0 0 1 0 11.314l-67.882 67.882a8 8 0 1 1-11.314-11.315l67.882-67.881a8.003 8.003 0 0 1 11.314 0zm-28.287 84.86l-28.284 28.284a40 40 0 0 1-56.567-56.567l28.284-28.284a8 8 0 0 0-11.315-11.315l-28.284 28.284a56 56 0 0 0 79.196 79.197l28.285-28.285a8 8 0 1 0-11.315-11.314zM212.852 43.14a56.002 56.002 0 0 0-79.196 0l-28.284 28.284a8 8 0 1 0 11.314 11.314l28.284-28.284a40 40 0 0 1 56.568 56.567l-28.285 28.285a8 8 0 0 0 11.315 11.314l28.284-28.284a56.065 56.065 0 0 0 0-79.196z" fill="currentColor"></path></svg></span></a> <span>Agentic Retrieval Augmented Generation (RAG)</span></h1> <p data-svelte-h="svelte-y9578v">In this unit, we’ll be taking a look at how we can use Agentic RAG to help Alfred prepare for the amazing gala.</p> <blockquote class="tip" data-svelte-h="svelte-sml7hr"><p>We know we’ve already discussed Retrieval Augmented Generation (RAG) and agentic RAG in the previous unit, so feel free to skip ahead if you’re already familiar with the concepts.</p></blockquote> <p data-svelte-h="svelte-140qrhf">LLMs are trained on enormous bodies of data to learn general knowledge.
However, the world knowledge model of LLMs may not always be relevant and up-to-date information.
<strong>RAG solves this problem by finding and retrieving relevant information from your data and forwarding that to the LLM.</strong></p> <p data-svelte-h="svelte-kysd50"><img src="https://huggingface.co/datasets/agents-course/course-images/resolve/main/en/unit2/llama-index/rag.png" alt="RAG"></p> <p data-svelte-h="svelte-aqkixd">Now, think about how Alfred works:</p> <ol data-svelte-h="svelte-1j2u100"><li>We’ve asked Alfred to help plan a gala</li> <li>Alfred needs to find the latest news and weather information</li> <li>Alfred needs to structure and search the guest information</li></ol> <p data-svelte-h="svelte-kv63c9">Just as Alfred needs to search through your household information to be helpful, any agent needs a way to find and understand relevant data.
<strong>Agentic RAG is a powerful way to use agents to answer questions about your data.</strong> We can pass various tools to Alfred to help him answer questions.
However, instead of answering the question on top of documents automatically, Alfred can decide to use any other tool or flow to answer the question.</p> <p data-svelte-h="svelte-1srircl"><img src="https://huggingface.co/datasets/agents-course/course-images/resolve/main/en/unit2/llama-index/agentic-rag.png" alt="Agentic RAG"></p> <p data-svelte-h="svelte-ipidlv">Let’s start <strong>building our agentic RAG workflow!</strong></p> <p data-svelte-h="svelte-aaolqu">First, we’ll create a RAG tool to retrieve up-to-date details about the invitees. Next, we’ll develop tools for web search, weather updates, and Hugging Face Hub model download statistics. Finally, we’ll integrate everything to bring our agentic RAG agent to life!</p> <a class="!text-gray-400 !no-underline text-sm flex items-center not-prose mt-4" href="https://github.com/huggingface/agents-course/blob/main/units/en/unit3/agentic-rag/agentic-rag.mdx" target="_blank"><svg class="mr-1" xmlns="http://www.w3.org/2000/svg" aria-hidden="true" fill="currentColor" focusable="false" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 32 32"><path d="M31,16l-7,7l-1.41-1.41L28.17,16l-5.58-5.59L24,9l7,7z"></path><path d="M1,16l7-7l1.41,1.41L3.83,16l5.58,5.59L8,23l-7-7z"></path><path d="M12.419,25.484L17.639,6.552l1.932,0.518L14.351,26.002z"></path></svg> <span data-svelte-h="svelte-zjs2n5"><span class="underline">Update</span> on GitHub</span></a>  <p></p> 
			
			<script>
				{
					__sveltekit_l7uhis = {
						assets: "/docs/agents-course/pr_693/en",
						base: "/docs/agents-course/pr_693/en",
						env: {}
					};

					const element = document.currentScript.parentElement;

					const data = [null,null];

					Promise.all([
						import("/docs/agents-course/pr_693/en/_app/immutable/entry/start.e12ac9b3.js"),
						import("/docs/agents-course/pr_693/en/_app/immutable/entry/app.fc405f77.js")
					]).then(([kit, app]) => {
						kit.start(app, element, {
							node_ids: [0, 68],
							data,
							form: null,
							error: null
						});
					});
				}
			</script>