{"id":248,"date":"2026-07-11T21:55:03","date_gmt":"2026-07-11T12:55:03","guid":{"rendered":"https:\/\/www.studio-jt.co.kr\/seo-glossary\/excluded-by-noindex\/"},"modified":"2026-11-15T18:46:51","modified_gmt":"2026-11-15T09:46:51","slug":"excluded-by-noindex","status":"publish","type":"seo_glossary","link":"https:\/\/www.studio-jt.co.kr\/en\/seo-glossary\/excluded-by-noindex\/","title":{"rendered":"URL marked &#8216;noindex&#8217;"},"content":{"rendered":"<h2 class=\"wp-block-heading\">This status is not an error<\/h2>\n<p class=\"wp-block-paragraph\">&#8220;URL marked &#8216;noindex'&#8221; is one of the &#8220;Not indexed&#8221; reasons in the <a href=\"\/en\/seo-glossary\/page-indexing-report\/\">Page Indexing report<\/a>, and means Google tried to index the page, found a noindex directive and stopped. It&#8217;s not that Google did something wrong or that your site has a problem; it&#8217;s the result of Google following the &#8220;don&#8217;t index this&#8221; instruction the site placed on the page. Google&#8217;s official documentation describes this status as: &#8220;When Google tried to index the page it encountered a &#8216;noindex&#8217; directive and therefore did not index it. If you do not want this page indexed, congratulations!&#8221; <a class=\"jt-src jt-src--official\" href=\"https:\/\/support.google.com\/webmasters\/answer\/7440203?hl=ko\" target=\"_blank\" rel=\"noopener\">GSC Help Center<\/a><\/p>\n<p class=\"wp-block-paragraph\">A note on naming: this entry&#8217;s English heading, &#8220;Excluded by noindex tag,&#8221; is the name used in older versions of the report; current official documentation and the report use &#8220;URL marked &#8216;noindex&#8217;.&#8221; Both refer to the same status. <a class=\"jt-src jt-src--official\" href=\"https:\/\/support.google.com\/webmasters\/answer\/7440203?hl=ko\" target=\"_blank\" rel=\"noopener\">GSC Help Center<\/a><\/p>\n<h2 class=\"wp-block-heading\">What is a noindex directive?<\/h2>\n<p class=\"wp-block-paragraph\">Google&#8217;s robots meta tag specifications define the noindex rule as an instruction: &#8220;Do not show this page, media, or resource in search results.&#8221; <a class=\"jt-src jt-src--official\" href=\"https:\/\/developers.google.com\/search\/docs\/crawling-indexing\/robots-meta-tag?hl=ko\" target=\"_blank\" rel=\"noopener\">Google (official)<\/a> There are two ways to set it. First, you can add a meta tag inside the head of an HTML document.<\/p>\n<pre class=\"wp-block-code\"><code>&lt;meta name=\"robots\" content=\"noindex\"&gt;<\/code><\/pre>\n<p class=\"wp-block-paragraph\">Second, you can set it with an HTTP response header. The specification says, &#8220;Any rule that can be used in a robots meta tag can also be specified as an X-Robots-Tag,&#8221; and this method is used for non-HTML files such as PDFs. <a class=\"jt-src jt-src--official\" href=\"https:\/\/developers.google.com\/search\/docs\/crawling-indexing\/robots-meta-tag?hl=ko\" target=\"_blank\" rel=\"noopener\">Google (official)<\/a><\/p>\n<pre class=\"wp-block-code\"><code>X-Robots-Tag: noindex<\/code><\/pre>\n<h2 class=\"wp-block-heading\">How to tell if it&#8217;s a problem: intentional vs. accidental noindex<\/h2>\n<p class=\"wp-block-paragraph\">The judgment is simple. Open the list of URLs with this status and check just one thing: &#8220;Is there a page here I want indexed?&#8221;<\/p>\n<h3 class=\"wp-block-heading\">No action needed: intentional noindex<\/h3>\n<ul class=\"wp-block-list\"><li>Login and admin pages, cart and checkout pages<\/li><li>On-site search results pages, filter and sort parameter pages<\/li><li>Thin listing pages such as tag archives, thank-you pages after form submission<\/li><\/ul>\n<p class=\"wp-block-paragraph\">If pages like these are on the list, noindex is working as intended. Just as Google&#8217;s documentation says, &#8220;If you do not want this page indexed, congratulations!&#8221;, no action is needed. <a class=\"jt-src jt-src--official\" href=\"https:\/\/support.google.com\/webmasters\/answer\/7440203?hl=ko\" target=\"_blank\" rel=\"noopener\">GSC Help Center<\/a><\/p>\n<h3 class=\"wp-block-heading\">Action needed: accidental noindex<\/h3>\n<p class=\"wp-block-paragraph\">The most common mistake is leftover development or staging settings. Ahrefs warns, &#8220;It&#8217;s good practice to block crawling and indexing of your entire staging environment, but if that setting gets deployed to production and forgotten, organic search traffic plummets.&#8221; <a class=\"jt-src jt-src--data\" href=\"https:\/\/ahrefs.com\/blog\/meta-robots\/\" target=\"_blank\" rel=\"noopener\">Ahrefs (measured)<\/a> A classic example is launching a WordPress site with the &#8220;Discourage search engines from indexing this site&#8221; option still turned on. If you see pages on the list that should be indexed, check them following the steps in Google&#8217;s official documentation.<\/p>\n<ol class=\"wp-block-list\"><li>In the report, click the inspect icon next to the URL to open the <a href=\"\/en\/seo-glossary\/url-inspection-tool\/\">URL Inspection tool<\/a>.<\/li><li>Under &#8220;Indexing allowed?&#8221;, check whether noindex is blocking indexing, and search for noindex in the page source or HTTP response headers.<\/li><li>Use &#8220;Test live URL&#8221; to check whether noindex still remains in the current live version.<\/li><li>Remove the tag or header, then click &#8220;Request indexing.&#8221; The GSC Help Center documentation states, &#8220;If you want this page to be indexed, you should remove the &#8216;noindex&#8217; directive.&#8221; <a class=\"jt-src jt-src--official\" href=\"https:\/\/support.google.com\/webmasters\/answer\/7440203?hl=ko\" target=\"_blank\" rel=\"noopener\">GSC Help Center<\/a><\/li><\/ol>\n<h2 class=\"wp-block-heading\">The crucial difference between noindex and robots.txt blocking<\/h2>\n<p class=\"wp-block-paragraph\">Many people assume &#8220;blocking it with robots.txt has the same effect,&#8221; but Google&#8217;s official documentation says the opposite. Its introduction to robots.txt states that the file &#8220;is used mainly to avoid overloading your site with requests; it is not a mechanism for keeping a web page out of Google.&#8221; <a class=\"jt-src jt-src--official\" href=\"https:\/\/developers.google.com\/search\/docs\/crawling-indexing\/robots\/intro?hl=ko\" target=\"_blank\" rel=\"noopener\">Google (official)<\/a> In particular, you must not combine the two methods. Google&#8217;s noindex guide warns: &#8220;If the page is blocked by a robots.txt file or the crawler can&#8217;t access the page, the crawler will never see the noindex rule, and the page can still appear in search results.&#8221; <a class=\"jt-src jt-src--official\" href=\"https:\/\/developers.google.com\/search\/docs\/crawling-indexing\/block-indexing?hl=ko\" target=\"_blank\" rel=\"noopener\">Google (official)<\/a> In other words, if you block crawling, Google can&#8217;t read the noindex.<\/p>\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th>Aspect<\/th><th>noindex<\/th><th><a href=\"\/en\/seo-glossary\/robots-txt\/\">robots.txt<\/a> blocking<\/th><\/tr><\/thead><tbody><tr><td>What it controls<\/td><td>Indexing (appearing in search results)<\/td><td>Crawling (visiting the page)<\/td><\/tr><tr><td>Crawling<\/td><td>Must be allowed to work<\/td><td>Blocked<\/td><\/tr><tr><td>When Google reads the instruction<\/td><td>After reading the page<\/td><td>Before reading the page<\/td><\/tr><tr><td>Guaranteed removal from search results<\/td><td>Yes (when crawlable)<\/td><td>No: the URL can be indexed from links alone<\/td><\/tr><\/tbody><\/table><\/figure>\n<p class=\"wp-block-paragraph\">The introduction to robots.txt explains, &#8220;If other pages point to your page with descriptive text, Google could still index the URL without visiting the page.&#8221; <a class=\"jt-src jt-src--official\" href=\"https:\/\/developers.google.com\/search\/docs\/crawling-indexing\/robots\/intro?hl=ko\" target=\"_blank\" rel=\"noopener\">Google (official)<\/a> That&#8217;s why the Page Indexing report documentation also says, &#8220;If you don&#8217;t want Google to index the page, remove the robots.txt block and use a &#8216;noindex&#8217; directive.&#8221; <a class=\"jt-src jt-src--official\" href=\"https:\/\/support.google.com\/webmasters\/answer\/7440203?hl=ko\" target=\"_blank\" rel=\"noopener\">GSC Help Center<\/a> Ahrefs explains the same principle from a practical angle: &#8220;Don&#8217;t block crawling of content you want removed from the index in robots.txt, because it prevents search engines from recrawling the page and discovering the noindex directive.&#8221; <a class=\"jt-src jt-src--data\" href=\"https:\/\/ahrefs.com\/blog\/meta-robots\/\" target=\"_blank\" rel=\"noopener\">Ahrefs (measured)<\/a> To sum up: use noindex to keep pages out of search results and robots.txt to reduce server load, and if you use both on the same page, the noindex becomes useless.<\/p>\n<h2 class=\"wp-block-heading\">References<\/h2>\n<ul class=\"wp-block-list\"><li><a href=\"https:\/\/support.google.com\/webmasters\/answer\/7440203?hl=ko\" target=\"_blank\" rel=\"noopener\">Page Indexing report &#8211; Google Search Console Help Center<\/a><\/li><li><a href=\"https:\/\/developers.google.com\/search\/docs\/crawling-indexing\/block-indexing?hl=ko\" target=\"_blank\" rel=\"noopener\">Block search indexing with noindex &#8211; Google Search Central<\/a><\/li><li><a href=\"https:\/\/developers.google.com\/search\/docs\/crawling-indexing\/robots\/intro?hl=ko\" target=\"_blank\" rel=\"noopener\">Introduction to robots.txt and guides &#8211; Google Search Central<\/a><\/li><li><a href=\"https:\/\/developers.google.com\/search\/docs\/crawling-indexing\/robots-meta-tag?hl=ko\" target=\"_blank\" rel=\"noopener\">Robots meta tag specifications &#8211; Google Search Central<\/a><\/li><li><a href=\"https:\/\/ahrefs.com\/blog\/meta-robots\/\" target=\"_blank\" rel=\"noopener\">Robots Meta Tag &amp; X-Robots-Tag: Everything You Need to Know &#8211; Ahrefs<\/a><\/li><\/ul>","protected":false},"excerpt":{"rendered":"<p>&#8220;URL marked &#8216;noindex'&#8221; means Google tried to index the page, found a noindex directive on it and did not index it. It&#8217;s not an error but the result of Google following the site&#8217;s own &#8220;don&#8217;t index this&#8221; instruction, so if the noindex is intentional, no action is needed. You only need to remove the noindex when a page you want indexed is on this list.<\/p>\n","protected":false},"template":"","glossary_categories":[17],"class_list":["post-248","seo_glossary","type-seo_glossary","status-publish","hentry","glossary_categories-search-console"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.studio-jt.co.kr\/en\/wp-json\/wp\/v2\/seo_glossary\/248","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.studio-jt.co.kr\/en\/wp-json\/wp\/v2\/seo_glossary"}],"about":[{"href":"https:\/\/www.studio-jt.co.kr\/en\/wp-json\/wp\/v2\/types\/seo_glossary"}],"version-history":[{"count":1,"href":"https:\/\/www.studio-jt.co.kr\/en\/wp-json\/wp\/v2\/seo_glossary\/248\/revisions"}],"predecessor-version":[{"id":2333,"href":"https:\/\/www.studio-jt.co.kr\/en\/wp-json\/wp\/v2\/seo_glossary\/248\/revisions\/2333"}],"wp:attachment":[{"href":"https:\/\/www.studio-jt.co.kr\/en\/wp-json\/wp\/v2\/media?parent=248"}],"wp:term":[{"taxonomy":"glossary_categories","embeddable":true,"href":"https:\/\/www.studio-jt.co.kr\/en\/wp-json\/wp\/v2\/glossary_categories?post=248"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}