joem1 Posted December 10, 2018 Report Share Posted December 10, 2018 I've just finished up this website > and attempted to submit the sitemap to Google Search Console, but I am getting an error on Google Search Console saying "URL restricted by robots.txt"...but I do not have any No Follow/No Index added. Any guidance on this before I end up having to switch back to Yoast? Link to comment Share on other sites More sharing options...
Support Montgomerie Posted December 10, 2018 Support Report Share Posted December 10, 2018 Hello, Thank you for contacting MyThemeShop and sorry for any inconvenience that might have been caused due to that. It seems like your Sitemaps are submitted correctly. You can check the report here: wp-admin/admin.php?page=rank-math-search-console&view=sitemaps Can you please add the screenshot in the sensitive area from the Search Console when visiting this URL?https://www.google.com/webmasters/tools/sitemap-list?hl=en&siteUrl= Looking forward to helping you. đRank #1 on Google With our WordPress SEO Plugin âĄScore a đŻon PageSpeed and Dominate Search Rankings. â Editing theme files? Please create a child theme to make your changes update-proof. Link to comment Share on other sites More sharing options...
joem1 Posted December 10, 2018 Author Report Share Posted December 10, 2018 That's crazy. I've been fighting with it all morning, now the errors disappear. Thanks for checking and for the help. Link to comment Share on other sites More sharing options...
Support Montgomerie Posted December 10, 2018 Support Report Share Posted December 10, 2018 Hello, It could be something wrong with Search Console's end as they are upgrading their platform lately and users sometimes run into weird issues. I'm glad everything's sorted for you. Please let us know if you need any further assistance, we are here to help. If not already, we would request you to take a couple of minutes to REVIEW the plugin and give it 5-STARS on WordPress.orghttps://link.mythemeshop.com/reviewrankmath Your kind words motivate us and help us put more effort into the development of this plugin and make it even better. We really need your positive feedback to push even harder, keep the plugin FREE, and continue the development of the plugin in full-swing. If you are planning to do a 4-star review or anything less, please don't. Instead, reply here and let us understand your requirements so we can get a 5-star rating from you as well. Can not afford even a single user to be disappointed over anything. Thank you. đRank #1 on Google With our WordPress SEO Plugin âĄScore a đŻon PageSpeed and Dominate Search Rankings. â Editing theme files? Please create a child theme to make your changes update-proof. Link to comment Share on other sites More sharing options...
joem1 Posted December 10, 2018 Author Report Share Posted December 10, 2018 Looks like the Errors/warnings are back. Every single page is show an error. I took a screen shot of it, but can not figure out how to attach. Link to comment Share on other sites More sharing options...
Support Montgomerie Posted December 10, 2018 Support Report Share Posted December 10, 2018 Hello, Sorry to hear that. Can you please upload them on imgur.com and add them in the sensitive area? Looking forward to helping you. Thank you. đRank #1 on Google With our WordPress SEO Plugin âĄScore a đŻon PageSpeed and Dominate Search Rankings. â Editing theme files? Please create a child theme to make your changes update-proof. Link to comment Share on other sites More sharing options...
joem1 Posted December 10, 2018 Author Report Share Posted December 10, 2018 Hello,I have updated the sensitive data as requested. Can you please check further?Thank you. Link to comment Share on other sites More sharing options...
BenMTS Posted December 10, 2018 Report Share Posted December 10, 2018 Hello, Could you please add your WP login details a well in the Sensitive Data field so we can take a look at the plugin settings? Thank you. Looking forward to helping you. Link to comment Share on other sites More sharing options...
joem1 Posted December 10, 2018 Author Report Share Posted December 10, 2018 Hello,I have updated the sensitive data as requested. Can you please check further?Thank you. Link to comment Share on other sites More sharing options...
BenMTS Posted December 10, 2018 Report Share Posted December 10, 2018 Hello, Thank you for adding the login details. This is a strange error because your robots.txt does not seem to be blocking any of the URLs present in the sitemaps. Nonetheless, I tried editing your robots.txt in Rank Math > General Settings > Edit robots.txt, but my changes are not being applied when I visit your /robots.txt file. Are you using any cache or CDN on your site that might be causing this? Please try the following: upload an empty robots.txt file in the root folder of your site. Then, when you visit /robots.txt on your site, you should see a blank file. Then please try submitting the sitemap again in the Search Console. Let us know how that helps. Thank you. Link to comment Share on other sites More sharing options...
joem1 Posted December 10, 2018 Author Report Share Posted December 10, 2018 I've add the Robots.txt file, now it is blank. I cleared the cache. I resubmitted the sitemaps, but it still appears the URL's are blocked. Link to comment Share on other sites More sharing options...
BenMTS Posted December 11, 2018 Report Share Posted December 11, 2018 Hello, If the robots.txt file is empty now, then it definitely cannot be blocking any of the URLs â for that it would need to contain a rule such as Disallow: *. The issue might be caused by some cache mechanism on Google's side. Please check the accessibility of one of the faulty URLs using the Search Console robots.txt Tester https://www.google.com/webmasters/tools/robots-testing-tool At the top you should see a text box with your current robots.txt content (it should be empty at the moment), while at the bottom you will see a text input field where you can test if a specific URL is accessible or not. Try it with one of the URLs that was flagged as blocked, to see if it is still blocked or not, and to see which robots.txt rule is blocking it. Hope that helps. Link to comment Share on other sites More sharing options...
Recommended Posts