How do I prevent the uploaded files from being found on Google and accessed without being logged in? If I search for members of my organization in Google, I can find an uploaded files that contain their names and sometimes personal information. Without having access to the forum.
I already removed the files and let Google them remove from the search results. And I created a robots.txt file. That didn't help. When a document is uploaded again (after adding the robots.txt file) it still gets indexed.
This is so frustrating.
Can anyone help me?
Hi @kusje-erop,
Please follow this support topic: https://wpforo.com/community/general-discussions/question-about-no-index/
This is about indexing the user pages. Does this also work to deny search engines to index the uploads as well? Because that's what I want, to deny access to and indexing the uploads.
The robots.txt file should look for example like this:
User-Agent: *
Disallow: /wp-content/
Disallow: /wp-admin/
Disallow: /readme.html
Disallow: /refer/
Sitemap: http://www.example.com/post-sitemap.xml
Sitemap: http://www.example.com/page-sitemap.xml
Sitemap: http://www.example.com/community/sitemap.xml
Here should be all Sitemap tags on your website, and if you have an SEO plugin you need to have those links in Sitemap tags.
Also please don't forget to add all wpForo Sitemap too. Please note the wpForor Sitemap generated only by wpForo.
To find the wpForo sitemap you just need to add sitemap.xml on the main page of the forum. See the screenshot below:
Please read this article it may help you: https://www.wpbeginner.com/wp-tutorials/how-to-optimize-your-wordpress-robots-txt-for-seo/
If I add sitemap.xml on the main page of my forum I get back that nothing was found. "No results found. The page you requested could not be found." etc etc.
I edited my Robots.txt file again. But it was even more specific which parts of my website were disallowed, but it still grabs it.
And how do I find the sitemaps if I can't find them? For SEO JetPack is the only plugin I have installed.
I edited my Robots.txt file again. But it was even more specific which parts of my website were disallowed, but it still grabs it.
The robots.txt file doesn't have any relation with the wpForo. We only may suggest checking the file one more time, and see the data is correct, and check again.
And how do I find the sitemaps if I can't find them? For SEO JetPack is the only plugin I have installed.
You should contact the JetPack plugin support and asked them that question.
However, we found the following link that may help you, to how you can find the sitemaps:
https://jetpack.com/2018/03/22/improve-seo-sitemaps/