Your download page can be accessed by internet digital thief if you didn’t consider on security when setting up your website.
As a result, your private information, protected documents, and files directory will be easily known and downloaded by others.
Moreover, your website’s bandwidth will consume faster. So, you will need to take some simple approaches to protect the page you want hide from the search engines in your website.
There are few ways you can use to protect your download page, here are two popular methods you can use.
Add this line of code to the head section of your webpage where you want it to be protected.
This method can protect your download page from almost all search engines, but people still can find your download page through certain keywords from alexa. So, this method may no longer work probably.
By applying this method, the search engines will first look for robot.txt file and then look for what is disallowed in your site directory to be crawled by the search engines.
Upload the robot text file to the site you would like to protect.
Some important information to note:
People still can find your download page by accessing the robot.txt file.
To solve this problem, simply open a blank text file and save it as “index.htm”.
Upload the blank “index.htm” page to each of your download directory to protect your download directory from being accessed.
When people access that download directory, it will be a blank page. So, your download page is now protected and not visible to the public.