I found the file, did some reading up on robots but Im still not sure about what to do from there, if you have any hints or useful websites that helped you please tell.
Did you read that file properly
The page that you found is the key, now follow the path :)
This site only uses cookies that are essential for the functionality of this website. Cookies are not used for tracking or marketing purposes.
By using our site, you acknowledge that you have read and understand our Privacy Policy, and Terms of Service.