New thread
Forum
Level Discussion > Main Levels > Main Level 7 > Latest threads-
ThreadRepliesVoicesLatest
-
-
What is a robots.txt file?I've googled it but I don't fully understand what they are and what they do. Anyone know what they look like and how to access them or is that too much information? UPDATE: I found a URL link in the robots.txt file but every time I type it in I get 'error accessing resource'. Am I on the right track or no and if I am how do I get rid of the error?53
-
StuckedGuys pls help me with this stage have try to use "/robots.txt" bt it just loading the main robots file for hackthis12
-
Guys pls I need help with Main level 7, Am stuck plsGuys pls I need help with main level 7, I am stuck Please help me please. I checked the hint but still seems confusing to me. I tried look at the page source as well and I also inspected the element but still I have no clue. I have seen other threads and people were talking about the robots.txt where is this from?23
-
JS embedded robot.txt file issuesI've gotten the impression from the forum that the robot.txt file controlls permissions? anyway, i also got the impression that is is embedded in a Javascript file, yet after going through all the js files, i can't seem to find it. Whats up with that?12
-
Help me boysall sorted. :) so simple, was trying toooooo harrrrdd12
-
[closed] StuckHelp... I looked up what robot.txt (not saying it so i don't spoil) files are on Javascript. I swear I've looked through every single one and couldn't figure it out. A very big hint (obvious or not) would be appreciated, thanks:)23
-
Main 7 help... Please and Thank you.Okay, so I have flown around the threads, and everyone is saying something about robot.txt file. according to https://en.wikipedia.org/wiki/Robots_exclusion_standard, A robot.txt file allows you to edit which bots and what they can do on the website in that file. So should i make a web scraper against that page? Or am i headed in the completely wrong direction? Thank You!74
-
warm but not hoti've found the robot.txt file, but now i'm lost as to how to use it. I see one account that is allowed but after putting the account in the username i'm still getting rejected Any assistance will be appreciated.128
-
I'm confused in level 7I don't understand hints I don't know how to solve My English is not good so I face some problems Anyone explain how to do I don't understand12
-
[closed] HELP Please .. I can't cross thisi put " /robot.txt " after " www.hackthis.co.uk " and i get this " Error accessing resource "01
-
- New post
- New post in watched thread
- Thread closed
- Sticky thread