Privacy & Cookies

This website uses cookies. By continuing to use this site you are agreeing to our use of cookies.
Forum Index

Sections

View

Filter topics in this section

Stats

Threads6,998
Posts56,862
Authors6,427

Main 7 help... Please and Thank you.

Level Discussion > Main Levels > Main Level 7 > Main 7 help... Please and Thank you.


    • 1375
    • 3

    0
    Okay, so I have flown around the threads, and everyone is saying something about robot.txt file. according to https://en.wikipedia.org/wiki/Robots_exclusion_standard, A robot.txt file allows you to edit which bots and what they can do on the website in that file. So should i make a web scraper against that page? Or am i headed in the completely wrong direction?
    Thank You!
Viewing 7 replies - 1 through 7 (of 7 total)
  • dimooz
    dimooz's profile picture

    • 13085
    • 697

    0
    A robot.txt file allows you to edit which bots and what they can do on the website in that file. purepanic

    And sometimes what directories they can access (or not).
    userbar.png
  • purepanic
    purepanic's profile picture

    • 1375
    • 3

    0
    so if i found the robot.txt file and edited it, maybe i could get to the password directory?
  • dimooz
    dimooz's profile picture

    • 13085
    • 697

    0
    You don't have many ways to be sure. You'll have to try.
    userbar.png
  • purepanic
    purepanic's profile picture

    • 1375
    • 3

    0
    Thank You!
  • airmongeeko
    airmongeeko's profile picture

    • 895
    • 5

    0
    is this function that gives you the text

    (function(i, s, o, g, r, a, m) {
    i = r;
    i[r] = i[r] || function() {
    (i[r].q = i[r].q || []).push(arguments)
    }, i[r].l = 1 * new Date();
    a = s.createElement(o),
    m = s.getElementsByTagName(o)[0];
    a.async = 1;
    a.src = g;
    m.parentNode.insertBefore(a, m)
    })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
    ga('create', 'UA-34026704-1', 'hackthis.co.uk');
    ga('send', 'pageview');
  • mosale
    mosale's profile picture

    • 1985
    • 2

    0
    airmongeeko No
    This function is not related with the answer
  • airmongeeko
    airmongeeko's profile picture

    • 895
    • 5

    0
    yup...sorry for the dumb comment that function has to do with visits on the page ...
Viewing 7 replies - 1 through 7 (of 7 total)
You must be logged in to reply to this topic