Recursive webcrawl is functionally an infinite loop #2

For the handful of test websites I've tried, the recursive webcrawl is functionally an infinite loop. For teaching purposes, I think we should consider either providing a sparsely linked url for people to ping, or remove that section of the code since waiting for it to complete is not well-suited for iterating changes to the code.