Now that's a great line...
The last link the OP provided is very comprehensive, the author appears to pull off the operation. So I am confused why the OP can't keep repeating the procedure until it works.
I dont get how it can be done. From his example all the States seem nicely listed in a number sequence and all in one place.
But my example I have to click Accounting, then click a course, then scrape the course page, then go back and click another course and so on.
The web pages are not numbered nicely, so each page has a different text name, not a different number.
Do you think the only way to scrap the page is to scrape the course page itself and do that for every course?
If so, its probably easier and quicker for me to just copy and paste what I need from each course page.