The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
"Logging into pages with Password Protection before crawl"
Hello, I've searched for about an hour and can't find this answer:
What I am trying to do is crawl my distributor's website for all the products I sell from them. The problem is, I have to be logged in to see the products as they don't display the information to the public since it would show wholesale pricing, etc.
All I need to do is pass my login credentials before running my Crawl Web, but I can' seem to figure out how to do this?
Any help or direction would be greatly appreciated!
What I am trying to do is crawl my distributor's website for all the products I sell from them. The problem is, I have to be logged in to see the products as they don't display the information to the public since it would show wholesale pricing, etc.
All I need to do is pass my login credentials before running my Crawl Web, but I can' seem to figure out how to do this?
Any help or direction would be greatly appreciated!
Tagged:
0