Not able to crawl https url (from the requestList) #1074
-
Getting time out error. When we changed url from https://eglb33.egdemo.info/21help/sitemap.xml to http://eglb33.egdemo.info/21help/sitemap.xml . It is progressing further. To verify whether it is proxy server issue or not.
It is able make call to the https url. Set up: From the instance(VM), We have allowed all our external call through proxy only. |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
Looked further.. In utilsrequest.js file, When changed default value useHttp2 = true. Can you please do needful to handle this case.. Furthermore, Can u please suggest how we can override this value from crawler options. |
Beta Was this translation helpful? Give feedback.
-
I closed the issue because I tested it and could not reproduce the problem with our proxies, so it might have something to do with configuration of your own proxy. Nevertheless, I created an issue for the |
Beta Was this translation helpful? Give feedback.
I closed the issue because I tested it and could not reproduce the problem with our proxies, so it might have something to do with configuration of your own proxy. Nevertheless, I created an issue for the
http2: false
configuration: #1075