Tracking down a difficult bug in sb.cdp.is_element_present

[zg009]

Hello, and thank you for the library.

I am running a piece of code through a proxy provider (that rhymes with Dodo) on Github actions in UC+CDP mode with a headed browser using Xvfb and have found pretty good success in viewing webpages for information gathering. However, I check periodically for the absence of elements to check if there is a captcha in the way, and use sb.solve_captcha() to attempt to bypass it. However, if that fails I then attempt the PerimeterX captcha solve as demonstrated in your code. For the most part, all of these seem to work.

The issue I am facing is sometimes the sb.cdp.is_element_present will suddenly just "hang" when my code is executing. Interestingly, I previously used sb.cdp.wait_for_element with a timeout for the check and it would still lock up my code execution. I tried changing the page load strategy to both "none" and "eager", and ran into the same issue. I also tried skipping javascript waits, but had no success. I have tried ThreadPoolExecutor with futures, various bypasses, and other things. I attached some custom CDP handlers to see if there was anything to be picked up and still - no error logs. Just a silent hang until the program times out. I tried doing a set_page_load_timeout and set_script_timeout, but the proxy provider will fail to work when I do that. Has anyone experienced this problem before, and how did you solve it? Where should I start looking to really find this problem? Any specific handlers, SB/driver flags?

Thank you.