Problem with latest selenium-python lib.

[Gateswong]

I recently setup an environment which has "selenium 4.4.3" installed. It's been installed as a direct or indirect dependency of finance-dl. This version of selenium-python has the following change recently, which breaks all find element API calls:

baijum/selenium-python@3b13c2f

Causes:

  File "somepath\.venv\lib\site-packages\finance_dl\scrape_lib.py", line 222, in wait_for_page_load
    old_page = self.driver.find_element_by_tag_name('html')
AttributeError: 'WebDriver' object has no attribute 'find_element_by_tag_name'

[Gateswong]

The lastest version of selenium that works with finance-dl is 4.2.0.

pip install -Iv selenium==4.2.0

[Zburatorul]

Thanks for digging into this.
Are you willing to submit a PR with the right modifications to setup.py?

[chandler150]

Not a full solution, but it looks like since the Find_element_By... usage is depreciated, we are going to need to follow the guidelines here https://saucelabs.com/resources/articles/how-to-upgrade-to-selenium-4 to update