--- title: Best Selenium posts of 2024 | daily.dev description: The most upvoted Selenium posts of 2024, curated by the daily.dev community. canonical: https://daily.dev/tags/selenium/best-of/2024 twitter:card: summary_large_image twitter:site: @dailydotdev og:url: https://daily.dev/tags/selenium/best-of/2024 og:type: website og:site_name: daily.dev og:title: Best Selenium posts of 2024 | daily.dev og:description: The most upvoted Selenium posts of 2024, curated by the daily.dev community. og:image: https://media.daily.dev/image/upload/s--VAY5ToZt--/f_auto/v1724209435/public/daily.dev%20-%20open%20graph --- # Best of Selenium — 2024 1. 1 [](/posts/python-ai-web-scraper-tutorial---use-ai-to-scrape-anything-qvtnlkrx6 "Python AI Web Scraper Tutorial - Use AI To Scrape ANYTHING") Video Tech With Tim · 2y Python AI Web Scraper Tutorial - Use AI To Scrape ANYTHING This post guides you on building an AI-powered web scraper using Python. The scraper can extract information from any website by passing a URL and a prompt to the AI. Essential tools include Streamlit for the front end, Selenium for web scraping, and Langchain for integrating with AI models. Detailed steps cover setting up the environment, handling dependencies, and developing the UI and backend functions necessary for scraping and parsing web content. The tuto­r­ial also explores overcoming common challenges like captchas and IP bans using Bright Data's scraping browser. 119 3 2. 2 [](/posts/web-scraping-in-python---the-complete-guide-y4mq2oy3z "Web Scraping in Python - The Complete Guide") Article Hacker News · 3y Web Scraping in Python - The Complete Guide This post provides a comprehensive guide to web scraping in Python, including the advantages of using Python for web scraping, the best Python libraries for web scraping, and some tips and best practices for handling challenges in web scraping. It also includes code examples and recommendations for alternative libraries and tools for web scraping. 51 2 3. 3 [](/posts/python-web-scraping-made-easy-explore-these-8-libraries--1fnshvo3g "Python Web Scraping Made Easy: Explore These 8 Libraries 🔍") Article Community Picks · 2y Python Web Scraping Made Easy: Explore These 8 Libraries 🔍 Python is an ideal language for web scraping due to its simplicity and robust ecosystem. This post highlights eight popular Python libraries for web scraping: BeautifulSoup for HTML/XML parsing, Scrapy for creating spiders, Selenium for browser automation, Requests for handling HTTP requests, LXML for efficient XML/HTML processing, PyQuery for jQuery-like querying, MechanicalSoup for browser emulation, and Playwright for cross-browser automation. Each library has unique features catering to various scraping needs. 41 2 4. 4 [](/posts/how-to-automate-whatsapp-messages-using-python-ogipijmzx "How to Automate WhatsApp Messages Using Python") Article TestMu AI (Formerly LambdaTest) · 3y How to Automate WhatsApp Messages Using Python Learn how to automate WhatsApp messages using Python and Selenium. Automating WhatsApp messages can bridge communication gaps, automate notifications, and create a seamless flow of information in test scenarios. Python and Selenium offer versatility, user-friendliness, and strong capabilities for automating WhatsApp messages effectively. Consider using Pywhatkit or Twilio API for WhatsApp, or explore other Python libraries like yowsup, WhatsAPIDriver, and WhatsAPI for automation. Best practices include being aware of WhatsApp's terms, ensuring user privacy and data security, handling errors and exceptions, scheduling messages, understanding rate limits, staying updated with WhatsApp's policies, and maintaining and updating libraries. By following these best practices, you can ethically and successfully automate WhatsApp messages using Python. 41 5. 5 [](/posts/this-open-source-scraper-changes-the-game--9v8llf7tz "This Open Source Scraper CHANGES the Game!!!") Video YouTube · 2y This Open Source Scraper CHANGES the Game!!! An open-source application is capable of scraping data from any website using just the URL and specified data fields, presenting the extracted information in formats like JSON, Excel, and Markdown. The tool leverages GPT models for cost-efficient operations and can handle intricate tasks such as CAPTCHA navigation and infinite scrolling. It avoids using libraries like fire craw for more control but still ensures reliable data extraction through structured output models from OpenAI. 40 1 6. 6 [](/posts/how-to-write-a-test-cases-in-java-3zpvtevld "How To Write a Test Cases in Java") Article TestMu AI (Formerly LambdaTest) · 2y How To Write a Test Cases in Java Writing test cases in Java is essential for ensuring code reliability and robustness. This guide covers fundamental concepts like the importance of test cases, locating WebElements, and setting up a project using Maven and Eclipse IDE with TestNG and Selenium frameworks. It also explains structuring the tests, setting up and tearing down WebDriver instances, and executing tests both locally and on the LambdaTest cloud platform. Additionally, best practices for writing test cases are provided to help make your tests maintainable and reliable. 36 7. 7 [](/posts/python-web-scraping-with-beautiful-soup-and-selenium-kgw3ijgzg "Python Web Scraping with Beautiful Soup and Selenium") Article Earthly · 2y Python Web Scraping with Beautiful Soup and Selenium Learn how to scrape websites with Python using Beautiful Soup and Selenium. Extract data from static pages with Beautiful Soup and navigate dynamic pages with Selenium. 35 1 8. 8 [](/posts/8-useful-pytest-plugins-for-python-automation-2wd1k1ub8 "8 Useful pytest Plugins for Python Automation") Article TestMu AI (Formerly LambdaTest) · 2y 8 Useful pytest Plugins for Python Automation Explore eight useful pytest plugins that can enhance your Python automation testing processes. These plugins include pytest-check for advanced assertions, pytest-bdd for BDD integration, pytest-xdist for parallel test execution, pytest-randomly for random test order, pytest-html for HTML reports, pytest-datafiles for external data file integration, pytest-cov for code coverage reports, and pytest-mock for managing mocks. Learn how to install each plugin and see examples of how they can optimize your testing workflow. 31 1 9. 9 [](/posts/automating-my-bill-payments-with-python-and-selenium-zsejqyt7n "Automating My Bill Payments with Python and Selenium") Video Corey Schafer · 2y Automating My Bill Payments with Python and Selenium Learn how to automate bill payments using Python and Selenium. The author shares a real-world example of automating bill payments using a Python script that takes advantage of various skills and techniques such as navigating web browsers, automating form filling, logging, and sending email and text notifications. 25 10. 10 [](/posts/mherrmann-helium-lighter-web-automation-with-python-8ojyptj9r "mherrmann/helium: Lighter web automation with Python") Article Hacker News · 2y mherrmann/helium: Lighter web automation with Python Helium is a Python library that simplifies web browser automation for Chrome and Firefox, offering a high-level API that shortens and stabilizes scripts by enabling element identification through user-visible labels. It seamlessly integrates with Selenium and includes additional functionalities like easier iFrame interaction, window management, and implicit waits. The author highlights the open-source nature of the project, encourages contributions, and provides steps for getting started and conducting tests. 23 11. 11 [](/posts/7-best-test-automation-tools-to-supercharge-your-software-testing-efficiency-hkqvajyoo "7 Best Test Automation Tools to Supercharge Your Software Testing Efficiency") Article Community Picks · 2y 7 Best Test Automation Tools to Supercharge Your Software Testing Efficiency Test automation is crucial for enhancing the speed, accuracy, efficiency, and cost-effectiveness of software testing. By automating repetitive tasks, it allows human testers to focus on more complex responsibilities. Popular tools like Keploy, Katalon, Selenium, Appium, TestComplete, Cypress, and Siege each offer unique features suitable for various aspects of testing, including web, mobile, API, and performance tests. 23 12. 12 [](/posts/steel-dev-steel-browser-open-source-browser-api-for-ai-agents-apps-steel-browser-is-a-batterie-ojzcwifiw "steel-dev/steel-browser: 🚧 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser instance that lets you build automate the web without worrying about infrastructu") Article Hacker News · 2y steel-dev/steel-browser: 🚧 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser instance that lets you build automate the web without worrying about infrastructu Steel.dev is an open-source browser API that allows developers to build AI apps and agents for web interaction without building automation infrastructure from scratch. It offers full browser control, session management, proxy support, debugging tools, and more. The API supports popular frameworks such as Puppeteer, Playwright, and Selenium, and can be run locally or deployed to various cloud platforms. The project is in public beta and invites contributions and feedback. 18 13. 13 [](/posts/why-playwright-is-less-flaky-than-selenium-ykbbb4oz2 "Why Playwright is less flaky than Selenium") Article Lobsters · 2y Why Playwright is less flaky than Selenium Playwright is considered less flaky than Selenium because its speed forces correct UI test writing from the start. Selenium's slower performance can allow race conditions to pass undetected, leading to erratic test failures. Switching to Playwright may reveal pre-existing issues in tests, which is beneficial for writing more reliable tests. 16 14. 14 [](/posts/lavague-ai-lavague-automate-automation-with-large-action-model-framework-x18bgn1gs "lavague-ai/LaVague: Automate automation with Large Action Model framework") Article Hacker News · 3y lavague-ai/LaVague: Automate automation with Large Action Model framework LaVague is a framework designed to automate menial tasks on behalf of users by transforming natural language instructions into seamless browser interactions. It is built on open-source projects, integrates with Selenium, and supports local models for privacy and control. 16 15. 15 [](/posts/selenium-python-tutorial-a-python-automation-testing-guide-with-examples-yaeiet3i2 "Selenium Python Tutorial : A Python Automation Testing Guide with examples") Article TestMu AI (Formerly LambdaTest) · 2y Selenium Python Tutorial : A Python Automation Testing Guide with examples Learn how to automate web browsers using Selenium and Python with this comprehensive guide. The tutorial covers installation steps, configuring Selenium with Python, setting up projects, running automated tests on local and cloud grids, handling keyboard and mouse actions, interacting with dropdowns, radio buttons, checkboxes, alerts, and iFrames, and more. Ideal for those seeking to enhance their web testing skills. 15 16. 16 [](/posts/playwright-vs-selenium-which-one-to-choose-f5l5r4tuy "Playwright vs Selenium: Which One to Choose") Video Oxylabs · 2y Playwright vs Selenium: Which One to Choose Selenium and Playwright are two popular web automation frameworks used for web scraping and testing. Selenium supports a wide range of programming languages and browsers but requires individual WebDriver installations. On the other hand, Playwright, although supporting fewer languages and browsers, offers an easier implementation and faster performance due to its modern architecture and built-in drivers. Both tools have their own strengths, making Selenium suitable for flexibility and extensive community support, while Playwright is best for simpler and quicker implementations. 15 1 17. 17 [](/posts/how-to-generate-pytest-code-coverage-report-eh58xifac "How To Generate Pytest Code Coverage Report") Article TestMu AI (Formerly LambdaTest) · 2y How To Generate Pytest Code Coverage Report Code coverage measures how much of an application's source code is exercised by tests, typically expressed as a percentage. Using the pytest framework, developers can generate detailed code coverage reports using tools like coverage.py and pytest-cov. These tools provide various reporting options, such as HTML or XML, and support extensive customization. Achieving high code coverage helps identify untested code, minimizing the risk of undetected bugs. Walkthroughs and examples demonstrate how to set up and execute tests for comprehensive code coverage, even on cloud-based platforms like LambdaTest. 15 18. 18 [](/posts/16-selenium-best-practices-for-efficient-test-automation-ii08cvfag "16 Selenium Best Practices For Efficient Test Automation") Article TestMu AI (Formerly LambdaTest) · 3y 16 Selenium Best Practices For Efficient Test Automation This post provides 16 Selenium best practices for efficient test automation. It covers topics such as avoiding blocking sleep calls, naming test cases appropriately, setting the browser zoom level to 100 percent, using the best-suited web locator, implementing logging and reporting, using design patterns like Page Object Model (POM), and leveraging parallel testing in Selenium. The post also includes a list of worst practices to avoid in automation testing with Selenium. 14 19. 19 [](/posts/how-to-bypass-recaptcha-v2-v3-using-code-and-another-way-b4ukyywq3 "How to bypass reCAPTCHA V2/V3 using code and another way") Article habr · 2y How to bypass reCAPTCHA V2/V3 using code and another way The post details various methods to bypass Google's reCAPTCHA using programming languages like Python, JavaScript, and PHP. It discusses the evolution of reCAPTCHA from V1 to V3 and introduces different modules and tools that can solve these CAPTCHA challenges. The post provides code examples and highlights the use of automation tools such as Selenium to ease the bypassing process. 12 20. 20 [](/posts/what-are-the-best-python-web-scraping-libraries--54gnbxoiz "What are the best Python web scraping libraries?") Article Community Picks · 3y What are the best Python web scraping libraries? Explore the best Python web scraping libraries and frameworks, including HTTP libraries like Requests and HTTPX, Beautiful Soup for HTML parsing, Selenium and Playwright for browser automation, and Scrapy for complex scraping jobs. Each library has its own pros and cons, so it's important to choose the one that best fits your project's needs. 13 21. 21 [](/posts/lavague-s-open-sourced-large-action-model-outperforms-gemini-and-chatgpt-in-information-retrieval-a-ta72pb2ml "LaVague’s Open-Sourced Large Action Model Outperforms Gemini and ChatGPT in Information Retrieval: A Game Changer in AI Web Agents") Article Machine Learning News · 2y LaVague’s Open-Sourced Large Action Model Outperforms Gemini and ChatGPT in Information Retrieval: A Game Changer in AI Web Agents LaVague is an open-sourced framework that simplifies the creation and deployment of AI agents for information retrieval. It offers powerful capabilities and easy integration with private data sources. LaVague aims to revolutionize AI-driven automation and encourages community participation and sharing. 12 22. 22 [](/posts/chrome-s-headless-mode-gets-an-upgrade-introducing---headless-new-9un7xoco9 "Chrome's Headless mode gets an upgrade: introducing --headless=new") Article Community Picks · 3y Chrome's Headless mode gets an upgrade: introducing --headless=new Chrome's Headless mode has been upgraded with the introduction of --headless=new. The new version unifies Headless and headful modes, removing limitations and bugs of the old implementation. Developers can try out the new Headless mode using the \`--headless=new\` flag. The new mode supports various command-line flags like \`--dump-dom\`, \`--screenshot\`, and \`--print-to-pdf\`. To debug Headless Chrome, the \`--remote-debugging-port\` flag can be used. 12 23. 23 [](/posts/learn-to-test-software-automatically-with-selenium-and-python-pgtnnszhn "Learn to Test Software Automatically with Selenium and Python") Article JetBrains · 3y Learn to Test Software Automatically with Selenium and Python Learn to test software automatically with Selenium and Python. The course covers automated testing, its importance, and provides access to the course on JetBrains Marketplace. 12 1 24. 24 [](/posts/how-to-handle-hidden-elements-in-selenium-webdriver-dp8h8sgt2 "How to Handle Hidden Elements in Selenium WebDriver") Article TestMu AI (Formerly LambdaTest) · 2y How to Handle Hidden Elements in Selenium WebDriver Learn how to handle hidden elements in Selenium WebDriver. Discover what hidden elements are, how to access them using JavaScriptExecutor, and avoid exceptions while interacting with them. Also, find answers to frequently asked questions about hidden elements in Selenium. 11 [See all Selenium archives](/tags/selenium/best-of) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/tags/selenium/best-of/2024#page","url":"https://daily.dev/tags/selenium/best-of/2024","name":"Best Selenium Posts of 2024","description":"The most upvoted Selenium posts of 2024, curated by the daily.dev community.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/tags/selenium/best-of/2024#items","numberOfItems":24,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/python-ai-web-scraper-tutorial---use-ai-to-scrape-anything-qvtnlkrx6","name":"Python AI Web Scraper Tutorial - Use AI To Scrape ANYTHING"},{"@type":"ListItem","position":2,"url":"https://daily.dev/posts/web-scraping-in-python---the-complete-guide-y4mq2oy3z","name":"Web Scraping in Python - The Complete Guide"},{"@type":"ListItem","position":3,"url":"https://daily.dev/posts/python-web-scraping-made-easy-explore-these-8-libraries--1fnshvo3g","name":"Python Web Scraping Made Easy: Explore These 8 Libraries 🔍"},{"@type":"ListItem","position":4,"url":"https://daily.dev/posts/how-to-automate-whatsapp-messages-using-python-ogipijmzx","name":"How to Automate WhatsApp Messages Using Python"},{"@type":"ListItem","position":5,"url":"https://daily.dev/posts/this-open-source-scraper-changes-the-game--9v8llf7tz","name":"This Open Source Scraper CHANGES the Game!!!"},{"@type":"ListItem","position":6,"url":"https://daily.dev/posts/how-to-write-a-test-cases-in-java-3zpvtevld","name":"How To Write a Test Cases in Java"},{"@type":"ListItem","position":7,"url":"https://daily.dev/posts/python-web-scraping-with-beautiful-soup-and-selenium-kgw3ijgzg","name":"Python Web Scraping with Beautiful Soup and Selenium"},{"@type":"ListItem","position":8,"url":"https://daily.dev/posts/8-useful-pytest-plugins-for-python-automation-2wd1k1ub8","name":"8 Useful pytest Plugins for Python Automation"},{"@type":"ListItem","position":9,"url":"https://daily.dev/posts/automating-my-bill-payments-with-python-and-selenium-zsejqyt7n","name":"Automating My Bill Payments with Python and Selenium"},{"@type":"ListItem","position":10,"url":"https://daily.dev/posts/mherrmann-helium-lighter-web-automation-with-python-8ojyptj9r","name":"mherrmann/helium: Lighter web automation with Python"},{"@type":"ListItem","position":11,"url":"https://daily.dev/posts/7-best-test-automation-tools-to-supercharge-your-software-testing-efficiency-hkqvajyoo","name":"7 Best Test Automation Tools to Supercharge Your Software Testing Efficiency"},{"@type":"ListItem","position":12,"url":"https://daily.dev/posts/steel-dev-steel-browser-open-source-browser-api-for-ai-agents-apps-steel-browser-is-a-batterie-ojzcwifiw","name":"steel-dev/steel-browser: 🚧 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser instance that lets you build automate the web without worrying about infrastructu"},{"@type":"ListItem","position":13,"url":"https://daily.dev/posts/why-playwright-is-less-flaky-than-selenium-ykbbb4oz2","name":"Why Playwright is less flaky than Selenium"},{"@type":"ListItem","position":14,"url":"https://daily.dev/posts/lavague-ai-lavague-automate-automation-with-large-action-model-framework-x18bgn1gs","name":"lavague-ai/LaVague: Automate automation with Large Action Model framework"},{"@type":"ListItem","position":15,"url":"https://daily.dev/posts/selenium-python-tutorial-a-python-automation-testing-guide-with-examples-yaeiet3i2","name":"Selenium Python Tutorial : A Python Automation Testing Guide with examples"},{"@type":"ListItem","position":16,"url":"https://daily.dev/posts/playwright-vs-selenium-which-one-to-choose-f5l5r4tuy","name":"Playwright vs Selenium: Which One to Choose"},{"@type":"ListItem","position":17,"url":"https://daily.dev/posts/how-to-generate-pytest-code-coverage-report-eh58xifac","name":"How To Generate Pytest Code Coverage Report"},{"@type":"ListItem","position":18,"url":"https://daily.dev/posts/16-selenium-best-practices-for-efficient-test-automation-ii08cvfag","name":"16 Selenium Best Practices For Efficient Test Automation"},{"@type":"ListItem","position":19,"url":"https://daily.dev/posts/how-to-bypass-recaptcha-v2-v3-using-code-and-another-way-b4ukyywq3","name":"How to bypass reCAPTCHA V2/V3 using code and another way"},{"@type":"ListItem","position":20,"url":"https://daily.dev/posts/what-are-the-best-python-web-scraping-libraries--54gnbxoiz","name":"What are the best Python web scraping libraries?"},{"@type":"ListItem","position":21,"url":"https://daily.dev/posts/lavague-s-open-sourced-large-action-model-outperforms-gemini-and-chatgpt-in-information-retrieval-a-ta72pb2ml","name":"LaVague’s Open-Sourced Large Action Model Outperforms Gemini and ChatGPT in Information Retrieval: A Game Changer in AI Web Agents"},{"@type":"ListItem","position":22,"url":"https://daily.dev/posts/chrome-s-headless-mode-gets-an-upgrade-introducing---headless-new-9un7xoco9","name":"Chrome's Headless mode gets an upgrade: introducing --headless=new"},{"@type":"ListItem","position":23,"url":"https://daily.dev/posts/learn-to-test-software-automatically-with-selenium-and-python-pgtnnszhn","name":"Learn to Test Software Automatically with Selenium and Python"},{"@type":"ListItem","position":24,"url":"https://daily.dev/posts/how-to-handle-hidden-elements-in-selenium-webdriver-dp8h8sgt2","name":"How to Handle Hidden Elements in Selenium WebDriver"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Tags","item":"https://daily.dev/tags"},{"@type":"ListItem","position":3,"name":"Selenium","item":"https://daily.dev/tags/selenium"},{"@type":"ListItem","position":4,"name":"Best of","item":"https://daily.dev/tags/selenium/best-of"},{"@type":"ListItem","position":5,"name":"2024"}]}]} ```