For detailed information, you can go through the Docs. I will be explaining things in a simpler way. Primarily it is for automating web applications for testing purposes, but is certainly not limited to just that.īoring web-based administration tasks can (and should) also be automated as well. "Selenium is a portable framework for testing web applications." - Wikipedia In this we will be creating a basic project with Selenium for a dynamic website. Python uses Selenium ,Beautiful Soup, Scrapy and a few more. So, various languages provide various libraries,frameworks and tools to make a Web Scraper or a Web Crawler. These days Web-Scraping is being used in every fields staring from Digital Marketing to DataScience or AI. You give it a list of things to extract and then it goes for shopping(scraping) from a website.įor example, you need an image, it searches for img tags. Instead doing things manually, you can automate things. Have you ever searched and downloaded images? Or have ever Ctrl+ C and Ctrl+ V (If you know you know)? Or submitted an assignment with the solutions you get online? Basically, this is what scraping is.Ĭollecting data or to be more specific Extracting data from a website is Web-Scraping. We will be writing a program that takes the YouTube playlist link and web-scraps all the video links using Selenium and download the videos using YouTube-dl. This post will be about a simple project "YoPlaDo-YouTube Playlist Downloader" built using Python. Why pay for a service you can build with a few lines of code? Wait a minute, you are a Python developer. Exams are important, you can pay for them and if it is about learning, let it take some more time, we have entire life?
You can download the playlist videos one-by-one(until that's a huge one).
OOPS, either they download one video at a time or if they download a complete playlist at once, they are paid ones. Now, there are websites/applications to download YouTube videos. Or like, you wanted to learn a new skill/language/framework from YouTube and you get a good "playlist" but limited storage space in your phone.
Have you ever been in a situation like, you are having you final exams in a week or so and you haven't attended a single lecture(I mean mindfully, of course)? Then you ask YouTube for help (happens in my case every time) and what you get is a huge(even larger than node_modules) playlist to watch and limited data/data-speed at your place. Note:This post is just for educational purpose to show the use of Webscraping.
0 kommentar(er)
