Selenium - Basic Authentication Via Url

Selenium - Basic Authentication via url

There were some updates in this link as :

Chromium Issue 435547 Drop support for embedded credentials in subresource requests. (removed)

We should block requests for subresources that contain embedded credentials (e.g. "http://ima_user:hunter2@example.com/yay.tiff"). Such resources would be handled as network errors.

However, Basic Authentication functionality still works with Selenium 3.4.0, geckodriver v0.18.0, chromedriver v2.31.488763, Google Chrome 60.x and Mozilla Firefox 53.0 through Selenium-Java bindings.

Here is the example code which tries to open the URL http://the-internet.herokuapp.com/basic_auth with a valid set of credentials and it works.

Firefox:

import org.openqa.selenium.WebDriver;
import org.openqa.selenium.firefox.FirefoxDriver;

public class BasicAuthentication_FF 
{
    public static void main(String[] args) 
    {
        System.setProperty("webdriver.gecko.driver", "C:\\Utility\\BrowserDrivers\\geckodriver.exe");
        WebDriver driver =  new FirefoxDriver();
        driver.navigate().to("http://admin:admin@the-internet.herokuapp.com/basic_auth");
    }
}

Chrome:

import org.openqa.selenium.WebDriver;
import org.openqa.selenium.chrome.ChromeDriver;
import org.openqa.selenium.chrome.ChromeOptions;

public class BasicAuthentication_Chrome 
{
    public static void main(String[] args) 
    {
        System.setProperty("webdriver.chrome.driver", "C:\\Utility\\BrowserDrivers\\chromedriver.exe");
        ChromeOptions options = new ChromeOptions();
        options.addArguments("start-maximized");
        options.addArguments("disable-infobars");
        options.addArguments("--disable-extensions");
        WebDriver driver =  new ChromeDriver(options);
        driver.navigate().to("http://admin:admin@the-internet.herokuapp.com/basic_auth");
    }
}

How to manage Basic Authentication login with selenium c#?

After days on research and trying, this is what works for me, i did a Google Chrome extension, the basic authentication method of http://user:password@mywebsite.com don't work anymore so i did this extension with my credentials, it's kinda risky but it was the only solution that i found

First you need to make a manifest.json:

{
  "name": "Webrequest API",
  "version": "1.0",
  "description": "Extension to handle Authentication window",
  "permissions": [
    "webRequest",
    "webRequestBlocking",
    "<all_urls>"
  ],
  "background": {
    "scripts": [
      "webrequest.js"
    ]
  },
  "manifest_version": 2
}

Then you need to create webrequest.js:

chrome.webRequest.onAuthRequired.addListener(function(details){
        console.log("chrome.webRequest.onAuthRequired event has fired");
        return {
                authCredentials: {username: "myusername", password: "mypassword"}
            };
    },
    {urls:["<all_urls>"]},
    ['blocking']);

After that you need to create the crx, in the chrome://Extension site in developer mode, after that you should login without problem in the website you're trying to login.

References:
How to handle authentication popup in Chrome with Selenium WebDriver using Java

I hope help to anyone who come to this post

Selenium using Chrome browser - Timeout during HTTP basic authentication [Python]

What worked here finally was to discard using the Selenium way of using send_keys() approach but use other packages to do the job. The following two snippets worked.

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
import keyboard
​
options = webdriver.ChromeOptions()
options.add_argument('--ignore-certificate-errors')
options.add_argument('--ignore-ssl-errors')
driver = webdriver.Chrome(r"path_to_chromedriver.exe", options=options)
driver.maximize_window()
driver.get("<replace with url>")
​
keyboard.write(r"<replace with username>")
keyboard.press_and_release("tab")
keyboard.write("<replace with password>")
keyboard.press_and_release("tab")
keyboard.press_and_release("enter")

Or this one (pip install pywin32 before)

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
import win32com.client 
​
options = webdriver.ChromeOptions()
options.add_argument('--ignore-certificate-errors')
options.add_argument('--ignore-ssl-errors')
driver = webdriver.Chrome(r"path_to_chromedriver.exe", options=options)
driver.maximize_window()
driver.get("<replace with url>")
​
shell = win32com.client.Dispatch("WScript.Shell")  
shell.SendKeys(r"<replace with username>")
shell.SendKeys("{TAB}")
shell.SendKeys("<replace with password>")
shell.SendKeys("{TAB}")

Python HTTP Basic Authentication through Selenium when username and password contains special characters

For Basic Authentication if the Password contains symbols e.g. "''asd'asd';123asd' you need to translate the string into UTF. As an example:

username = "%21%40user" #stands for !@user
password = "%0D%0Apass" #stands for ^&pass
webpage = "something.url.com"

Now you can use:

url = 'http://{}:{}@{}'.format(username, password, webpage)
driver.get(url)

Python Selenium - Alert Like Authentication Pop Up

The reason you cannot "find" the element

The alert box is not an HTML element. It's not part of the webpage, thus you could not see it in the HTML code. The alert box is part of the browser.

Some context

What you are seeing is an example of the Basic access authentication. As the wiki stated, what usually would happen is that your app/browser automatically provides the username and password via a header field (the Authorization header) in the request. In this case, your browser does not know the username and password yet so it asks for it via the browser's alert box.

My proposed solution

I believe the cleanest and easiest way to authenticate using selenium would be providing the credential during your get method like so:

chrome.get('http://username:password@domain')

In your specific case, it would be http://admin:admin@the-internet.herokuapp.com/basic_auth.

However, as @Nic-Laforge mentioned, this solution is dependent on the fact that the browser supports it. (as of writing the latest Chrome supports it)

The solutions from the other StackOverflow post

Unlike my proposed solution, both of the solutions proposed in the similar StackOverflow post require additional libraries.

The first solution Mr. @Evander proposes is to use a pynput library to simulate keyboard input. This solution requires the user to use a non-headless browser, to have the browser focused, and to not interact with the keyboard during the input.

The second solution is much nicer. As stated above, the Basic access authentication expects your credentials in the Authorization header in the request. What Mr. @Evander did is use the selenium-wire library to intercept selenium's request and add the header with the credentials.

---

Related Topics