How to use test_accessibility_multiselectable method in Playwright Python

Playwright does not support key filtering at the moment. But you can filter for the job.id which is part of the props:

from playwright.sync_api import sync_playwright

with sync_playwright() as p:
    browser = p.chromium.launch()
    page = browser.new_page()
    page.goto("https://www.glassdoor.co.uk/Job/qa-engineer-jobs-SRCH_KO0,11.htm")
    page.locator("_react=q[job.id=1007630619432]").click()
    browser.close()

The only way I found is wrap the goto inside a try-except block

Content of main.py

from playwright.sync_api import Playwright, sync_playwright, expect

with sync_playwright() as p:
    #We define the browser, the context and the page
    browser = p.chromium.launch(headless=False)
    context = browser.new_context()
    page = browser.new_page()
    with page.expect_download() as download_info:
        #If we navigate without try, it will throw an exception and it will stop our script, so, we wrap it inside a try except block
        try:
            page.goto("https://manueltgomes.com/wp-content/uploads/2021/09/ParseHTMLLInks_1_0_0_1.zip")
        except:
            pass
    download = download_info.value
    download.save_as(f"./{download.suggested_filename}")
    context.close()
    browser.close()

Then just run python3 main.py

The file will be saved in the same path of the main.py file

The sync_api is simply a wrapper around the asyncio_api that abstracts asyncio usage away from you. As such, the capabilities are largely the same, but the async_api may afford some more flexibility in complex scenarios (for example, in previous playwright-python releases the only way to run instances in a multi-threaded fashion on Unix + Python 3.7 was to use the async_api for reasons I won't get into here).

Chances are you won't need that flexibility though, so I'd just suggest using whatever you're comfortable with.

I may be wrong on this but let's say the button you are trying to click has link which will redirect you to another page/site and you want to go to that link. You should take the attribute value of the selector and just navigate there. Check here for more details : https://playwright.dev/python/docs/api/class-page#page-get-attribute

It means that your object of ScrapyPlaywrightDownloadHandler doesn't have an attribute named browser.

At the end of each iteration of "y" you issue a mouse up event. However, you dont issue a mouse move event to the start of the new line before putting the mouse down again.

Try the below code:

    for y in range(100, 1000, 100):
        # Generate mouse points
        points = []
        wm(start_point, y, x, y, M_0=15, D_0=12, move_mouse=lambda x, y: points.append([x, y]))

        page.mouse.up()
        # Move mouse to start of new line
        page.mouse.move(points[0][0], points[0][1])
        # Mouse back down
        page.mouse.down()
        #Iterate the remaining points
        for point in points[1:]:
            page.mouse.move(point[0], point[1])
        page.mouse.up()

So how do I scrape a website which has dynamic content?

there are a few options:

1. Use Selenium, which allows you to simulate opening a browser, letting the page render, then pull the html source code
2. Sometimes you can look at the XHR and see if you can fetch the data directly (like from an API)
3. Sometimes the data is within the <script> tags of the html source. You could search through those and use json.loads() once you manipulate the text into a json format

what exactly is the difference between dynamic and static content?

Dynamic means the data is generated from a request after the initial page request. Static means all the data is there at the original call to the site

How do I extract other information like price and image from the website? and how to get particular classes for example like a price?

Refer to your first question

how would I know that data is dynamically created?

You'll know it's dynamically created if you see it in the dev tools page source, but not in the html page source you first request. You can also see if the data is generated by additional requests in the dev tool and looking at Network -> XHR

Lastly

Amazon does offer an API to access the data. Try looking into that as well

So, it seems that this is simply not directly possible with python-playwright, nor is it going to be. From this discussion, I gathered that the dialog...

"[...] is not a part of the web, it is a part of the browser, so we don't automate it."

There are workarounds, e.g. to trigger a download in a different way, but this would then not involve handling the browser dialog, as stated in the question.

It is not possible to do it with the URL as I can see

Anyways, I prepared an script for making what you wanted. I used an auxiliar function that you can use. I hope it works for you.

import time
from playwright.sync_api import Playwright, sync_playwright, expect

#This function wait for an element, if the element is not present it return false instead of throwing an exception and stopping the script. If element is not present after the timeout, it return false and we can use that false for our desired flow
def wait_for_selector_with_no_exception(page, selector, timeout):
    try:
        page.wait_for_selector(selector, timeout=timeout)
        return True
    except:
        return False

with sync_playwright() as p:
    #We define the browser, the context and the page
    browser = p.chromium.launch(headless=False)
    context = browser.new_context(
        user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36')
    page = browser.new_page()

    #We navigate to URL of the car we want (In this case the Tesla from your example)
    url_for_car = "https://turo.com/us/en/car-rental/united-states/austin-tx/tesla/model-s/1733237"
    page.goto(url_for_car)

    #We do click into start date dropdown element
    page.locator("#reservationDates-dateRangePicker").click()

    #Here we define the selector for the start date we want (You can replace it with your desired date, of course)
    selector_for_start_date="//td[contains(@aria-label,'December 29, 2022')]"

    #We use our auxiliar function to see if the start date is within the DOM, if not we click on arrow for moving to next month
    while not wait_for_selector_with_no_exception(page=page, selector=selector_for_start_date, timeout=2000):
        page.locator(".DayPickerNavigationNext_icon").click()

    #Once desired start date is within the DOM we click on it
    page.locator(selector_for_start_date).click()

    #This selector is the second datepicker element once is open
    selector_when_date_end_is_open = '//div[@class="DateInput_displayText DateInput_displayText__focused DateInput_displayText__has-input"]/..//input[@id="reservationDates-dateRangePicker-endDate"]'

    #We wait till the second datepicker is already open
    page.wait_for_selector(selector_when_date_end_is_open)

    #Here we define the selector for the end date we want (Also you can replace it with your desired end date)
    selector_for_end_date="//td[contains(@aria-label,'March 23, 2023')]"

    #Same we did with start date but with end date, we wait for our end date element, if is not present we click on next arrow
    while not wait_for_selector_with_no_exception(page=page, selector=selector_for_end_date, timeout=2000):
        page.locator(".DayPickerNavigationNext_icon").click()

    #Once our end date is present we click on it
    page.locator(selector_for_end_date).click()

    #This sleep you can remove it, is only for you to see that it worked as expected
    time.sleep(10)

    #We close the context and the browser
    context.close()
    browser.close()

As you can see, I used xpath for my selectors because it is what I have under control, if you find a way of doing it with CSS go ahead.