How to use test_should_report_shiftkey method in Playwright Python

you can use the channel msedge

robotframework example

New Browser chromium headless=false channel=msedge

New Context viewport={'width': 1920, 'height': 1080}

New Page https://marketsquare.github.io/robotframework-browser/Browser.html

Methods in python are snake case. context.add_cookies should do the work.

If you need to handle new page without event listener (i.e. new tab open by link click), you can try this code:

    from playwright import sync_playwright

    with sync_playwright() as p:
        browser = p.chromium.launch()
        context = browser.newContext()
        page = context.newPage()
        page.goto('<site url>')
        with context.expect_page() as tab:
            page.click('.newTabByLink')
        # do some steps
        ...
        tab.close()
        
        browser.close()

Instead of:

page.once("dialog", lambda dialog: asyncio.create_task(dialog.accept()))

It should apparently be just:

page.once("dialog", lambda dialog: dialog.accept())

This was basically a lucky guess, so take it with a grain of salt. I can't find a good source to back it up.

At the time of writing, the documentation for the Python version of Playwright doesn't seem to mention page.once() at all.

In the original JavaScript version of Playwright, page.once() is documented as part of the standard Node.js EventEmitter class, from which Page is derived. Nothing like EventEmitter exists in the Python standard library, though.

Playwright does not play well with relative paths, use os.getcwd() instead. Also, note that you don't need to ensure that directories exist, playwright creates them automatically if they don't.

from playwright.sync_api import sync_playwright
import os

user_dir = 'tmp/playwright'
user_dir = os.path.join(os.getcwd(), user_dir)

with sync_playwright() as p:
    browser = p.chromium.launch_persistent_context(user_dir, headless=False)
    page = browser.new_page()
    page.goto('https://playwright.dev/python', wait_until='domcontentloaded')

The only way I found is wrap the goto inside a try-except block

Content of main.py

from playwright.sync_api import Playwright, sync_playwright, expect

with sync_playwright() as p:
    #We define the browser, the context and the page
    browser = p.chromium.launch(headless=False)
    context = browser.new_context()
    page = browser.new_page()
    with page.expect_download() as download_info:
        #If we navigate without try, it will throw an exception and it will stop our script, so, we wrap it inside a try except block
        try:
            page.goto("https://manueltgomes.com/wp-content/uploads/2021/09/ParseHTMLLInks_1_0_0_1.zip")
        except:
            pass
    download = download_info.value
    download.save_as(f"./{download.suggested_filename}")
    context.close()
    browser.close()

Then just run python3 main.py

The file will be saved in the same path of the main.py file

Absent seeing the actual site, a traditional selection and get_attribute should be sufficient:

from playwright.sync_api import sync_playwright

with sync_playwright() as p:
    browser = p.chromium.launch(headless=True)
    page = browser.new_page()
    page.set_content("""
    <iframe title="IFRAME_NAME" src="https://www.data_I_want_TO_get.com"></iframe>
    """)
    src = page.get_attribute('iframe[title="IFRAME_NAME"]', "src")
    print(src)  # => https://www.data_I_want_TO_get.com
    browser.close()

If the frame isn't immediately visible you can wait for it by replacing the src = line with

src = (
    page.wait_for_selector('iframe[title="IFRAME_NAME"]')
        .get_attribute("src")
)

Your code looks fine. Try the df.iloc[row_start:row_finish,column_start:column_finish] command. It works for me. It may also be a problem with the Jupyter notebook - style running of Playwright. Save this into a file.py and run from the terminal in the correct directory: python file.py

I used asyncio to run Playwright, as I had a template script available, but you should get it working without it too, if you want.

import pandas as pd
import asyncio
from playwright.async_api import Playwright, async_playwright
import pandas as pd

async def run(playwright: Playwright) -> None:
    browser = await playwright.chromium.launch(headless=False, slow_mo=50)
    page = await browser.new_page()
    ## Go to PAPA property address
    await page.goto("https://www.pbcgov.org/papa/Asps/PropertyDetail/PropertyDetail.aspx?parcel=73414434010020070")
    x = await page.content() #You're not using this, so you may as well remove this line.

    ## Click text=View Building Details
    await page.locator("text=View Building Details").click()
    #######################################

    ## Click text=Building 2
    await page.frame_locator("#MainContent_Iframe7").locator("text=Building 2").click()
    x2 = await page.frame_locator("#MainContent_Iframe7").locator("html").inner_html()

    ## Click text=Building 3
    await page.frame_locator("#MainContent_Iframe7").locator("text=Building 3").click()
    x3 = await page.frame_locator("#MainContent_Iframe7").locator("html").inner_html()

    ## Click text=Building 4
    await page.frame_locator("#MainContent_Iframe7").locator("text=Building 4").click()
    x4 = await page.frame_locator("#MainContent_Iframe7").locator("html").inner_html()

    x2s = pd.read_html(x2)
    x3s = pd.read_html(x3)
    x4s = pd.read_html(x4)

    print(x2s[3].iloc[0:,0:]) # When it works this is the table that I want
    print(x3s[3].iloc[0:,0:])
    print(x4s[3].iloc[0:,0:])

    year_built_building_1 = x2s[3].iloc[3][2]
    year_built_building_2 = x3s[3].iloc[3][2]
    year_built_building_3 = x4s[3].iloc[3][2]
    
    print(year_built_building_1,year_built_building_2,year_built_building_3)


async def main(debug=True) -> None:
    async with async_playwright() as playwright:
        await run(playwright)

asyncio.run(main())

On my side it outputs:

                                     1                                   2
0   Structural Element for  Building 1  Structural Element for  Building 1
1                                  NaN                                 NaN
2                      Exterior Wall 1               CONCRETE BLOCK STUCCO
3                           Year Built                                2018
4                  Air Condition Desc.                                 NaN
5                            Heat Type                                NONE
6                            Heat Fuel                                NONE
7                            Bed Rooms                                 NaN
8                           Full Baths                                 NaN
9                           Half Baths                                   1
10                      Roof Structure           WOOD JOISTS, WOOD/COMPOSI
11                          Roof Cover           ALUMINUM/STEEL PANEL ENML
12                     Interior Wall 1                              STABLE
13                        Floor Type 1                         RUBBER TILE
14                             Stories                                   1
                                     1                                   2
0   Structural Element for  Building 1  Structural Element for  Building 1
1                                  NaN                                 NaN
2                      Exterior Wall 1               CONCRETE BLOCK STUCCO
3                           Year Built                                2018
4                  Air Condition Desc.                                 NaN
5                            Heat Type                                NONE
6                            Heat Fuel                                NONE
7                            Bed Rooms                                 NaN
8                           Full Baths                                 NaN
9                           Half Baths                                   1
10                      Roof Structure           WOOD JOISTS, WOOD/COMPOSI
11                          Roof Cover           ALUMINUM/STEEL PANEL ENML
12                     Interior Wall 1                              STABLE
13                        Floor Type 1                         RUBBER TILE
14                             Stories                                   1
                                     1                                   2
0   Structural Element for  Building 1  Structural Element for  Building 1
1                                  NaN                                 NaN
2                      Exterior Wall 1               CONCRETE BLOCK STUCCO
3                           Year Built                                2018
4                  Air Condition Desc.                                 NaN
5                            Heat Type                                NONE
6                            Heat Fuel                                NONE
7                            Bed Rooms                                 NaN
8                           Full Baths                                 NaN
9                           Half Baths                                   1
10                      Roof Structure           WOOD JOISTS, WOOD/COMPOSI
11                          Roof Cover           ALUMINUM/STEEL PANEL ENML
12                     Interior Wall 1                              STABLE
13                        Floor Type 1                         RUBBER TILE
14                             Stories                                   1
2018 2018 2018

There are two things to notice:

1. Python executable
2. Alternatives priority

Executable

Running in the base image:

# which python
# which python3
/usr/bin/python3
# ls -l /usr/bin/python*
lrwxrwxrwx 1 root root       9 Mar 13  2020 /usr/bin/python3 -> python3.8
-rwxr-xr-x 1 root root 5230592 Jun 22 20:18 /usr/bin/python3.8

With the following Dockerfile (from the question);

FROM mcr.microsoft.com/playwright
RUN apt update
RUN apt install -y software-properties-common
RUN add-apt-repository -y ppa:deadsnakes/ppa
RUN apt update
RUN apt install -y python3.10

RUN update-alternatives --install /usr/bin/python python /usr/bin/python3.10 1
RUN update-alternatives --install /usr/bin/python python /usr/bin/python3.8 2

python is now added and controlled by alternatives, but python3 is untouched:

# ls -l /usr/bin/python*
lrwxrwxrwx 1 root root      24 Dec 16 04:10 /usr/bin/python -> /etc/alternatives/python
lrwxrwxrwx 1 root root       9 Mar 13  2020 /usr/bin/python3 -> python3.8
-rwxr-xr-x 1 root root 5565184 Dec  7 01:12 /usr/bin/python3.10
-rwxr-xr-x 1 root root 5230592 Jun 22 20:18 /usr/bin/python3.8
# ls -l /etc/alternatives/python
lrwxrwxrwx 1 root root 18 Dec 16 04:10 /etc/alternatives/python -> /usr/bin/python3.8

Priority

From alternative's manpage:

If the group is in automatic mode, and the newly added alternatives' priority is higher than any other installed alternatives for this group, the symlinks will be updated to point to the newly added alternatives.

This is numeric, so it's not that 1 is the winner and 2 is second-best, but rather 2 is higher than 1.

Resolution

By changing both the executable form python to python3, and the priority so that 3.10 will be 2 and 3.8 will be 1 (as such):

FROM mcr.microsoft.com/playwright
RUN apt update
RUN apt install -y software-properties-common
RUN add-apt-repository -y ppa:deadsnakes/ppa
RUN apt update
RUN apt install -y python3.10

RUN update-alternatives --install /usr/bin/python3 python /usr/bin/python3.10 2
RUN update-alternatives --install /usr/bin/python3 python /usr/bin/python3.8 1

the default python version should be 3.10:

# which python
# which python3
# ls -l /usr/bin/python*
lrwxrwxrwx 1 root root      24 Dec 16 04:16 /usr/bin/python3 -> /etc/alternatives/python
-rwxr-xr-x 1 root root 5565184 Dec  7 01:12 /usr/bin/python3.10
-rwxr-xr-x 1 root root 5230592 Jun 22 20:18 /usr/bin/python3.8
# ls -l /etc/alternatives/python
lrwxrwxrwx 1 root root 19 Dec 16 04:16 /etc/alternatives/python -> /usr/bin/python3.10
# python3 --version
Python 3.10.9