How to use _on_load_state method in Playwright Python

It would appear that when you run the script on your server, the user you're using does not have permission to create either the local_save directory or the path to that directory. On a Unix-like system, /var and most of its subdirectories are generally writable only by root. The exception is /var/tmp. If you change your local_save variable to be

local_save = '/var/tmp/apis/tceprotocolo'

and prior to calling your function, call

os.makedirs(local_save)

then your function should successfully write output to that directory.

It would appear that when you run the script on your server, the user you're using does not have permission to create either the local_save directory or the path to that directory. On a Unix-like system, /var and most of its subdirectories are generally writable only by root. The exception is /var/tmp. If you change your local_save variable to be

local_save = '/var/tmp/apis/tceprotocolo'

and prior to calling your function, call

os.makedirs(local_save)

then your function should successfully write output to that directory.

You can access the href in an almost similar way to that of selenium.

element_handle = page.locator("//a")
link = element_handle.get_attribute('href')

How about checking if the element is clickable: https://playwright.dev/docs/api/class-locator#locator-click

use trial option and if it returns true continue execution

  await page.click(First_Row_Download, , {trial:true})

When I try to run the chromium browser that downloaded by playwright using this command

!/root/.cache/ms-playwright/chromium-1033/chrome-linux/chrome

It gives this error

src/tcmalloc.cc:283] Attempt to free invalid pointer 0x18400020c5a0

It means the problem is somehow related to the browser downloaded by playwright. We can use a different browser.

First, install chromium.

!apt install chromium-chromedriver

Set executable_path and user_data_dir with launch_persistent_context in your code.

import nest_asyncio
nest_asyncio.apply()

import asyncio
from playwright.async_api import async_playwright

async def main():
    async with async_playwright() as p:
        browser = await p.chromium.launch_persistent_context(
            executable_path="/usr/bin/chromium-browser",
            user_data_dir="/content/random-user"
        )
        page = await browser.new_page()
        await page.goto("https://google.com")
        title = await page.title()
        print(f"Title: {title}")
        await browser.close()

asyncio.run(main())

I know this is not the right solution but it works.

If you don't want to use context managers then you can start the browser without one using the .start() method:

from playwright.sync_api import sync_playwright

p = sync_playwright().start()
browser = p.chromium.launch(headless=False)
page = browser.new_page()
p.stop()

Remember to use the .stop() method once you are done.

You can use one of those options :

const element = await page.$$("text='element'");
if (element) {
    // ...
}

or

const element = await page.$$("text='element'");
if (element.length) {
    // ...
}

or

await expect(page.locator(".MyClass")).toHaveCount(0)

You can select it by attribute:

self.page.locator('[id=\'#A/BC\']').click()

Doing something similar for a project of mine, this is how I would do it.

from playwright.sync_api import sync_playwright

posts = ['https://playwright.dev/','https://playwright.dev/python/',]

def scrap_post_info(context, post):
    page = context.new_page()
    page.goto(post)
    print(page.title())
    # do whatever scraping you need to
    page.close()

with sync_playwright() as p:
    browser = p.chromium.launch()
    context = browser.new_context()
    for post in posts:
        scrap_post_info(context, post)
        # some time delay

browser.close()

Thing is the code snippet from the playwright docs is more about opening a new page after clicking a link on an existing page. Since you already have the urls ready, you can just visit each page one by one, and do your scraping.