Standard Functions

We provide some documents to help you better use the crawler browser

We provide some common open source technology frameworks for you to choose from. Through these technologies, you can explore the basic CDP functions. You can learn to use these technologies such as Puppeteer and Playwright

Scripting Browser supports all features of these frameworks, so you can get support through the official documentation of these technologies.

Technology Stack

Puppeteer

New Page

const page = await page.newPage();  
await page.goto('https://example.com');  

Get Screenshot

await page.screenshot({ path: 'screenshot.png', fullPage: true });

Get HTML

const page = await browser.newPage();  
await page.goto('https://example.com');  
const html = await page.content();

Click on Element

// Wait and click on first result.
await page.locator('.devsite-result-item-link').click()

Selenium

Python

# Start the session
driver = webdriver.Chrome()

# Take action on browser
driver.get("https://www.selenium.dev/selenium/web/web-form.html")

# Request browser information
title = driver.title
driver.implicitly_wait(0.5)

#Find an element
text_box = driver.find_element(by=By.NAME, value="my-text")
submit_button = driver.find_element(by=By.CSS_SELECTOR, value="button")

# Take action on element
text_box.send_keys("Selenium")
submit_button.click()

# Request element information
message = driver.find_element(by=By.ID, value="message")
text = message.text

# End the session
driver.quit()

NodeJs

 // Start the Browser
 driver = await new Builder().forBrowser(Browser.CHROME).build();
 
 // GOTO UTL on browser
 await driver.get('https://www.selenium.dev/selenium/web/web-form.html');
 
 // Request browser information
 let title = await driver.getTitle();
 
 // Waiting
 await driver.manage().setTimeouts({implicit: 500});
 
 // Find an element
 let textBox = await driver.findElement(By.name('my-text'));
 let submitButton = await driver.findElement(By.css('button'));

 // Take action on element
 await textBox.sendKeys('Selenium');
 await submitButton.click();
 
 // Request element information   
 let message = await driver.findElement(By.id('message'));
 let value = await message.getText();
 
 // End the session   
 await driver.quit();

Running

Save the following code (don't forget to enter your credentials!) and run it with the following command: script.js

NodeJS

node your_script.js

Python

python your_script.py