100字范文,内容丰富有趣,生活中的好帮手!
100字范文 > Python pyppeteer通过cookie获取数据(cookie爬虫)

Python pyppeteer通过cookie获取数据(cookie爬虫)

时间:2019-10-02 02:53:08

相关推荐

Python pyppeteer通过cookie获取数据(cookie爬虫)

1. 利用EditThisCookie插件获取页面cookie

2. 源码实例

"""set browser"""browser = await launch({"headless": False,"executablePath": "F:\\chrome-win32\\chrome.exe","args": ["--disable-gpu","--disable-web-security","--disable-xss-auditor", # 关闭 XSS Auditor"--no-sandbox","--disable-setuid-sandbox","--allow-running-insecure-content", # 允许不安全内容"--disable-webgl",],"ignoreHTTPSErrors": True # 忽略证书错误})width, height = screen_size()page = await browser.newPage()tasks = [# 设置UAasyncio.ensure_future(page.setUserAgent(random.choice(user_agents))),# 启用JS,不开的话无法执行JSasyncio.ensure_future(page.setJavaScriptEnabled(True)),# 关闭缓存asyncio.ensure_future(page.setCacheEnabled(False)),# 设置窗口大小asyncio.ensure_future(page.setViewport({"width": width, "height": height}))]await asyncio.wait(tasks)cookies = [{},{}]for item in cookies:await page.setCookie(item)"""Search"""url = ""await page.goto(url, {"waitUntil": "networkidle2", "timeout": 30000})

本内容不代表本网观点和政治立场,如有侵犯你的权益请联系我们处理。
网友评论
网友评论仅供其表达个人看法,并不表明网站立场。