L¨¤m th? n¨¤o ?? v??t qua Cloudflare | S? d?ng Puppeteer v¨¤ Node.JS

Anh Tuan
Data Science Expert
22-Aug-2024

T?i c?m th?y r?ng c¨¤ng nhi?u nhi?m v? t? ??ng h¨®a hi?n nay c¨¤ng ???c ?¨¢nh gi¨¢ cao, v¨¬ v?y c¨¢c th¨¢ch th?c tr? n¨ºn r? r¨¤ng v¨¤ kh¨® kh?n h?n. V¨ª d?, Cloudflare hi?n ?ang cung c?p c¨¢c bi?n ph¨¢p b?o m?t m?nh m? ?? b?o v? c¨¢c trang web kh?i t?t c? c¨¢c c?ng c? t? ??ng h¨®a.
Tuy nhi¨ºn, vi?c ?i?u h??ng qua c¨¢c t¨ªnh n?ng b?o m?t n¨¤y c¨® th? l¨¤ m?t th¨¢ch th?c ??i v?i c¨¢c nh¨¤ ph¨¢t tri?n v¨¤ t? ch?c ?ang th?c hi?n c¨¢c d? ¨¢n t? ??ng h¨®a nh? thu th?p d? li?u, tr¨ªch xu?t d? li?u ho?c ki?m th?. Tuy nhi¨ºn, v?i c¨¢c c?ng c? v¨¤ chi?n l??c ph¨´ h?p, b?n c¨® th? gi?i quy?t hi?u qu? nh?ng th¨¢ch th?c n¨¤y trong khi v?n tu?n th? c¨¢c ti¨ºu chu?n ph¨¢p l? v¨¤ ??o ??c.
Trong h??ng d?n n¨¤y, t?i s? kh¨¢m ph¨¢ c¨¢ch gi?i quy?t hi?u qu? Cloudflare nh? Turnstile b?ng c¨¢ch s? d?ng Puppeteer v¨¤ Node.js v?i s? tr? gi¨²p t? c?ng c? gi?i m? CAPTCHA.
M? th??ng
Nh?n m? th??ng Bonus Code c?a b?n cho c¨¢c gi?i ph¨¢p CAPTCHA h¨¤ng ??u t? CapSolver: WEBS. Sau khi ??i m?, b?n s? nh?n ???c th¨ºm 5% ti?n th??ng sau m?i l?n n?p, kh?ng gi?i h?n.

T¨¬m hi?u v? Turnstile c?a Cloudflare
Turnstile c?a Cloudflare l¨¤ m?t t¨ªnh n?ng b?o m?t ph?c t?p ???c thi?t k? ?? th¨¢ch th?c ng??i d¨´ng c? g?ng truy c?p v¨¤o c¨¢c trang web ???c b?o v?. N¨® s? d?ng s? k?t h?p c?a c¨¢c k? thu?t, bao g?m c¨¢c th? th¨¢ch JavaScript, CAPTCHA v¨¤ ph?n t¨ªch h¨¤nh vi ?? ?¨¢nh gi¨¢ xem ng??i d¨´ng c¨® ph?i l¨¤ ng??i th?t hay kh?ng. ??i v?i c¨¢c nh¨¤ ph¨¢t tri?n, ?i?u n¨¤y c¨® ngh?a l¨¤ vi?c v??t qua Turnstile ?¨°i h?i nhi?u h?n ch? l¨¤ c¨¢c k? thu?t thu th?p d? li?u web truy?n th?ng.
Y¨ºu c?u tr??c
Tr??c khi ?i s?u v¨¤o tri?n khai, h?y ??m b?o b?n c¨® c¨¢c c?ng c? v¨¤ t¨¤i nguy¨ºn sau:
- Node.js: C¨¤i ??t phi¨ºn b?n m?i nh?t c?a Node.js t? trang web ch¨ªnh th?c.
- Puppeteer: M?t th? vi?n Node.js cung c?p API c?p cao ?? ?i?u khi?n Chrome ho?c Chromium kh?ng ??u, h?u ¨ªch cho c¨¢c t¨¢c v? t? ??ng h¨®a.
- Kh¨®a API c?a CapSolver: ??ng k? CapSolver v¨¤ l?y kh¨®a API ?? s? d?ng d?ch v? gi?i m? CAPTCHA.
CapSolver l¨¤ g¨¬?
CapSolver l¨¤ m?t c?ng c? m?nh m? ???c thi?t k? ?? gi¨²p gi?i m? CAPTCHA v¨¤ c¨¢c th¨¢ch th?c t? ??ng kh¨¢c. Khi c¨¢c trang web ng¨¤y c¨¤ng tri?n khai c¨¢c c? ch? b?o m?t ph?c t?p ?? ng?n ch?n bot v¨¤ c¨¢c c?ng c? thu th?p d? li?u, CapSolver cung c?p m?t gi?i ph¨¢p ?¨¢ng tin c?y ?? v??t qua nh?ng tr? ng?i n¨¤y.
C¨¢c t¨ªnh n?ng ch¨ªnh c?a CapSolver:
- Gi?i ph¨¢p CAPTCHA to¨¤n di?n: CapSolver h? tr? nhi?u lo?i CAPTCHA kh¨¢c nhau, bao g?m reCAPTCHA, captcha, Cloudflare, ImageToText v¨¤ nhi?u h?n n?a, cho ph¨¦p gi?i quy?t c¨¢c th? th¨¢ch m?t c¨¢ch li?n m?ch.
- ?? ch¨ªnh x¨¢c cao: S? d?ng c¨¢c thu?t to¨¢n ti¨ºn ti?n v¨¤ m? h¨¬nh h?c m¨¢y, CapSolver ??m b?o ?? ch¨ªnh x¨¢c cao trong vi?c gi?i CAPTCHA, gi?m t? l? th?t b?i v¨¤ n?ng cao hi?u qu?.
- T¨ªch h?p d? d¨¤ng: CapSolver cung c?p API th?n thi?n v?i ng??i d¨´ng, d? d¨¤ng t¨ªch h?p v¨¤o c¨¢c c?ng c? t? ??ng h¨®a hi?n c¨® c?a b?n, bao g?m c? Puppeteer. ?i?u n¨¤y cho ph¨¦p b?n t? ??ng h¨®a vi?c gi?i CAPTCHA nh? m?t ph?n c?a quy tr¨¬nh thu th?p d? li?u ho?c ki?m th? c?a b?n.
- H? tr? 24/7: CapSolver cung c?p h? tr? kh¨¢ch h¨¤ng m?nh m? ?? gi¨²p gi?i quy?t b?t k? v?n ?? ho?c c?u h?i n¨¤o, ??m b?o ho?t ??ng tr?n tru v¨¤ h? tr? k?p th?i.
D??i ??y l¨¤ phi¨ºn b?n chi ti?t h?n v¨¤ gi¨¤u n?i dung h?n c?a ph?n gi?i th¨ªch c?a b?n, k¨¨m theo ph?n k?t th¨²c cho b¨¤i vi?t:
C¨¢c b??c tri?n khai chi ti?t
-
S? d?ng Puppeteer v¨¤ JavaScript ?? g?i API CapSolver v¨¤ truy c?p trang web
- Puppeteer l¨¤ m?t th? vi?n Node.js m?nh m? cho ph¨¦p b?n ?i?u khi?n Chrome ho?c Chromium kh?ng ??u th?ng qua DevTools Protocol. Trong ng? c?nh n¨¤y, n¨® ???c s? d?ng ?? ?i?u h??ng c¨¢c trang web v¨¤ x? l? c¨¢c t??ng t¨¢c ph?c t?p, ch?ng h?n nh? ??i ph¨® v?i CAPTCHA.
-
L?y SiteKey cho Turnstile
- SiteKey l¨¤ m?t y?u t? quan tr?ng c?n ph?i c¨® ?? gi?i quy?t th? th¨¢ch Turnstile. Kh¨®a n¨¤y l¨¤ duy nh?t cho m?i trang web v¨¤ c?n thi?t ?? t??ng t¨¢c v?i API gi?i CAPTCHA. B?n c¨® th? tr¨ªch xu?t SiteKey b?ng c¨¢ch ph?n t¨ªch HTML c?a trang web ho?c s? d?ng c¨¢c c?ng c? nh? Ti?n ¨ªch m? r?ng CapSolver ?? ??n gi?n h¨®a quy tr¨¬nh. ?? c¨® h??ng d?n chi ti?t v? c¨¢ch x¨¢c ??nh c¨¢c th?ng s? c?n thi?t, h?y tham kh?o b¨¤i ??ng tr¨ºn blog c?a ch¨²ng t?i.
-
S? d?ng JavaScript ?? g?i API CapSolver v¨¤ l?y m? th?ng b¨¢o
- Khi b?n ?? c¨® SiteKey, b?n c¨® th? th?c hi?n y¨ºu c?u t?i API CapSolver. ?i?u n¨¤y bao g?m vi?c t?o m?t t¨¢c v? m¨¤ CapSolver s? x? l? ?? gi?i CAPTCHA. API s? tr? v? m?t m? th?ng b¨¢o m¨¤ b?n c¨® th? s? d?ng ?? v??t qua b?o v? Turnstile.
- D??i ??y l¨¤ m?t v¨ª d? v? c¨¢ch t??ng t¨¢c v?i API CapSolver b?ng JavaScript:
javascript
// npm install axios puppeteer-core
const axios = require('axios');
const puppeteer = require("puppeteer-core");
const api_key = "YOUR_API_KEY";
const site_key = "0xxxxxx";
const site_url = "https://xxx.xxx.xxx/xxx";
const proxy = "http://xxx:[email protected]:x"
async function capsolver() {
const payload = {
clientKey: api_key,
task: {
type: 'AntiTurnstileTaskProxyLess',
websiteKey: site_key,
websiteURL: site_url,
metadata: {
action: '', // optional,
type: "turnstile"
},
// proxy: proxy
}
};
try {
const res = await axios.post("https://api.capsolver.com/createTask", payload);
const task_id = res.data.taskId;
if (!task_id) {
console.log("Failed to create task:", res.data);
return;
}
console.log("Got taskId:", task_id);
while (true) {
await new Promise(resolve => setTimeout(resolve, 1000)); // Delay for 1 second
const getResultPayload = {clientKey: api_key, taskId: task_id};
const resp = await axios.post("https://api.capsolver.com/getTaskResult", getResultPayload);
const status = resp.data.status;
if (status === "ready") {
return resp.data.solution.token;
}
if (status === "failed" || resp.data.errorId) {
console.log("Solve failed! response:", resp.data);
return;
}
}
} catch (error) {
console.error("Error:", error);
}
}
const wait = (ms) => new Promise(resolve => setTimeout(resolve, ms));
async function reqSite(){
let coockie;
await capsolver().then(token => {
console.log(token);
coockie = token;
});
const browser = await puppeteer.launch({
headless: false,
executablePath: "Browser Path"
});
const page = await browser.newPage();
await wait(500);
await page.setCookie({
name: "cf_clearance",
value: coockie,
domain: "xx.xx.xx"
});
await wait(500);
await page.goto(site_url);
// TODO
await page.close();
await browser.disconnect();
}
reqSite().then();
- C¨¤i ??t Cookie v?i Puppeteer v¨¤ Truy c?p n?i dung trang
- V?i m? th?ng b¨¢o thu ???c t? CapSolver, b?y gi? b?n c¨® th? c¨¤i ??t c¨¢c cookie ph¨´ h?p trong Puppeteer ?? v??t qua th? th¨¢ch c?a Cloudflare. B??c n¨¤y r?t quan tr?ng v¨¬ n¨® cho ph¨¦p b?n truy c?p v¨¤o n?i dung ???c b?o v? tr¨ºn trang web.
K?t lu?n
Trong h??ng d?n n¨¤y, ch¨²ng ta ?? kh¨¢m ph¨¢ c¨¢ch gi?i quy?t hi?u qu? t¨ªnh n?ng b?o m?t Turnst
ile c?a Cloudflare b?ng c¨¢ch s? d?ng k?t h?p Puppeteer v¨¤ CapSolver. Th?ng qua vi?c s? d?ng c¨¢c c?ng c? v¨¤ ph??ng ph¨¢p ph¨´ h?p, b?n c¨® th? v??t qua c¨¢c th? th¨¢ch t? ??ng h¨®a m?t c¨¢ch hi?u qu?, trong khi v?n ??m b?o tu?n th? c¨¢c ti¨ºu chu?n ??o ??c v¨¤ ph¨¢p l?.
Tuy¨ºn b? Tu?n th?: Th?ng tin ???c cung c?p tr¨ºn blog n¨¤y ch? mang t¨ªnh ch?t tham kh?o. CapSolver cam k?t tu?n th? t?t c? c¨¢c lu?t v¨¤ quy ??nh hi?n h¨¤nh. Vi?c s? d?ng m?ng l??i CapSolver cho c¨¢c ho?t ??ng b?t h?p ph¨¢p, gian l?n ho?c l?m d?ng l¨¤ ho¨¤n to¨¤n b? c?m v¨¤ s? b? ?i?u tra. C¨¢c gi?i ph¨¢p gi?i captcha c?a ch¨²ng t?i n?ng cao tr?i nghi?m ng??i d¨´ng trong khi ??m b?o tu?n th? 100% trong vi?c gi¨²p gi?i quy?t c¨¢c kh¨® kh?n v? captcha trong qu¨¢ tr¨¬nh thu th?p d? li?u c?ng khai. Ch¨²ng t?i khuy?n kh¨ªch vi?c s? d?ng d?ch v? c?a ch¨²ng t?i m?t c¨¢ch c¨® tr¨¢ch nhi?m. ?? bi?t th¨ºm th?ng tin, vui l¨°ng truy c?p ?i?u kho?n D?ch v? v¨¤ Ch¨ªnh s¨¢ch Quy?n ri¨ºng t?.
Th¨ºm

C¨¢ch gi?i quy?t th? th¨¢ch Cloudflare
V??t qua th? th¨¢ch Cloudflare d? d¨¤ng v?i CapSolver. H??ng d?n n¨¤y bao g?m nh?ng ?i?u c?n thi?t ?? gi?i quy?t b?o m?t c?a Cloudflare, ??m b?o ?i?u h??ng th¨¤nh c?ng v?i c¨¢c b??c v¨¤ l?i khuy¨ºn chi ti?t.

Anh Tuan
23-Sep-2025

C¨¢ch gi?i quy?t th? th¨¢ch Cloudflare JS ?? thu th?p d? li?u web v¨¤ t? ??ng h¨®a
T¨¬m hi?u c¨¢ch gi?i quy?t th? th¨¢ch JavaScript c?a Cloudflare ?? thu th?p d? li?u web v¨¤ t? ??ng h¨®a li?n m?ch. Kh¨¢m ph¨¢ c¨¢c chi?n l??c hi?u qu?, bao g?m s? d?ng tr¨¬nh duy?t kh?ng ??u, lu?n phi¨ºn proxy, v¨¤ t?n d?ng kh? n?ng gi?i quy?t CAPTCHA n?ng cao c?a CapSolver.

Anh Tuan
05-Mar-2025

D?u v?n tay TLS c?a Cloudflare: N¨® l¨¤ g¨¬ v¨¤ c¨¢ch gi?i quy?t
T¨¬m hi?u v? vi?c Cloudflare s? d?ng d?u v?n tay TLS ?? b?o m?t, c¨¢ch n¨® ph¨¢t hi?n v¨¤ ch?n bot, v¨¤ kh¨¢m ph¨¢ c¨¢c ph??ng ph¨¢p hi?u qu? ?? gi?i quy?t v?n ?? n¨¤y cho c¨¢c t¨¢c v? thu th?p d? li?u web v¨¤ duy?t web t? ??ng.

Anh Tuan
28-Feb-2025

C¨¢ch tr¨ªch xu?t d? li?u t? trang web ???c b?o v? b?i Cloudflare
Trong h??ng d?n n¨¤y, ch¨²ng ta s? kh¨¢m ph¨¢ c¨¢c k? thu?t ??o ??c v¨¤ hi?u qu? ?? tr¨ªch xu?t d? li?u t? c¨¢c trang web ???c b?o v? b?i Cloudflare.

Anh Tuan
20-Feb-2025

C¨¢ch gi?i quy?t Cloudflare b?ng Python v¨¤ Go v¨¤o n?m 2025
S? chia s? nh?ng hi?u bi?t v? Cloudflare Turnstile, s? d?ng Python v¨¤ Go cho nh?ng t¨¢c v? n¨¤y, li?u Turnstile c¨® th? ph¨¢t hi?n scraper Python, v¨¤ c¨¢ch v??t qua n¨® m?t c¨¢ch hi?u qu? b?ng c¨¢c gi?i ph¨¢p nh? CapSolver.

Anh Tuan
05-Nov-2024

C¨¢ch gi?i quy?t Captcha Turnstile c?a Cloudflare b?ng Selenium
Trong blog n¨¤y, ch¨²ng ta s? th?o lu?n v? m?t s? k? thu?t hi?u qu? ?? v??t qua Cloudflare Turnstile Captchas b?ng Selenium.

Anh Tuan
11-Oct-2024