Integrasi dengan Python Requests dan curl_cffi
Ketahui cara menghalakan pengikis Python Requests dan curl_cffi yang meniru TLS melalui proksi mudah alih XProxy 4G/5G dengan pencetus putaran IP automatik apabila menghadapi had kadar HTTP 429/403.
Mengapa menggunakan XProxy dengan Python Requests & curl_cffi?
Python Requests dan curl_cffi (yang meniru cap jari TLS Chrome/Firefox pada peringkat soket) ialah pustaka paling popular untuk pengikisan web yang pantas dan ringan. Menghalakan skrip Python anda melalui proksi mudah alih 4G/5G yang dihoskan sendiri oleh XProxy membolehkan anda memintas pengecaman cap jari TLS Cloudflare dan had kadar IP dengan daya pemprosesan data tanpa had.
Prasyarat
- Python 3.8+ dengan
requestsdancurl_cffidipasang (pip install requests curl_cffi). - Pelayan XProxy yang berjalan dengan dongle USB 4G/5G atau telefon Android yang aktif.
- Kelayakan proksi (IP, Port, Nama Pengguna, Kata Laluan, Pautan API Putaran) daripada Papan Pemuka XProxy.
1. Contoh Python Requests Standard
Berikut ialah skrip lengkap yang menunjukkan putaran IP XProxy automatik apabila menerima kod status HTTP 429 atau 403:
import time
import requests
# --- XProxy Configuration ---
PROXIES = {
"http": "http://username:[email protected]:5001",
"https": "http://username:[email protected]:5001",
}
ROTATION_API_URL = "http://192.168.6.7:8081/api/v1/rotate_ip/position/1"
def rotate_xproxy_ip():
"""Trigger 4G/5G cellular reconnection on XProxy."""
print("🔄 Triggering XProxy IP rotation...")
try:
res = requests.get(ROTATION_API_URL, timeout=10)
if res.status_code == 200:
print("✅ IP rotation requested. Waiting 6 seconds for 4G reconnect...")
time.sleep(6)
return True
except Exception as e:
print(f"❌ Rotation error: {e}")
return False
def scrape_url(url):
for attempt in range(3):
try:
response = requests.get(url, proxies=PROXIES, timeout=15)
# Handle rate limits or anti-bot blocks
if response.status_code in (429, 403):
print(f"⚠️ Encountered HTTP {response.status_code}. Rotating IP...")
rotate_xproxy_ip()
continue
print(f"✅ Success ({response.status_code}): {response.text[:100]}")
return response
except requests.exceptions.RequestException as e:
print(f"❌ Request error: {e}. Retrying with new IP...")
rotate_xproxy_ip()
if __name__ == "__main__":
scrape_url("https://api.ipify.org?format=json")2. Penyamaran TLS dengan `curl_cffi`
Untuk memintas pemeriksaan cap jari TLS Cloudflare & Akamai sambil menggunakan IP mudah alih XProxy 4G/5G, gunakan curl_cffi untuk memalsukan tandatangan TLS pelayar Chrome sebenar:
from curl_cffi import requests
# Configure SOCKS5 or HTTP proxy with Chrome TLS impersonation
proxy_url = "socks5://username:[email protected]:5001"
response = requests.get(
"https://tls.browserleaks.com/json",
proxies={"http": proxy_url, "https": proxy_url},
impersonate="chrome120", # Impersonate Chrome 120 TLS fingerprint
timeout=15
)
print("Status Code:", response.status_code)
print("TLS Response:", response.json())Soalan Lazim
- S: Perlukah saya menggunakan HTTP atau SOCKS5 dengan Python Requests?
J: Pustakarequestsstandard berfungsi dengan baik dengan proksi HTTP. Untuk sokongan SOCKS5 dalam Python Requests, pasangrequests[socks](cth.socks5h://user:[email protected]:5001).
Why High-Quality SOCKS5 UDP & Mobile Proxies Matter for Python Requests & Scrapers
Using cheap datacenter proxies or basic HTTP proxies in antidetect profiles leads to instant account suspensions on Facebook, Google, TikTok, and Amazon. Here is why XProxy's self-hosted 4G/5G mobile proxies deliver superior anonymity and trust:
- SOCKS5 with Full UDP Support: Unlike standard HTTP proxies that drop UDP packets, XProxy SOCKS5 proxies fully support UDP datagrams. This ensures WebRTC, DNS queries, and real-time audio/video sockets route securely through your proxy without revealing your real IP address.
- Instant REST API IP Rotation: Trigger cellular IP rotation on demand via simple HTTP GET requests (e.g.
http://192.168.6.7:8081/api/v1/rotate_ip/position/1). Reconnect 4G/5G USB modems in 3 to 8 seconds with zero proxy dropouts. - 100% WebRTC & DNS Leak Protection: Combined with XProxy's local LAN gateway and TCP OS Spoofing, your browser profiles maintain pristine anonymity scores on BrowserLeaks, Whoer, Pixelscan, and IPhey.
- Carrier-Grade NAT (CGNAT) Trust: Mobile carrier IPs are shared by thousands of active smartphone users. Major platforms never ban mobile IP ranges, granting your accounts maximum trust.
