Ko te wāhanga piri he whakaritenga proxy e pupuri ana i ngā tono e haere ana i raro i te IP putanga kotahi mō te wā kua whakaritea, i te mea kāore e whakawhiwhia he IP hou i ia tono. Ka taea e taua mau tonu te āwhina i ngā mahi maha pērā i ngā taki, ngā kāri, me ngā utu kia haere tonu me te kore e kite te pae i te huri IP i waenganui i te wāhanga.

I ētahi huarahi, ka taea e koe te whakarite i te roa wā piri, i ētahi wā tae noa ki te 24 haora, ā, ka pau te wāhanga i te wā e pau ana taua wā.

He tikanga tuarua tāna i te taha tūmau. E kī ana a AWS ko te wāhanga piri, e mōhiotia ana hoki hei piri wāhanga, hei pūhiko uta e here ana i te wāhanga o te kaiwhakamahi ki tētahi wāhanga tuarua. E rua ngā tikanga e pupuri ana i tētahi kiritaki ki tētahi mea: ka pupuri te proxy i tō IP putanga, ā, ka pupuri te pūhiko uta i a koe ki tētahi tūmau.

Me pēhea te mahi o ngā wāhanga piri

Ka hanga ētahi huarahi proxy hurihuri i tētahi wāhanga piri mai i tētahi ID wāhanga e tāpiri ana koe ki te ingoa kaiwhakamahi proxy:

  1. Tīpakohia tētahi ID wāhanga: tāpirihia ki te ingoa kaiwhakamahi, me ngā wāhanga wā e tautokohia ana e te huarahi.
  2. Whakamahia anō: ka puta ngā tono e kawe ana i te ID wāhanga kotahi i raro i te IP putanga kotahi.
  3. Tēnā, waihohia hei pau, hei whakakapi: ka noho te IP i whakaritea ki te wā e pau ana te wāhanga. I ētahi whatunga, ka mutu hoki mēnā kāore te wāhanga e whakamahia.
  4. Huri i te ID mō tētahi IP hou: ka whakahauhia e tētahi ID wāhanga hou he IP hou, nō reira ka taea e koe te whakahaere i ngā wāhanga piri maha i te wā kotahi, e noho ana ia ki tana ake IP.

Wāhanga Piri Proxy vs. Pūhiko Uta

Wāhanga piri proxyWāhanga piri pūhiko uta
He aha e noho ana hei mauTō IP putangaTe tūmau tuarua e whakahaere ana i a koe
Ko wai e whakarite anaKoe, mā te ingoa kaiwhakamahi proxyTe kaiwhakahaere o te paetukutuku
Me pēhea e tirohia aiTētahi ID wāhangaTētahi puku, pērā i te AWSALB o AWS, kāore he pātea o tō IP
He aha te take e whakamahia aiKa pupuri i ngā taki me ngā kāri mai i te kite i te huri IPKa tukuna ngā tono katoa o tētahi kaiwhakamahi ki te tūmau kotahi

Ka noho te wāhanga piri i waenganui i ngā kōwhiringa e rua: ka huri te proxy hurihuri i te IP i runga i te hiahia, ā, kāore e huri te proxy pūmau.

Ka whakamahi hoki ngā paetukutuku i ngā wāhanga piri

He maha ngā paetukutuku e whakahaere ana i tā rātou ake piri i muri i te pūhiko uta, ā, ka taea e tētahi scraper te whakakore i taua piri me te kore e mōhio:

  • I runga i ngā puku: e kī ana te aratohu raru a AWS, mēnā kāore te kiritaki e whakauru i te puku AWSALB, kāore e mahi te piri. Ka taea e tētahi scraper te tuku i ngā puku i waenganui i ngā tono, ā, ka taea e ia te tae ki tētahi tūmau rerekē i ia wā.
  • I runga i ngā IP: mā te tikanga IP hash o NGINX, ka tīpako te hash o te IP kiritaki i te tūmau, nō reira ka noho tonu te kiritaki ki te tūmau kotahi. Mēnā ka huri tō IP i waenganui i te rerenga, ka taea e koe te neke ki tētahi tūmau rerekē.

Mēnā ka pupuri te pae i ngā raraunga wāhanga i tētahi tūmau, kāore pea e whai ngā raraunga kāri, kāore hoki e whai te kāri utu. Mā te pupuri i te IP putanga me te puku wāhanga i te wā kotahi e taea ai te karo i tēnei.

Ngā here o ngā wāhanga piri

  • Ka taea e tētahi whāinga e whakaiti ana i ngā tono e pā ana ki te IP te whakahoki i te 429 Too Many Requests i te wā e tuku ana tētahi IP i te nui o ngā tono i roto i te wā kua whakaritea.
  • Mēnā ka riro te IP i te ipurangi i mua i te pau o te wāhanga, ka taea e ētahi huarahi te whakakapi i tētahi IP hou ki te awhina. Ka taea e taua mea te whakakore i tētahi mahi i waenganui, nō reira me hanga he whakahou.
  • I te wā e kati ana te matapihi wāhanga, ka huri te IP, ā, ka taea e tēnā te whakakore i ngā mahi e haere ana.

He aha te tikanga mō te Web Scraping

  • Whakawhiti te wāhanga ki te mahi: tīpakohia tētahi roa wā e kapi ana i te katoa o te rerenga, pērā i te taki ki te utu.

  • Kotahi te ID wāhanga mō ia kaimahi: hoatu ki ia kaimahi rerekē tāna ake ID, nō reira kāore e raru ngā tono me ngā puku i runga i tētahi IP kotahi.

  • Pupuri i tētahi ipu puku mō ia wāhanga: penapena i ngā puku e riro ana i ia wāhanga, ā, tukuna atu i ngā tono katoa i roto i taua wāhanga.

  • Mobile Proxy

  • Proxy Pool

  • IP Ban