Ko te wāhanga piri he whakaritenga proxy e pupuri ana i ngā tono e haere ana i raro i te IP putanga kotahi mō te wā kua whakaritea, i te mea kāore e whakawhiwhia he IP hou i ia tono. Ka taea e taua mau tonu te āwhina i ngā mahi maha pērā i ngā taki, ngā kāri, me ngā utu kia haere tonu me te kore e kite te pae i te huri IP i waenganui i te wāhanga.
I ētahi huarahi, ka taea e koe te whakarite i te roa wā piri, i ētahi wā tae noa ki te 24 haora, ā, ka pau te wāhanga i te wā e pau ana taua wā.
He tikanga tuarua tāna i te taha tūmau. E kī ana a AWS ko te wāhanga piri, e mōhiotia ana hoki hei piri wāhanga, hei pūhiko uta e here ana i te wāhanga o te kaiwhakamahi ki tētahi wāhanga tuarua. E rua ngā tikanga e pupuri ana i tētahi kiritaki ki tētahi mea: ka pupuri te proxy i tō IP putanga, ā, ka pupuri te pūhiko uta i a koe ki tētahi tūmau.
Me pēhea te mahi o ngā wāhanga piri
Ka hanga ētahi huarahi proxy hurihuri i tētahi wāhanga piri mai i tētahi ID wāhanga e tāpiri ana koe ki te ingoa kaiwhakamahi proxy:
- Tīpakohia tētahi ID wāhanga: tāpirihia ki te ingoa kaiwhakamahi, me ngā wāhanga wā e tautokohia ana e te huarahi.
- Whakamahia anō: ka puta ngā tono e kawe ana i te ID wāhanga kotahi i raro i te IP putanga kotahi.
- Tēnā, waihohia hei pau, hei whakakapi: ka noho te IP i whakaritea ki te wā e pau ana te wāhanga. I ētahi whatunga, ka mutu hoki mēnā kāore te wāhanga e whakamahia.
- Huri i te ID mō tētahi IP hou: ka whakahauhia e tētahi ID wāhanga hou he IP hou, nō reira ka taea e koe te whakahaere i ngā wāhanga piri maha i te wā kotahi, e noho ana ia ki tana ake IP.
Wāhanga Piri Proxy vs. Pūhiko Uta
| Wāhanga piri proxy | Wāhanga piri pūhiko uta | |
|---|---|---|
| He aha e noho ana hei mau | Tō IP putanga | Te tūmau tuarua e whakahaere ana i a koe |
| Ko wai e whakarite ana | Koe, mā te ingoa kaiwhakamahi proxy | Te kaiwhakahaere o te paetukutuku |
| Me pēhea e tirohia ai | Tētahi ID wāhanga | Tētahi puku, pērā i te AWSALB o AWS, kāore he pātea o tō IP |
| He aha te take e whakamahia ai | Ka pupuri i ngā taki me ngā kāri mai i te kite i te huri IP | Ka tukuna ngā tono katoa o tētahi kaiwhakamahi ki te tūmau kotahi |
Ka noho te wāhanga piri i waenganui i ngā kōwhiringa e rua: ka huri te proxy hurihuri i te IP i runga i te hiahia, ā, kāore e huri te proxy pūmau.
Ka whakamahi hoki ngā paetukutuku i ngā wāhanga piri
He maha ngā paetukutuku e whakahaere ana i tā rātou ake piri i muri i te pūhiko uta, ā, ka taea e tētahi scraper te whakakore i taua piri me te kore e mōhio:
- I runga i ngā puku: e kī ana te aratohu raru a AWS, mēnā kāore te kiritaki e whakauru i te puku
AWSALB, kāore e mahi te piri. Ka taea e tētahi scraper te tuku i ngā puku i waenganui i ngā tono, ā, ka taea e ia te tae ki tētahi tūmau rerekē i ia wā. - I runga i ngā IP: mā te tikanga IP hash o NGINX, ka tīpako te hash o te IP kiritaki i te tūmau, nō reira ka noho tonu te kiritaki ki te tūmau kotahi. Mēnā ka huri tō IP i waenganui i te rerenga, ka taea e koe te neke ki tētahi tūmau rerekē.
Mēnā ka pupuri te pae i ngā raraunga wāhanga i tētahi tūmau, kāore pea e whai ngā raraunga kāri, kāore hoki e whai te kāri utu. Mā te pupuri i te IP putanga me te puku wāhanga i te wā kotahi e taea ai te karo i tēnei.
Ngā here o ngā wāhanga piri
- Ka taea e tētahi whāinga e whakaiti ana i ngā tono e pā ana ki te IP te whakahoki i te
429 Too Many Requestsi te wā e tuku ana tētahi IP i te nui o ngā tono i roto i te wā kua whakaritea. - Mēnā ka riro te IP i te ipurangi i mua i te pau o te wāhanga, ka taea e ētahi huarahi te whakakapi i tētahi IP hou ki te awhina. Ka taea e taua mea te whakakore i tētahi mahi i waenganui, nō reira me hanga he whakahou.
- I te wā e kati ana te matapihi wāhanga, ka huri te IP, ā, ka taea e tēnā te whakakore i ngā mahi e haere ana.
He aha te tikanga mō te Web Scraping
-
Whakawhiti te wāhanga ki te mahi: tīpakohia tētahi roa wā e kapi ana i te katoa o te rerenga, pērā i te taki ki te utu.
-
Kotahi te ID wāhanga mō ia kaimahi: hoatu ki ia kaimahi rerekē tāna ake ID, nō reira kāore e raru ngā tono me ngā puku i runga i tētahi IP kotahi.
-
Pupuri i tētahi ipu puku mō ia wāhanga: penapena i ngā puku e riro ana i ia wāhanga, ā, tukuna atu i ngā tono katoa i roto i taua wāhanga.