ThreadHi everyone, Does anyone know how to fetch a part of HTML?

10 messages · 15:58–11:57

Hi everyone, Does anyone know how to fetch a part of HTML? I mean, for some unknown reason, the information provided on the website is much different than the one I'm fetching through its API. It's a lot more useful. So I wanna fetch that part of website, but I have no idea how to do that or what library I should use.

15:58

A
Alex
bs4?
15:59
1. A
  Artan
  let me see...
  16:00
2. A
  Artan
  When I use it in a for loop, would it mark my IP as suspicious activity? or it's safe to use? Imaging going through 100-1000~ webpages in around 30s...
  16:02
  1. A
    Alex
    Yes, it's quite likely you'll get blocked. It all depends on what the website is doing.
    16:04
  2. M
    mazunki [they/them]
    depends on the site. just set up some rate limits and you'll be fine probably
    16:04
I
Infinity
Try using playwright
08:11
1. 𝔾
  𝔾Ò𝕌ℝ𝔸𝕍 𝕆ℙ 🔱🚩
  ip block problem?
  10:04
  1. [
    [FS]
    Is it possible?
    11:54
    1. 𝔾
      𝔾Ò𝕌ℝ𝔸𝕍 𝕆ℙ 🔱🚩
      Yes 😍🥳
      11:57