GhostChain
🇨🇳 Telegram 用户早上好!我们将持续为您带来 Ghost Chain 的新功能和背景信息。
今天我们将开始抓取更多顶级域名 (TLD)。目前,我们的公共网络爬虫已配置为抓取以下顶级域名:AT、BAZAR、BIT、CH、COM、DE、GOV、KZ、LU、RU 和 UA。
接下来我们将抓取 ORG 和 NET 顶级域名。
我们之所以没有一开始就抓取“所有域名”,是因为我们希望逐步扩展,以确保数据质量始终保持高水平,并能够存储不断涌入的 TB 级数据。此外,这也有助于我们迭代优化每个步骤,从而提升抓取速度。
🇺🇸 Good morning Telegram users! We will keep you updated on new features and background info of Ghost Chain.
Today we will start crawling additional TLDs. Currently our public web crawlers are configured to crawl these: AT, BAZAR, BIT, CH, COM, DE, GOV, KZ, LU, RU, UA
Next on the list are ORG and NET.
The reason why we don't simply crawl "everything" is that we want to gradually expand to make sure the data quality remains high and we are able to store the incoming TBs of data. It also allows us to iterate each step and improve crawling speed.
📨 @GhostChainLookupbot
1 · 7.2K ·