资深爬虫工程师

2 weeks ago

Global Remote, China H7-Mg Full time CN¥200,000 - CN¥400,000 per year

It's fun to work in a company where people truly BELIEVE in what they're doing

We're committed to bringing passion and customer focus to the business 1. 设计开发维护高性能、分布式爬虫系统,进行多平台多终端信息的抓取 2. 设计和实现高效的数据清洗和预处理方法,确保数据质量 3. 实施并优化多种反检测技术,确保数据采集的持续性和稳定性 4. 提升数据爬取效率,制定优化策略,解决海量存储与读取瓶颈 5. 与AI团队紧密合作,为AI模型提供高质量的训练数据 6. 推动大模型在爬虫场景的应用和落地  技术要求 1. 精通 Python 语言,熟悉多进程、多线程编程、协程编程 2. 熟悉常见的爬虫框架和工具,如Script-Redis、Pyppeteer、Playwright等,具备从0到1搭建爬虫生态系统能力 3. 熟练掌握TCP/IP、HTTP、HTTPS等网络协议,熟悉Web前端技术,包括JS/CSS/HTML 4. 具备大规模分布式爬虫系统设计和开发经验,能够解决分布式爬虫中的挑战和问题,如任务调度、数据同步和去重等 5. 熟悉数据库(如MySQL、Redis、Mongo等)及消息队列(Kafka/RabbitMQ)使用,能够优化数据存储和查询方案 6. 了解常见加密算法,能够分析和解决爬虫中的技术难题,如图片验证码、滑块验证、账号限制、IP封禁、JS加密等难点 7. 有AI大模型赋能爬虫实践经验优先If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us

  • Java工程师

    2 weeks ago

    Global Remote, China G4-Cx Full time CN¥48,000 - CN¥120,000 per year

    It's fun to work in a company where people truly BELIEVE in what they're doing We're committed to bringing passion and customer focus to the business岗位职责:1. 负责微服务治理平台从0到1的搭建;2、负责基础框架的迭代更新;3.

  • 资深数据研发

    3 days ago

    Global Remote, China G13-Cdss Full time

    It's fun to work in a company where people truly BELIEVE in what they're doing We're committed to bringing passion and customer focus to the business- 岗位职责  + 负责内控日志及数据平台整体建设,为内部风控业务提供稳定、高效的数据处理、分析基础设施  +

  • Ui/Ux设计师

    2 weeks ago

    Global Remote, China G13-Cdss Full time CN¥120,000 - CN¥240,000 per year

    It's fun to work in a company where people truly BELIEVE in what they're doing We're committed to bringing passion and customer focus to the

  • Ai平台产品经理

    2 weeks ago

    Global Remote, China H7-Mg Full time CN¥1,500,000 - CN¥2,000,000 per year

    It's fun to work in a company where people truly BELIEVE in what they're doing We're committed to bringing passion and customer focus to the

  • Web3钱包-后端开发工程师

    2 weeks ago

    Global Remote, China H7-Mg Full time CN¥120,000 - CN¥240,000 per year

    It's fun to work in a company where people truly BELIEVE in what they're doing We're committed to bringing passion and customer focus to the

  • 钱包测试工程师

    2 weeks ago

    Global Remote, China H7-Mg Full time CN¥180,000 - CN¥240,000 per year

    It's fun to work in a company where people truly BELIEVE in what they're doing We're committed to bringing passion and customer focus to the business职位描述:1、负责业务线整体质量,

  • 钱包高级工程师

    5 days ago

    Global Remote, China H7-Mg Full time

    It's fun to work in a company where people truly BELIEVE in what they're doing We're committed to bringing passion and customer focus to the

  • 钱包运维工程师

    2 weeks ago

    Global Remote, China H7-Mg Full time CN¥60,000 - CN¥120,000 per year

    It's fun to work in a company where people truly BELIEVE in what they're doing We're committed to bringing passion and customer focus to the

  • 攻防工程师

    2 weeks ago

    Global Remote, China H7-Mg Full time CN¥120,000 - CN¥240,000 per year

    It's fun to work in a company where people truly BELIEVE in what they're doing We're committed to bringing passion and customer focus to the business岗位职责1. 承接高级攻防类测试工作(红队攻防、内网渗透、定制化渗透、持续性渗透等);2. 研究并跟进最新的安全漏洞与安全动态;3....

  • Ai 应用产品经理

    7 days ago

    Global Remote, China H7-Mg Full time CN¥1,200,000 - CN¥3,600,000 per year

    It's fun to work in a company where people truly BELIEVE in what they're doing We're committed to bringing passion and customer focus to the