हम आपके अनुभव को बेहतर बनाने, साइट उपयोग का विश्लेषण करने और हमारे मार्केटिंग प्रयासों में सहायता के लिए कुकीज़ और समान तकनीकों का उपयोग करते हैं। गोपनीयता नीति
बजट: CNY 25,000-45,000
पोस्ट का समय:
We seek an experienced AI Big Data Engineer to design, optimize, and maintain large-scale data platforms and ML pipelines for AI applications. Ideal candidates possess strong distributed systems knowledge and full-stack data engineering skills, enabling independent architecture of high-throughput, low-latency infrastructure supporting model training, feature engineering, and real-time inference. Key responsibilities: - Build batch-stream unified pipelines (Spark/Flink/Beam); - Implement Lakehouse architectures (Delta Lake/Iceberg/Hudi) for structured/unstructured data; - Develop production-grade feature platforms with offline/near-real-time computation, versioning, and A/B testing; - Partner with ML teams to optimize end-to-end training data supply chains (ingestion → cleaning → labeling → versioning → serving); - Orchestrate ML workflows via Airflow/Dagster/Kubeflow; - Establish observability (metrics, logging, tracing) for data quality and pipeline reliability;