Big Data Architecture

1. More than 8 years of experience in Big Data technology. Experience building and maintaining a complete 0-1 big data storage and computing platform.
2. Experience in a field encompassing Distributed computing, Data Analytics, and Data Transformation. Especially in IOT data analytics and transformation.
3. Utilize emerging technologies and big data design principles, interfaces, and architecture to support big data and IOT Data storage. Data architecture can especially support large-scale IOT concurrent data writing and querying in real time.
4. Proficient in Hadoop, Hudi, Spark, Doris, MinIO, Flink, etc. to ensure efficient and stable running of each component & cluster.
5. High proficiency in message middleware, such as RabbitMQ, Kafka, etc.
6. High proficiency in Linux commands.
7. Keep learning, and be good at solving and researching complex problems.


1. 8年以上大数据技术经验，有搭建和维护完整0-1大数据存储计算平台的经验。
2. 分布式计算、数据分析、数据转换等领域经验丰富，尤其擅长IOT数据分析与转换。
3. 熟练运用新兴技术和大数据设计原则、接口和架构，支撑大数据和IOT数据存储，尤其能支撑大规模IOT并发数据实时写入和查询。
4. 熟练掌握Hadoop、Hudi、Spark、Doris、MinIO、Flink等，确保各组件&集群的高效稳定运行。
5. 熟练掌握消息中间件，如RabbitMQ、Kafka等。
6. 熟练掌握Linux。
7. 不断学习，善于解决和研究难题。