职位详情

登录

Senior AWS EMR Administrator
2.5-4万·13薪
人 · 本科 · 10年及以上工作经验 · 性别不限2024/12/20发布
五险一金补充医疗保险交通补贴餐饮补贴年终奖金绩效奖金弹性工作定期体检专业培训

希尔顿

公司信息
恩梯梯数据(中国)有限公司大连分公司

合资/150-500人

该公司所有职位
职位描述
**Job Summary**:
We are seeking a highly skilled AWS Administrator to join our team. The ideal candidate will be responsible for the administration, configuration, and management of AWS Elastic MapReduce (EMR) clusters and associated applications. Candidate will also manage and optimize a range of AWS services including Glue, Redshift, Lambda, Step Functions, S3, IAM, EC2, Kafka. You will be responsible for ensuring the smooth operation, security, and efficiency of cloud-based systems while leveraging cloud services to build scalable, automated, and secure solutions.

**Key Responsibilities**:

- AWS EMR Cluster Management:
o Deploy, configure, and manage AWS EMR clusters, ensuring optimal performance and scalability.
o Install, configure, and maintain applications running on EMR clusters, such as Hadoop, Spark & Hive.
o Monitor cluster performance and resource utilization, implementing tuning strategies to optimize the performance and cost-efficiency of EMR clusters.
o Implement and manage backup and recovery processes for EMR data and configurations.
o Develop and maintain scripts for automating the deployment and management of EMR clusters and applications.
o Diagnose and resolve issues related to EMR clusters, applications, and data processing jobs.
o Work closely with data engineers, data scientists, and other stakeholders to support their big data processing needs.
- AWS Service Management:
o Administer and manage a variety of AWS services including AWS Glue, Amazon Redshift, AWS Lambda, Amazon S3, Amazon MSK (Kafka), KMS, and Secrets Manager to support data processing, storage, security, and compute needs.
o Implement AWS Step Functions to orchestrate workflows and integrate services like Lambda and Glue for end-to-end automation.
o Configure, manage, and optimize S3 buckets for efficient data storage, including setting up lifecycle policies and access controls.
- Performance Optimization & Automation:
o Optimize the performance and cost-effectiveness of AWS Lambda, Glue, and Redshift deployments through continuous monitoring and best practices.
o Automate infrastructure provisioning and management using Terraform.
o Leverage AWS CloudWatch to monitor performance metrics, set alarms, and implement automated responses to scaling events or failures.
- Collaboration & Support:
o Work with development and data engineering teams to design and implement scalable data pipelines and analytics solutions using Redshift, Glue, and S3.
o Provide operational support for troubleshooting issues related to AWS services, performance bottlenecks, and data inconsistencies.
o Ensure high availability and reliability of critical systems through proactive monitoring, patching, and maintenance.
- Documentation & Best Practices:
o Document architectural designs, configurations, and security policies to maintain a comprehensive knowledge base of the infrastructure.
o Stay up-to-date with the latest AWS developments and recommend improvements to systems, services, and workflows.
o Educate team members on AWS best practices for security, scalability, and cost optimization.

**Qualifications**:
- **Education**: Bachelor’s degree in computer science, Information Technology, or a related field.

- **Experience**:
- Proven experience with AWS services, particularly EMR, EC2, S3, and IAM.
- Strong background in administering big data technologies like Hadoop, Spark, Hive, and Presto.
- Experience with Linux/Unix systems administration.
- Experience with AWS services including Glue, Redshift, Lambda, Step Functions, S3, Kafka, KMS, Secrets Manager, IAM
- Strong understanding of AWS security best practices, including managing IAM roles, KMS, Secrets Manager, and encryption standards.
- Experience with serverless architectures using AWS Lambda and Step Functions.
- Familiarity with data processing, ETL pipelines, and real-time data streaming using AWS Glue and MSK (Kafka).
- Experience with infrastructure-as-code tools such as Terraform is preferred.

- **Skills**:
- Strong knowledge of AWS networking concepts, security protocols, and best practices.
- Proficiency in scripting languages such as Python, Shell, for automation tasks.
- Hands-on experience with monitoring tools like AWS CloudWatch and logging/alerting services.
- Good communication and collaboration skills to work with cross-functional teams.
- **Certifications**: AWS Certified Solutions Architect, AWS Certified Big Data – Specialty, or other relevant certifications are a plus.

**Preferred Qualifications**:
- Understanding of data warehousing concepts and ETL processes.
- Knowledge of data security practices and compliance standards like GDPR and HIPAA.

相关职位
软件开发工程师(大规模版图数据处理)2.5-4万
数据库内核开发工程师(中高级)2.5-5万
数仓开发工程师2-3.5万·15薪
CIM工程师20-40万/年
信息技术部IT数据开发岗2-3万
五险一金绩效奖金定期体检
查看所有职位
51米多多提醒你:在招聘、录用期间要求你支付费用的行为都必须提高警惕。 以招聘为名的培训、招生,许诺推荐其他工作机会,甚至提供培训贷款,或者支付体检 、服装、押金和培训等费用后才能录用工作的,都属于违法行为,应当提高警惕。一经发现,请立即举报,并向当地公安机关报案。

举报

招聘信息 > 上海招聘 > 数据招聘 > 上海数据仓库工程师招聘

收藏

热门职位热门城市周边城市