Sr. Data Engineer

Job Description

Job Description

We are looking for a highly skilled Senior Data Engineer to join our team on a long-term contract basis. In this role, you will design and implement robust data pipelines and architectures to support data-driven decision-making across the organization. You will work closely with cross-functional teams to deliver scalable, secure, and high-performance data solutions using cutting-edge tools and technologies. This position is based in Dallas, Texas.

Responsibilities :

• Develop and maintain scalable data pipelines using tools like Apache Airflow, NiFi, and Databricks to streamline data ingestion and transformation.
• Implement and manage real-time data streaming solutions utilizing Apache Kafka and Flink.
• Optimize and oversee data storage systems with technologies such as Hadoop and Amazon S3 to ensure efficiency and scalability.
• Establish and enforce data governance, quality, and security protocols through best practices and monitoring systems.
• Manage complex workflows and processes across hybrid and multi-cloud environments.
• Work with diverse data formats, including Parquet and Avro, to enhance data accessibility and integration.
• Troubleshoot and fine-tune distributed data systems to maximize performance and reliability.
• Mentor and guide engineers at the beginning of their careers to promote a culture of collaboration and technical excellence.
• Bachelor’s degree in Computer Science, Engineering, or a related discipline.
• At least 7 years of experience in data engineering, with a strong background in designing and managing data pipelines.
• Proficiency in tools such as Apache Kafka, Airflow, NiFi, Databricks, Spark, Hadoop, Flink, and Amazon S3.
• Expertise in programming languages like Python, Scala, or Java for data processing and automation.
• Strong knowledge of both relational and NoSQL databases.
• Experience with Kubernetes-based data engineering and hybrid cloud environments.
• Familiarity with data modeling principles, governance frameworks, and quality assurance processes.
• Excellent problem-solving, analytical, and communication skills.