Remote Data EngineerCG Infinity • Plano, TX, US
No longer accepting applications
Remote Data Engineer
CG Infinity • Plano, TX, US
22 hours ago
Job type
- Full-time
- Remote
Job descriptionSpark Streaming and its data sources KAFKA, CDC feed, etc Performance optimization and tuning Data transformation and processing Hands on Experience working with cloud-based Spark platforms (Databricks, AWS EMR, AWS Glue) Strong understanding of Hive, Unity catalog, Glue catalog Hands on Experience working with any data quality framework / tools Hands on Experience working with Observability and monitoring for data processing pipelines Strong understanding of distributed computing concepts Proficiency in version control systems (Github / GitLab / Bitbucket) Experience building and maintaining high-volume data processing pipelines Knowledge of data modeling and ETL / ELT best practices Familiarity with SQL and NoSQL databases Understanding of data warehouse concepts and dimensional modeling Experience with real-time data processing and streaming architectures Knowledge of Delta Lake or similar data lakehouse technologies Experience with CI / CD pipelines Cloud platform expertise (AWS / Azure / GCP) Contributions to open-source projects Design and implement scalable data pipelines Optimize existing data workflows for performance and reliability Collaborate with data scientists and analysts to support their data needs Implement data quality checks and monitoring Maintain documentation for data processes and architectures Strong problem-solving abilities Excellent communication skills Team collaboration Ability to work independently Strong attention to detail
Job Description
Job Description
We are seeking an experienced Data Engineer to design, build, and maintain scalable data processing pipelines using modern big data technologies. The ideal candidate will have strong development skills and experience with distributed computing frameworks.
Required Skills & Qualifications :
- Bachelor's degree in Computer Science, Engineering, or related technical field
- 5+ years of software development experience
- Strong proficiency in Python, Java or Scala programming languages
- Extensive hands-on experience with Apache Spark, including :
Spark SQL
Technical Requirements :
Preferred Qualifications :
Key Responsibilities :
Soft Skills :
The ideal candidate should have a proven track record of developing and maintaining production-grade data pipelines and be passionate about working with large-scale data systems.
Powered by JazzHR
9wh3EVa5sH
Create a job alert for this search
Data Engineer Remote • Plano, TX, US
Related jobs
A company is looking for a Senior Data Engineer.Key Responsibilities : Ensure accurate data flow from creation to presentation layers Enhance the Data Engineering stack through containerization, ...Show more A company is looking for a Cloud Data Engineer to design and implement data pipeline services for Azure cloud-based data solutions.
Key Responsibilities Maintain and operate legacy ETL processes a...Show more A company is looking for an AI Engineer to enhance AI-driven Electronic Health Record (EHR) systems.Key Responsibilities : Develop and refine prompts for optimal performance of Large Language Mode...Show more A company is looking for a Lead Data Engineer to lead the development and operationalization of data pipelines for improved health outcomes.
Key Responsibilities Lead the design and implementation...Show more A company is looking for a Data Engineer III.Key Responsibilities Drive cloud solutions utilizing Azure DevOps and Data Bricks Lead data stewardship workgroups and champion metadata and data qua...Show more 
Responsibilities include developing processes to interact with HDFS and Oracle, creating workflows using Autosys, and ensuring ML / AI models are production-ready while working in an agile environmen...Show more A company is looking for a Software Engineer, Data.Key Responsibilities Design, implement, and maintain scalable data ingestion pipelines Design, implement, and maintain scalable APIs for extern...Show more A company is looking for a Data Engineer I to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management procedu...Show more A company is looking for a Senior Engineer - Data Discovery.Key Responsibilities Design, architect, and deploy data discovery and inventory platform Administer tools and processes to implement P...Show more A company is looking for a Senior Data Platform Engineer.Key Responsibilities Expand and maintain the data platform in collaboration with other engineers and data scientists Improve product tele...Show more A company is looking for an AI Red Team Engineer - Dutch.Key Responsibilities Collaborate on adversarial testing of AI systems, including LLMs and multimodal models Craft prompts and scenarios t...Show more 
Location : Dallas, TX – Remote.Senior Data Engineer will be responsible for leading data engineering and ETL projects, mentoring team members, and architecting and developing ETL solutions.Als...Show more A company is looking for a Data Engineer II to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management proced...Show more Portfolio Data Engineer to join their Data Engineering team.Key Responsibilities Write code and design pipeline architecture for data ingestion and analysis Build and enhance pipelines to improv...Show more A company is looking for a Staff Data Engineer to design and maintain data systems that drive analytics and product innovation.
Key Responsibilities Lead the design, development, and maintenance o...Show more A company is looking for a Senior Software Engineer (React / React Native) - Data.Key Responsibilities Design and maintain event-driven pipelines and manage Snowflake administration Collaborate wi...Show more 
Experience working with business to document functional requirement and then develop technical requirement following industry best practice.
Ability to provide accurate estimate for development, tes...Show more A company is looking for a Databricks Data Engineer to join their data engineering and analytics team.Key Responsibilities Design and develop scalable data pipelines using Apache Spark on Databri...Show more A company is looking for a Health Data Analytics Engineer to focus on constructing dbt data models for healthcare analytics products.
Key Responsibilities Design, develop, and maintain dbt data mo...Show more 
We are looking for an onshore Data engineer with the following requirement to start ASAP : .SQL, data profiling, data cleansing, and data modeling experience.
comfortable working with raw data ...Show more
Senior Data Engineer
VirtualVocations • Mesquite, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
Cloud Data Engineer
VirtualVocations • Carrollton, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
AI Engineer
VirtualVocations • Arlington, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
Lead Data Engineer
VirtualVocations • Arlington, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer III
VirtualVocations • Irving, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
Big Data Engineer
Akkodis • Plano, TX, US
Full-time
Last updated: 30+ days ago • Promoted
Data Platform Engineer
VirtualVocations • Mesquite, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer
VirtualVocations • Carrollton, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Discovery Engineer
VirtualVocations • Garland, Texas, United States
Full-time
Last updated: 1 day ago • Promoted
Senior Data Platform Engineer
VirtualVocations • Carrollton, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
AI Red Team Engineer
VirtualVocations • Irving, Texas, United States
Full-time
Last updated: 1 day ago • Promoted
Remote - Senior Data Engineer
Resource Informatics Group Inc • Dallas, TX, US
Remote
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer II
VirtualVocations • Grand Prairie, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Portfolio Data Engineer
VirtualVocations • Carrollton, Texas, United States
Full-time
Last updated: 10 hours ago • Promoted • New!
Staff Data Engineer
VirtualVocations • Arlington, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Software Engineer - Data
VirtualVocations • Carrollton, Texas, United States
Full-time
Last updated: 14 hours ago • Promoted • New!
Snowflake / SAP Data Engineer
Nesco Resource, LLC • Dallas, TX, US
Full-time
Last updated: less than 1 hour ago • Promoted • New!
Databricks Data Engineer
VirtualVocations • Plano, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
Health Data Analytics Engineer
VirtualVocations • Plano, Texas, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer - Remote
IT Vision Group • Dallas, TX, US
Remote
Full-time
Last updated: 30+ days ago • Promoted